Skip to content

Instantly share code, notes, and snippets.

@gfpoliva
Last active October 18, 2021 02:27
Show Gist options
  • Save gfpoliva/f0dc9fc7fbeb14e31abb25d246c3e5b5 to your computer and use it in GitHub Desktop.
Save gfpoliva/f0dc9fc7fbeb14e31abb25d246c3e5b5 to your computer and use it in GitHub Desktop.
ML Scraping
const scrapper = () => {
const containers = document.querySelectorAll('.andes-card.andes-card--flat.andes-card--default.ui-search-result.ui-search-result--core.andes-card--padding-default.andes-card--animated');
const infos = [];
containers.forEach(container => {
const link = container.querySelector('a').href;
const contentContainer = container.querySelector('a .ui-search-result__content-wrapper');
const rawPrice = contentContainer.querySelector('div.ui-search-price.ui-search-price--size-medium.ui-search-item__group__element')
const rawDescription = contentContainer.querySelector('.ui-search-item__title.ui-search-item__group__element');
if (rawPrice && rawDescription) {
let price = parseInt(rawPrice.innerText.split(' ')[0]);
const description = rawDescription.innerText;
if (!price) {
price = parseInt(rawPrice.innerText.split(' ')[1])
}
if (price < 1000) return;
infos.push({
description,
link,
'price': parseInt(price)
});
}
});
console.table(infos);
}
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment