jonstuebe / product-scraper

Node.js based scraper for ecommerce sites
MIT License
21 stars 6 forks source link

Walmart and React #1

Open pcanterini opened 8 years ago

pcanterini commented 8 years ago

Looks like Walmart updated their product page and most of it is now driven by JS after the page is loaded. That means cheerio won't be able to parse most of the content since it only reads the initial HTML.

It might be a good idea to consider using something like PhantomJS or SlimerJS