Add delay before reading HTML

matthewmueller / x-ray

The next web scraper. See through the <html> noise.

MIT License

5.88k stars 349 forks source link

Add delay before reading HTML #220

Closed Francisc closed 5 years ago

Francisc commented 8 years ago

Hello,

Is it possible to add arbitrary delay for when to read the markup? If there's JS code on the page that's async, it can change the DOM after parser read it.

Is there a way to work around that?

hackerunet commented 6 years ago

I'm asking the same myself, and a year later you have no respond yet. really bad!!

lathropd commented 5 years ago

If you're using with cheerio, it won't ever run the JavaScript.