search

bda-research / node-webcrawler

Crawler is a web spider written with Nodejs. It gives you the full power of jQuery on the server to parse a big number of pages as they are downloaded, asynchronously
MIT License
41 stars 7 forks source link

Waiting for asynchronous event listeners? #7

Open jackyon opened 8 years ago

jackyon commented 8 years ago

is there any method/options that i can use to deal with async loading data?

i used casperJS before, the "wait" methods are very useful.

http://docs.casperjs.org/en/latest/modules/casper.html#wait

plz advise, thx.

mike442144 commented 8 years ago

Actually, crawler will not load async scripts or ajax, you have to do it by yourself, that is , queue the ajax url.