binux / pyspider

A Powerful Spider(Web Crawler) System in Python.
http://docs.pyspider.org/
Apache License 2.0
16.5k stars 3.69k forks source link

how to run javascript many times on a page in phantomjs@pyspider? #454

Open dhcn opened 8 years ago

dhcn commented 8 years ago

for example : ajax pagination data crawl

binux commented 8 years ago

setInterval

note that, there is a timeout limit for every request.