search

nrabinowitz / pjscrape

A web-scraping framework written in Javascript, using PhantomJS and jQuery
http://nrabinowitz.github.io/pjscrape/
MIT License
996 stars 159 forks source link

pjscrape with proxy #33

Open antoniopenta opened 11 years ago

antoniopenta commented 11 years ago

Hello I run a pjscrape script using the proxy settings in phantomjs , someting like

phantomjs --proxy=ip:port pjscrape.js my_config.js scraping.js

but I get the following error :

ERROR: Page did not load (status=fail)

Any Idea, I use different proxy ip and they work within firefox browser..?

Thanks

raitucarp commented 11 years ago

cc @nrabinowitz

antoniopenta commented 11 years ago

The solution was to use http://casperjs.org/ with phantomjs options..