FATAL ERROR: Config file not found

nrabinowitz / pjscrape

A web-scraping framework written in Javascript, using PhantomJS and jQuery

http://nrabinowitz.github.io/pjscrape/

MIT License

997 stars 159 forks source link

FATAL ERROR: Config file not found #26

Open spoom opened 11 years ago

spoom commented 11 years ago

It is not possible to pass any arguments to the script, cause there is an error evaluating the arguments: phantomjs pjscrape/pjscrape.js pjs.config.js fooparm FATAL ERROR: Config file not found: fooparm

nrabinowitz commented 11 years ago

That's correct, at the moment all parameters passed to Pjscrape are interpreted as config files. What are you trying to pass in?

spoom commented 11 years ago

The url to scrape and maxDepth. http://pastebin.com/QjVATqDx

BTW: The site http://www.zeit.de/video/index is not working

Opening http://www.zeit.de/video/2012-09/1835172200001#autoplay ERROR: Page did not load (status=fail): http://www.zeit.de/video/2012-09/1835172200001#autoplay

I think they are detecting to much requests and then ban the IP. I think a "break" or delay would be good.

Thanks!