nrabinowitz / pjscrape

A web-scraping framework written in Javascript, using PhantomJS and jQuery
http://nrabinowitz.github.io/pjscrape/
MIT License
997 stars 159 forks source link

Calling pjscrape via commandline and append Results to File #59

Closed dasraab closed 9 years ago

dasraab commented 9 years ago

Is there any to call pjscrape via commandline? like pjscrape.sh my_config.json "http://myurl.org" and append the results to a file?

i´ve to scrape thousends of similar sites (only id in url changes). all those urls are saved in a database.... so cli-call would be perfect...

thanks for your help! great project!

nrabinowitz commented 9 years ago

Have you read the docs? It's a command line tool, that's the whole point... Take a look at the readme and let me know if you still have questions...

dasraab commented 9 years ago

yes i´ve read the docs... the main question is how i can set the url that has to be crawled by commandline call... can you give me a hint?

LunarDevelopment commented 7 years ago

Poor form from owner on not answering this.

"Here's some code, no I'm not telling you how to use it."