nrabinowitz / pjscrape

A web-scraping framework written in Javascript, using PhantomJS and jQuery
http://nrabinowitz.github.io/pjscrape/
MIT License
997 stars 159 forks source link

Take urls from the command line #8

Open nrabinowitz opened 12 years ago

nrabinowitz commented 12 years ago

Settings in pjs.config() will cascade down to all suites. So you could set your suite settings this way, and then add a conditional block to the CL argument parsing, around here, that would check for urls instead of file names, and, if found, do:

pjs.addSuite({ url: configFile });

I'd have to think whether there are any issues adding many individual suites if many urls were supplied...