search

peopledoc / crappyspider

4 stars 0 forks source link

Add (a) command line option(s) for the allow_domains and start_urls #22

Closed amessinger closed 9 years ago

amessinger commented 9 years ago

In order to switch from local to production crawling for example.