Scrapy Cluster 1.1 Merge

istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.

http://scrapy-cluster.readthedocs.io/

MIT License

1.18k stars 324 forks source link

Closed madisonb closed 8 years ago

madisonb commented 8 years ago

This PR adds all the documentation and code for Scrapy Cluster 1.1 to the main master branch.