istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.18k stars 323 forks source link

Initial package updates #185

Closed madisonb closed 6 years ago

madisonb commented 6 years ago

Duplicates #160 but is more up to date.

coveralls commented 6 years ago

Coverage Status

Coverage increased (+4.2%) to 70.433% when pulling d346a3afc1de090eb5df9e74ce3f92e09e7e1d96 on update-reqs into c38c13bd1d59e8ed72c24b42fd44ef058b3e569b on dev.