search

istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.18k stars 323 forks source link

Does it support python3? #211

Closed xingzhicn closed 5 years ago

madisonb commented 5 years ago

Yes, please see https://github.com/istresearch/scrapy-cluster/pull/126. It's on the dev branch.