search

istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.18k stars 323 forks source link

Missing KAFKA_PRODUCER_TOPIC in docker rest settings #194

Closed aafeher closed 6 years ago

aafeher commented 6 years ago

Hi Madison, rest/settings.py has KAFKA_PRODUCER_TOPIC = 'demo.incoming', but docker/rest/settings.py hasn't. So I can't overwrite from docker environment.

madisonb commented 6 years ago

Thanks for the bug report! This is actually fixed thanks to #136, and currently lives on the dev branch.

I am long overdue for a release at this point. Please let me know if you have any further questions.