istresearch / scrapy-cluster

This Scrapy project uses Redis and Kafka to create a distributed on demand scraping cluster.
http://scrapy-cluster.readthedocs.io/
MIT License
1.18k stars 324 forks source link

Why Couldn't initialize kafka consumer for topic #115

Closed sangli00 closed 7 years ago

sangli00 commented 7 years ago
[root@bogon kafka-monitor]# python kafka_monitor.py run
2017-04-10 23:19:41,036 [kafka-monitor] DEBUG: Logging to stdout
2017-04-10 23:19:41,036 [kafka-monitor] DEBUG: Creating new kafka consumer using brokers: localhost:9092 and topic demo.incoming
2017-04-10 23:19:41,068 [kafka-monitor] ERROR: Couldn't initialize kafka consumer for topic
2017-04-10 23:19:42,070 [kafka-monitor] DEBUG: Creating new kafka consumer using brokers: localhost:9092 and topic demo.incoming
2017-04-10 23:19:42,099 [kafka-monitor] ERROR: Couldn't initialize kafka consumer for topic
2017-04-10 23:19:44,102 [kafka-monitor] DEBUG: Creating new kafka consumer using brokers: localhost:9092 and topic demo.incoming
2017-04-10 23:19:44,129 [kafka-monitor] ERROR: Couldn't initialize kafka consumer for topic
^C2017-04-10 23:19:44,878 [kafka-monitor] INFO: Closing Kafka Monitor

kafka version: kafka_2.10-0.10.2.0 zookeeper version : zookeeper-3.5.2-alpha redis version: redis-3.2.8

sangli00 commented 7 years ago

I know what happen in this error. My OS hostname is error.