Parsely / pykafka

Apache Kafka client for Python; high-level & low-level consumer/producer, with great performance.
http://pykafka.readthedocs.org/
Apache License 2.0
1.12k stars 232 forks source link

RdKafkaException: (-170, 'Local: Not implemented') #899

Open lekhajk opened 5 years ago

lekhajk commented 5 years ago

I am getting the RdKafkaException: (-170, 'Local: Not implemented') error while trying to consume a message from the consumer. Following is the stack trace:


RdKafkaException                          Traceback (most recent call last)
<ipython-input-25-c071b94bc998> in <module>()
----> 1 for m in consumer:
      2     p.append(m)
      3 

/usr/local/lib/python2.7/dist-packages/pykafka/simpleconsumer.pyc in __iter__(self)
    459         """Yield an infinite stream of messages until the consumer times out"""
    460         while True:
--> 461             message = self.consume(block=True)
    462             if not message:
    463                 return

/usr/local/lib/python2.7/dist-packages/pykafka/rdkafka/simple_consumer.pyc in consume(self, block, unblock_event)
    108         timeout_ms = self._consumer_timeout_ms if block else 1
    109         try:
--> 110             msg = self._consume(timeout_ms, unblock_event)
    111         # if _rdk_consumer is None we'll catch an AttributeError here
    112         except (RdKafkaStoppedException, AttributeError) as e:

/usr/local/lib/python2.7/dist-packages/pykafka/rdkafka/simple_consumer.pyc in _consume(self, timeout_ms, unblock_event)
    134                 if unblock_event and unblock_event.is_set():
    135                     return
--> 136                 msg = self._rdk_consumer.consume(inner_timeout_ms)
    137                 if msg is not None:
    138                     return msg

RdKafkaException: (-170, 'Local: Not implemented')```

**PyKafka version**: 2.8.0
**Kafka version**: 0.11.0
emmettbutler commented 5 years ago

Thanks @lekhajk. How did you install pykafka, and what code are you using to replicate this issue?

carsonip commented 5 years ago

@lekhajk Do you have your librdkafka's version? Will an upgrade of librdkafka fix this?