linkedin / Burrow

Kafka Consumer Lag Checking
Apache License 2.0
3.75k stars 798 forks source link

Cannot get consumer list on certain kafka cluster #445

Open hejiaji opened 6 years ago

hejiaji commented 6 years ago

The config:

[general]
pidfile="burrow.pid"

[zookeeper]
servers=[ "localhost:2181" ]
timeout=6
root-path="/burrow"

[evaluator.mystorage]
class-name="caching"
minimum-complete=1.0

[cluster.test]
class-name="kafka"
servers=[ "localhost:9092" ]

[consumer.test]
class-name="kafka"
cluster="test"
servers=[ "localhost:9092" ]

[consumer.consumer-group-id]
class-name="kafka"
cluster="test"
servers=[ "localhost:9092" ]

[httpserver.default]
address=":8000"
timeout=300

[storage.default]
class-name="inmemory"
workers=20
intervals=30
min-distance=60

From the screenshot we can see that the consumer offset is committed

screen shot 2018-08-22 at 12 18 27 am

Any insight of this?

hejiaji commented 6 years ago

BTW, the Kafka version is 2.0, it works well in kafka 1.0.1

lukaalex commented 6 years ago

I think there is an issue with Kafka 2.0. I believe it is related to this library that burrow uses https://github.com/Shopify/sarama