yahoo / CMAK

CMAK is a tool for managing Apache Kafka clusters
Apache License 2.0
11.83k stars 2.51k forks source link

lag is smaller than 0 #216

Closed yuankui closed 8 years ago

yuankui commented 8 years ago

hi, my kafka-manager version is : kafka-manager-1.3.0.4

image

patelh commented 8 years ago

Yes, that can happen, if you are using the kafka consumer, we are reading the topic for offsets which is going to be processed much faster then the producer topic offset polling.

yuankui commented 8 years ago

we also setup a https://github.com/quantifind/KafkaOffsetMonitor, how could it show the lag correctly?(at least not smaller than 0)

patelh commented 8 years ago

I'm not certain how KafkaOffsetMonitor gets the producer offsets. It's possible they do it on the fly. Kafka Manager on the other hand allows you to configure the polling period since it is not scalable to attempt to get all the lag for every topic when we render the list of topics page with hundreds of topics. If you don't have a lot of topics, you can reduce the polling period in the cluster config.

yuankui commented 8 years ago

@patelh then how to "configure the polling period since", thx!

patelh commented 8 years ago

Use 1.3.0.7 and change the polling period in the cluster config view.

wangycc commented 5 years ago

How to configure the polling period of 1.3.3.22 version? image