search

ldaniels528 / trifecta

Trifecta is a web-based and CLI tool that simplifies inspecting Kafka messages and Zookeeper data. Additionally, the CLI tool provides the capability to import/export data to/from ElasticSearch and MongoDB.
http://ldaniels528.github.io/trifecta/
Apache License 2.0
215 stars 50 forks source link

Consumer offsets not displaying (missing partitions) #26

Open mikesparr opened 8 years ago

mikesparr commented 8 years ago

Kafka 0.10.0 on Ubuntu 14.04.04 LTS Trifecta 0.20.0

Using kafka-python client I consume a topic with 9 partitions and then view in Trifecta > Inspect > Consumers > {topic} > {group} and it only displays offsets for a portion of the partitions. I expect to see all partitions.

screen shot 2016-07-01 at 3 01 18 pm

Using the CLI tool I perform the following and it confirms they were all consumed and no lag:

ubuntu@db1:~$ kafka-consumer-offset-checker --group etl-diffs --topic rets.nnrmls.Agent --zookeeper localhost:2181

Group           Topic                          Pid Offset          logSize         Lag             Owner
etl-diffs       rets.nnrmls.Agent              0   3175            3175            0               none
etl-diffs       rets.nnrmls.Agent              1   3691            3691            0               none
etl-diffs       rets.nnrmls.Agent              2   3352            3352            0               none
etl-diffs       rets.nnrmls.Agent              3   3432            3432            0               none
etl-diffs       rets.nnrmls.Agent              4   3111            3111            0               none
etl-diffs       rets.nnrmls.Agent              5   2856            2856            0               none
etl-diffs       rets.nnrmls.Agent              6   3247            3247            0               none
etl-diffs       rets.nnrmls.Agent              7   3690            3690            0               none
etl-diffs       rets.nnrmls.Agent              8   3072            3072            0               none

I upgraded to latest 0.21 and same issue it appears.

screen shot 2016-07-01 at 3 17 39 pm
ldaniels528 commented 8 years ago

I'll take a look, and get it fixed. :-)

ldaniels528 commented 7 years ago

Could you confirm whether these issues still exist in the latest release?

mikesparr commented 7 years ago

Trying to deploy latest release but paths and directories changed (trifecta-ui instead of trifecta_ui folder naming, etc) and broke our build scripts. Fixing and will report. Thanks

mikesparr commented 7 years ago

Hi @ldaniels528 sorry been working on other projects. I upgraded to rc8 a couple months ago and ever since I cannot view the messages any more.

screenshot 2017-05-09 11 08 59

As such, it's difficult to tell if other issue resolved.

mikesparr commented 7 years ago

I'm unsure what changed and I proxy requests to Trifecta via Nginx on web server and haven't had time to troubleshoot. V 0.20 worked fine and then with 0.22.x file names changed and had to update my deploy scripts and the UI hasn't worked since.

likesh1980 commented 6 years ago

I agree, the same happening for me as well. It seems like when I have a broker 0.10.1.x, it works fine, but when I have a broker 0.10.0.x, I can not view the messages. I will try with a different version and see if this helps.