tchiotludo / akhq

Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...
https://akhq.io/
Apache License 2.0
3.37k stars 653 forks source link

Failed to display some message #152

Closed KhoiDinh closed 3 years ago

KhoiDinh commented 4 years ago

After writing to the topic, kafkahq doesnt show thwe newly committed message. I check and it is inside the topic via consumer console. What is the sync time?

tchiotludo commented 4 years ago

Really weird behavior.

The only thing I can see is that KafkaHQ only read commited message, you can change this option : https://github.com/tchiotludo/kafkahq/blob/36e4902de1b1e86399383caed3ee6ee20c314689/src/main/resources/application.yml#L78 Or the Kafka API is timeout during the poll of message, for this you can raise the kafkahq.topic-data.poll-timeout option to see if it works

KhoiDinh commented 4 years ago

I cant see any messages after the 53rd message. Also, sorting of any kind on topics' messages dont work either.

tchiotludo commented 4 years ago

Do you have tried to change the parameters below ? Does the pagination works on some page and stop working after ?

KhoiDinh commented 4 years ago

fixed it. it doesn't work on internet explorer but i can see all the messages after sorting them from newest to oldest on google chrome. is there a way we can see all the messages, like a next page button, without having to specify a filter or order?

tchiotludo commented 4 years ago

There is a pagination here : image

KhoiDinh commented 4 years ago

tried that on google chrome. Doesn't work is "sort" is oldest but works if sort is "newest". Same goes for the other filter/sorting tabs. They only work when "sort" is newest. If i use the pagination when sort=oldest, some messages are missing but when i change sort to equal "newest", it works

tchiotludo commented 4 years ago

We need to provide me some log of application , some more details or some screenshots.

Seems to be related to your Kafka cluster topology. Like topic with lot's of compacted record. Really hard without cluster in front of me.

When you say it don't work, was do you see ? Do you have configuration I send you, and what is the value of this config ?

KhoiDinh commented 4 years ago

isolation.level: read_committed

this is what i see:

Capture

There should be more messages after this, as show here after setting the sort=newest:

Capture
tchiotludo commented 4 years ago

Do you have to go to next page ? KafkaHQ can't display exactly the same number of items per page due to Kafka api. If not, Maybe if there is no sensitive data, can you provide me a dump of your topic with kafkacat in json ?

KhoiDinh commented 4 years ago

for both of them i have to go to the next page. but when i do next page when sort=oldest, missing information whereas next page with sort=newest, all data is there

tchiotludo commented 4 years ago

Really weird, Is the kafkacat dump is possible for you ?

KhoiDinh commented 4 years ago

its not possible for me unfortunately

tchiotludo commented 4 years ago

@Ranganath9979 really don't understand the question ...?

tchiotludo commented 4 years ago

still not understandable ! and seems to be not related to current issue

tchiotludo commented 3 years ago

closing due to inactivity, fell free to reopen