Search messages with sort OLDEST gets super slow if there are any empty topics

tchiotludo / akhq

Kafka GUI for Apache Kafka to manage topics, topics data, consumers group, schema registry, connect and more...

https://akhq.io/

Apache License 2.0

3.42k stars 661 forks source link

Search messages with sort OLDEST gets super slow if there are any empty topics #2002

Open joachimovesen opened 6 days ago

joachimovesen commented 6 days ago

Partitions are no longer being polled in parallel when using OLDEST sort (since PR #1843 ). This means that for each search request you have to wait for \<configured-poll-timeout> * amount of empty topics. For example if the poll-timeout is set to 10 seconds and there are 3 empty partitions then the minimum response time for the request is 30 seconds.

AlexisSouquiere commented 5 days ago

Figured out the same. Need to work on it but I didn't have time yet