aiven / kafka

Mirror of Apache Kafka
Apache License 2.0
2 stars 1 forks source link

[aiven] workaround to randomize remote fetch partition #52

Closed jeqo closed 1 month ago

jeqo commented 4 months ago

At the moment, it's always the first partition with remote fetch information that gets fetched at a time. This PR is a workaround until better distribution is implemented (either parallel fetching or randomized) by adding a randomizer on the partitions with remote info available.

jeqo commented 1 month ago

Haven't provide the expected results. Closing for now to investigate further