KIP-429: Kafka Consumer Incremental Rebalance Protocol - Githubissues

kafka4beam / brod

Apache Kafka client library for Erlang/Elixir

Apache License 2.0

650 stars 197 forks source link

KIP-429: Kafka Consumer Incremental Rebalance Protocol #524

Open robsonpeixoto opened 1 year ago

robsonpeixoto commented 1 year ago

Are there plans to add "Kafka Consumer Incremental Rebalance Protocol" support?

References:

zmstone commented 1 year ago

Hi. @robsonpeixoto No, not at the moment .

zmstone commented 1 month ago

Just to clarify a bit. Brod has the apis ready for this.

If one wants a different partition assignment strategy, they need to implement this behavior https://github.com/kafka4beam/brod/blob/c34fa870f00719fee6bc4cbff04f12121f08be6d/src/brod_group_member.erl#L55

For incremental rebalancing, one should not have to revoke assignments. https://github.com/kafka4beam/brod/blob/c34fa870f00719fee6bc4cbff04f12121f08be6d/src/brod_group_member.erl#L87