Kafka cooperative rebalance

haskell-works / hw-kafka-client

Kafka client for Haskell, including auto-rebalancing consumers

MIT License

139 stars 50 forks source link

Kafka cooperative rebalance #192

Open caiquefigueiredo opened 2 years ago

caiquefigueiredo commented 2 years ago

Hey, there! Is there some way to use cooperative assignment strategy? I've tried changing the configuration partition.assignment.strategy to cooperative-sticky (related librdkafka docs) but got the following error:

Group "group": application *assign() call failed: Changes to the current assignment must be made using incremental_assign() or incremental_unassign() when rebalance protocol type is COOPERATIVE

AlexeyRaga commented 1 year ago

Hi, I am not aware of such a protocol and have not tried to use this strategy myself. Perhaps deserves an investigation.

RahulXTmCoding commented 11 months ago

@caiquefigueiredo @AlexeyRaga I have raised a pr for the support of cooperative rebalance

https://github.com/haskell-works/hw-kafka-client/pull/198

This should fix the problem you are facing. I had the similar usecase.