IBMStreams / streamsx.kafka

Repository for integration with Apache Kafka
https://ibmstreams.github.io/streamsx.kafka/
Apache License 2.0
13 stars 9 forks source link

support incremental cooperative rebalancing #218

Closed ghost closed 3 years ago

ghost commented 4 years ago

With Kafka 2.4 cooperative incremental rebalancing has been introduced (KIP-429). The semantics of the ConsumerRebalanceListener.onPartitionsAssigned(partitions) changes compared with the older eager rebalancing protocol. These assumption from the old behaviour, (onPartitionsAssigned hands all assgined partitions) must not be taken any more by the implementation.

When in consistent region, the eager partition assignment must be enforced.