search

Yolean / kubernetes-kafka

Kafka cluster as Kubernetes StatefulSet, plain manifests and config
Apache License 2.0
1.84k stars 733 forks source link

upstream bug: zookeeper 3.5.7 leader election seriously broken #341

Open paulmhh opened 3 years ago

paulmhh commented 3 years ago

Hello,

due to some pending resource changes we thought it might be a good chance to upgrade from 6.0.3 to 6.0.4. That includes a kafka version change from 2.2.1 to 2.4.1

kafka 2.4.1 comes with zookeeper 3.5.7 and we quiet quickly run into this upstream bug (resolved in 3.5.8): https://issues.apache.org/jira/browse/ZOOKEEPER-2164

I would go so far to say that zookeeper 3.5.7 is broken / must not be used (at least in the configuration with 3 nodes that we run) [so we rolled back]

just had a quick peak into master, but as far as I could see master is still using kafka 2.4.1 (and thus bundling zookeeper 3.5.7?) If that is the case, you might consider upgrading that somehow

thanks and best regards Paul

weeco commented 3 years ago

I can confirm that, we migrated away from the version that comes with Apache Kafka and use v3.6.3 now.