bsm / sarama-cluster

Cluster extensions for Sarama, the Go client library for Apache Kafka 0.9 [DEPRECATED]
MIT License
1.01k stars 222 forks source link

Seeing lots of consumer errors with Sarama 1.17.0 #259

Closed jpiper closed 6 years ago

jpiper commented 6 years ago

I'm running Sarama 1.17.0 and sarama-cluster 2.1.14 and Kafka 1.1.0

I was previously running Sarama 1.16.0 and sarama-cluster 2.1.13 and had no issues, but when I upgraded, I keep seeing the following...

2018/08/16 14:29:50 Consumer error: kafka server: The provided member is not known in the current generation.
2018/08/16 14:29:50 Rebalanced: &{Type:rebalance error Claimed:map[] Released:map[] Current:map[]}
2018/08/16 14:29:50 Rebalanced: &{Type:rebalance start Claimed:map[] Released:map[] Current:map[]}
2018/08/16 14:29:53 Consumer error: kafka: invalid configuration (That topic/partition is already being consumed)
2018/08/16 14:29:53 Rebalanced: &{Type:rebalance error Claimed:map[] Released:map[] Current:map[]}
2018/08/16 14:29:53 Rebalanced: &{Type:rebalance start Claimed:map[] Released:map[] Current:map[]}
2018/08/16 14:29:53 Consumer error: kafka server: The provided member is not known in the current generation.
2018/08/16 14:29:53 Rebalanced: &{Type:rebalance error Claimed:map[] Released:map[] Current:map[]}
2018/08/16 14:29:53 Rebalanced: &{Type:rebalance start Claimed:map[] Released:map[] Current:map[]}
2018/08/16 14:29:56 Consumer error: kafka: invalid configuration (That topic/partition is already being consumed)
2018/08/16 14:29:56 Rebalanced: &{Type:rebalance error Claimed:map[] Released:map[] Current:map[]}
2018/08/16 14:29:56 Rebalanced: &{Type:rebalance start Claimed:map[] Released:map[] Current:map[]}

Any idea what could be causing this?

danpmx commented 6 years ago

We've seen it as well, looks like it's related to #258

jpiper commented 6 years ago

if I roll back before that PR to d98592677 (sarama-cluster v2.1.13-7-gd985926) I don't have any issues, so that PR must be to blame

dim commented 6 years ago

reverting ...