search

bsm / sarama-cluster

Cluster extensions for Sarama, the Go client library for Apache Kafka 0.9 [DEPRECATED]
MIT License
1.01k stars 222 forks source link

Consumer Issue in decoding packet #265

Closed harshitdx29 closed 6 years ago

harshitdx29 commented 6 years ago

Hi I am creating a consumer using the following code:

brokersList := strings.Split(config.Config.KafkaConfig.Brokers, ",")
    topicsList := strings.Split(config.Config.KafkaConfig.Topic, ",")
    consumerGroup := config.Config.KafkaConfig.ConsumerGroup
    bsmConfig := cluster.NewConfig()
    bsmConfig.Consumer.Return.Errors = true
    bsmConfig.Group.Return.Notifications = true
    //bsmConfig.Consumer.Offsets.Initial = sarama.OffsetOldest
    bsmConfig.Version = sarama.V0_10_1_0
    consumer, err := cluster.NewConsumer(brokersList, consumerGroup, topicsList, bsmConfig)

I am getting the following error:

kafka: error while consuming topic_harshit/0: kafka: error decoding packet: CRC didn't match
dim commented 6 years ago

That sounds like a producer/protocol issue. Sorry, but sarama-cluster fully relies on https://github.com/Shopify/sarama for consuming messages, it doesn't do anything to them. It's something you may need to raise with them.