search

wvanbergen / kafka

Load-balancing, resuming Kafka consumer for go, backed by Zookeeper.
MIT License
373 stars 141 forks source link

Lots of logs such as "abandoned subscription to xxx because consuming was taking too long" #109

Closed sparkthu closed 7 years ago

sparkthu commented 7 years ago

What does it means and what should I do?

wvanbergen commented 7 years ago

This message comes from sarama: https://github.com/Shopify/sarama/blob/482c471fbf73dc2ac66945187f811581f008c24a/consumer.go#L652-L655

The thing to do is raise timeout to a level well above what it takes your application to process a single message.