search

skroutz / rafka

Kafka proxy with a simple API, speaking the Redis protocol
https://engineering.skroutz.gr/blog/kafka-rails-integration/
GNU General Public License v3.0
8 stars 0 forks source link

Newly-spawned consumers lagging shutdown #73

Closed agis closed 4 years ago

agis commented 6 years ago

If a consumer is spawned and the server immediately (or in fact, before the consumer has been assigned a partition) receives a signal to shutdown, the consumer will take a lot time to close (even 20" in production).

We need to find out why. No matter what solution we find, I believe we should have a hard limit timeout for safety.

agis commented 4 years ago

Cannot reproduce with librdkafka 0.11.6 or later.