zalando / nakadi

A distributed event bus that implements a RESTful API abstraction on top of Kafka-like queues
https://nakadi.io
MIT License
952 stars 292 forks source link

Use Kafka consumer pool always, if it is there #1514

Closed a1exsh closed 1 year ago

a1exsh commented 1 year ago
  1. For misc we always want to use the consumer pool to reduce the rate of creating consumers.
  2. For the actual consumption stack we will be creating consumers normally.
a1exsh commented 1 year ago

:+1:

adyach commented 1 year ago

it is unexpected that pool can be 0 size, but making decision to create consumer or take from the pool at the timelag checker level requires a lot of code changes, os we agreed to remake it if it has positive effect.

adyach commented 1 year ago

👍