zendesk / racecar

Racecar: a simple framework for Kafka consumers in Ruby
Apache License 2.0
486 stars 93 forks source link

Configurable strategy for consuming multiple topics #363

Closed bestie closed 8 months ago

bestie commented 8 months ago

The current ConsumerSet implementation will only switch topics when the current topic returns no messages after the poll timeout.

This is not practical when one or more of the topics has a 'high' message volume as the broker will always return a message and Racecar may never switch to poll the other topics.

dasch commented 8 months ago

Any reason to make this configurable? Round robin seems like the only setup that makes sense here...