[Question] Get consumer offset/lag of each partition from the producer side

robinhood / faust

Python Stream Processing

Other

6.7k stars 538 forks source link

[Question] Get consumer offset/lag of each partition from the producer side #752

Open alecuba16 opened 2 years ago

alecuba16 commented 2 years ago

Is it possible to know what is the current offset/lag of the consumer at each partition for a given topic?

I'm looking to implement a task queue balancing problem. Is it possible to manage this with Faust or should it be done with the alternative kafka-python library?