search

linkedin / Burrow

Kafka Consumer Lag Checking
Apache License 2.0
3.75k stars 798 forks source link

'totallag' not documented #510

Open Tiller opened 5 years ago

Tiller commented 5 years ago

Hello, We're thinking about using Burrow for our application to monitor lag / circuit break some components, however, we have a concern regarding the 'totallag' attribute.

Looking at the API, the information we want (the total lag for a given consumer group) is available at /kafka/.../consumer/.../status and /kafka/.../consumer/.../lag with the field 'totallag'.

However, this field doesn't appear to be documented in your wiki ( https://github.com/linkedin/Burrow/wiki/http-request-consumer-group-status ), is it just a mistake in the documentation, or is the field deprecated / not reliable in any way?

Thanks

Tiller commented 4 years ago

Ping?

erkexzcx commented 3 years ago

Documentation of Burrow is a one big mess. They managed to miss documentation of SASL mechanism too... https://github.com/linkedin/Burrow/issues/526#issuecomment-772315238

The more I try to use Burrow, the more I hate it... https://github.com/linkedin/Burrow/issues/681

Tiller commented 3 years ago

Spoiler: we ended up not using borrow to monitor lag

erkexzcx commented 3 years ago

What would you recommend for multi-cluster lag metrics?