Report Kafka Offset lag in seconds

jaegertracing / jaeger

CNCF Jaeger, a Distributed Tracing Platform

https://www.jaegertracing.io/

Apache License 2.0

19.89k stars 2.37k forks source link

Report Kafka Offset lag in seconds #1072

Open vprithvi opened 5 years ago

vprithvi commented 5 years ago

Requirement - what kind of business use case are you trying to solve?

Currently, offset lag is reported in number of messages which is difficult to contextualize without also looking at number of incoming messages and rate of processing

Proposal - what do you suggest to solve the problem or improve the existing situation?

Compute offset lag in minutes and emit metric

Any open questions to address

yurishkuro commented 5 years ago

Are you planning to add this?

vprithvi commented 5 years ago

@yurishkuro Indeed! I'll have a diff up in a day or so. Sadly, we can't benefit from this internally yet.