search

linkedin / Burrow

Kafka Consumer Lag Checking
Apache License 2.0
3.76k stars 800 forks source link

Visualize lag #92

Closed nealbh closed 7 years ago

nealbh commented 8 years ago

Is there a UI to visualize the data returned from the REST calls?

cgosiak commented 8 years ago

Burrow does not have a GUI associated with it. I use kafka-manager which has a pretty intuitive useful GUI

nealbh commented 8 years ago

I'm familiar with kafka-manager, but I was looking for a visualization that works with burrow to show how laggy each partition is and alert me when a partition is not in a good state.

toddpalino commented 8 years ago

Currently, Burrow can notify in 3 ways - email, callout to another web service, or Slack. Right now, there's no UI in Burrow itself, though I would like to add at least a basic one. However, this isn't a high priority at the moment, so someone else is welcome to work on it and submit a PR.

jsvisa commented 8 years ago

@nealbh You can fetch the lag information throw HTTP Endpoint · linkedin/Burrow Wiki , then send those lags to influxdata/influxdb: Scalable datastore for metrics, events, and real-time analytics or other DBs , visualize it by grafana/grafana: Gorgeous metric viz, dashboards & editors for Graphite, InfluxDB & OpenTSDB or tools.

tulios commented 8 years ago

@nealbh I wrote a front-end for burrow, you can try it out https://github.com/tulios/burrow-stats

jsvisa commented 8 years ago

@tulios Sounds great 👍 , but just wonder where you store the history lag.

tulios commented 8 years ago

@jsvisa It's saved locally in the browser (localstorage), you can configured the size of the window (the default is 5min).