danielqsj / kafka_exporter

Kafka exporter for Prometheus
Apache License 2.0
2.11k stars 603 forks source link

Grafana dashboard #32

Open kaplun opened 6 years ago

kaplun commented 6 years ago

This exporter is great because it gives exactly the semantic metrics that are useful with Kafka (rather than the generic JMX ones).

Is there available a Grafana dashboard preconfigured for it?

danielqsj commented 6 years ago

Hi @kaplun, thanks for your feedback. I will add one soon.

kaplun commented 6 years ago

cc: @ballestr

yanchunhuo commented 6 years ago

缺grafana dashboard,啥时候会提供?

chenwumail commented 6 years ago

Your can try it: https://github.com/chenwumail/kafka_exporter/blob/master/kafka_exporter_overview.json

(Only Datasource need change, default is "default", based on grafana 5.1.0)

kafka_exporter_overview

danielqsj commented 6 years ago

@chenwumail Thanks, merged. @kaplun @yanchunhuo You can try it. https://github.com/danielqsj/kafka_exporter/blob/master/kafka_exporter_overview.json

yanchunhuo commented 6 years ago

这个好像不支持不支持集群、多套kafka监控 @danielqsj

wulfuric commented 5 years ago

A couple queries I've found helpful

average change per second for each topic, given a consumer group, calculated over 10 minutes sum(delta(kafka_consumergroup_lag{alias=~'$cluster',consumergroup='$consumergroup'}[10m]) / 900)

And, time until a lag of zero given 15 minute delta's, useful for estimating completion of large loads. (sum(kafka_consumergroup_lag{alias=~'$cluster',consumergroup='$consumergroup'})) / (-1 * sum(delta(kafka_consumergroup_lag{alias=~'$cluster',consumergroup='$consumergroup'}[15m]) < 0)) * 15

chenwumail commented 5 years ago

Good idea, I will take it into consideration soon.

chenwumail commented 5 years ago

@yanchunhuo https://grafana.com/dashboards/7589 dashboard which support multiple kafka, will push back to this project soon.