search

elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.76k stars 8.17k forks source link

[Monitoring] Provide logstash queue depth in node list #26749

Open matschaffer opened 5 years ago

matschaffer commented 5 years ago

Describe the feature:

Provide logstash_stats.queue.events_count as a "queue depth" metric in the logstash monitoring UI.

Describe a specific use case for the feature:

Today we get "Events ingested" which combined with CPU can give a rough idea of where to look for overwhelmed logstash nodes.

But we've found logstash_stats.queue.events_count metric (already provided from logstash in the metrics index documents) to be a much better indicator of a node that needs to be removed from rotation to let drain.

We can build visualizations for now, but could be good to get this into the default monitoring view.

Related to https://github.com/elastic/kibana/issues/18407

elasticmachine commented 5 years ago

Pinging @elastic/kibana-monitoring

ycombinator commented 5 years ago

Re-pinging @elastic/stack-monitoring

cachedout commented 5 years ago

@matschaffer Could you please take a look and see if this is what you are looking for? https://github.com/elastic/kibana/pull/42161