search

elastic / beats

:tropical_fish: Beats - Lightweight shippers for Elasticsearch & Logstash
https://www.elastic.co/products/beats
Other
12.15k stars 4.91k forks source link

Improve Metricbeat Kubernetes Volumes dashboard as currently it doesn't show useful information #39523

Open eedugon opened 4 months ago

eedugon commented 4 months ago

Describe the enhancement:

The main visualization in our [Metricbeat Kubernetes] Volumes default dashboard is not showing useful information, because the volume name is something generic and usually reused by a lot of pods. It could also mislead users.

For example this visualization is a bit meaningless as the names don't really identify much and actually belong to multiple pods:

Screenshot 2024-05-11 at 11 16 20

Also, the metrics on datadir could be misleagind, as they are averages from a lot of real volumes belonging to different pods.

My proposal would be something like this, very similar, but including the pod names. As you can see the information is clearer.

Screenshot 2024-05-11 at 11 15 49

I have included that visualization as part of a bigger dashboard here, in case you want to take a look.

Describe a specific use case for the enhancement or feature:

Kubernetes Monitoring with Metricbeat or Elastic Agent using the volume metricset.

cc: @gizas

elasticmachine commented 4 months ago

Pinging @elastic/obs-ds-hosted-services (Team:obs-ds-hosted-services)

gizas commented 1 month ago

We will keep this issue open because although we have merged an update for the Volumes dashboard still the pod metadata enrichment is not possible without an enhancement (see comment)

To be tracked as part of https://github.com/elastic/beats/issues/39524, where we will need to include the metadata pod watcher in the volume metricset and enrich relevant metrics with pod information