search

elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.77k stars 8.17k forks source link

[Metrics UI] Host name and kubernetes node name are used to join metrics, but don't always match up #128267

Closed weltenwort closed 4 months ago

weltenwort commented 2 years ago

:lady_beetle: Problem description

Recent investigations into failures to display Kubernetes node metrics suggest that there is a mismatch between the node name added by the add_kubernetes_metadata and the host name added by the add_host_metadata in metricbeat. The mismatch has been observed to be caused by different characteristics:

  1. the host name is not lower-cased while the k8s node name is
  2. the host name is the FQDN while the k8s node name isn't

Neither is "techically incorrect" according to the respective specs, but causes a problem for us because the inventory and node details use them to join the data.

:question: Potential solutions

It's not clear which would be the correct solution:

  1. somehow try to normalize the values in beats
  2. find a different field to join the metrics in the UI
elasticmachine commented 2 years ago

Pinging @elastic/infra-monitoring-ui (Team:Infra Monitoring UI)

miltonhultgren commented 2 years ago

@endorama Do you have any more thoughts to add or options we can consider for a solution?

roshan-elastic commented 1 year ago

Prioritising low - we will most likely pick this up when we revisit the asset views for K8s

elasticmachine commented 10 months ago

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)

botelastic[bot] commented 4 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

smith commented 4 months ago

We're not prioritizing this work at this time.