elastic / kibana

Your window into the Elastic Stack
https://www.elastic.co/products/kibana
Other
19.47k stars 8.04k forks source link

[Kubernetes]K8s Dashboard Visualisation is not showing anyn information #186616

Open gizas opened 1 week ago

gizas commented 1 week ago

Kibana version: 8.14.0

Describe the bug: Only Pods visualisation of Kubernetes Cluster Overview Dashboard is not showing any information!

The specific Pods Visualisation uses runtime fields in order to create a range of specific metrics based on the value of a specific metric: the kubernetes.pod.status.phase.

For eg it creates the Running metric with value 1 when:

if (doc['kubernetes.pod.status.phase'].value == 'running') {emit(1) }

Same fields called Pending, Succeeded, Failed are being created per doc['kubernetes.pod.status.phase'].value

Steps to reproduce:

  1. Install k8s cluster
  2. Install Elastic Agent with default K8s Integration policy
  3. Open [Metrics Kubernetes] Cluster Overview The Pods Visualisation does not show anything

Expected behavior: Pods Visualisation to show the values of the Pods in cluster

Screenshots (if relevant): Screenshot 2024-06-21 at 2 16 02 PM

I have confirmed that data is there and the Explore In Discover of relevant Visualisation returns metrics:

Screenshot 2024-06-21 at 2 15 21 PM

Provide logs and/or server output (if relevant): I have created a copy from another Visualisation and edit it with the same configuration options like the non-working one. As said before, the specific visualisation uses some runtime fields to populate some new field. The weird thing is that the new duplicated Visualisation is working.

See the comparison below: Screenshot 2024-06-21 at 2 23 46 PM

Any additional context:

elasticmachine commented 1 week ago

Pinging @elastic/obs-ux-infra_services-team (Team:obs-ux-infra_services)

gizas commented 1 week ago

@elastic/obs-ux-infra_services-team please let me know if this is the correct team that handles Lens/ visualisation issues or I need to forward this to another team

mlunadia commented 1 week ago

@teresaalvarezsoler not sure if this falls into one of the teams you work with. This dashboard is our presentation to K8s users after onboarding and crucial that it works flawlessly. Any help you can provide would be great! cc: @akhileshpok

akhileshpok commented 1 week ago

cc @flash1293. Is it possible to somehow link this issue to the Onboarding board, in order to help with tracking? Thanks

flash1293 commented 1 week ago

@akhileshpok I don't think this should be on the onboarding initiative, it looks like an integration issue - maybe the field names changed or something like this and the visualization configuration needs to be fixed? Via the package manifest, it is owned by @elastic/obs-cloudnative-monitoring

So what I would like suggest:

gizas commented 1 week ago

If the data and the config is right but the panel doesn't render right for some reason, we can reach out to the AppEx visualizations team

@flash1293 the second is the case here . Indeed (as I am part of @elastic/obs-cloudnative-monitoring ) I see that all data is there. Also nothing changed on our side on this dashboard and also I have made a duplication of the visualisation and The weird thing is that the new duplicated Visualisation is working. So same config on a new visualisation is working.

So we need some help from AppEx visualizations team. Which team is this to tag?

gizas commented 1 week ago

FYI I have a cluster running and if someone is assigned I can join a zoom for live troubleshooting

flash1293 commented 1 week ago

@elastic/kibana-visualizations could you take a look at this together with @gizas ?

gizas commented 6 days ago

@dej611 Testing in version 8.13.1 :

Same visualisation is working:

Screenshot 2024-06-25 at 2 46 29 PM

*The filter with label Status includes the ''**

Screenshot 2024-06-25 at 2 47 28 PM

Screenshot 2024-06-25 at 2 47 14 PM

FYI the filter by box has not double quotes (it is runing:* and not "running":*)

Screenshot 2024-06-25 at 2 47 46 PM

dej611 commented 6 days ago

The issue seems to come from a changed behaviour in Elasticsearch. The same query was working on 8.13.1 but returning 0 results in 8.14 . I think this issue should be moved to the Elasticsearch repository.

dej611 commented 6 days ago

Opened an issue on the Elasticsearch side: https://github.com/elastic/elasticsearch/issues/110133