grafana / grafana

The open and composable observability and data visualization platform. Visualize metrics, logs, and traces from multiple sources like Prometheus, Loki, Elasticsearch, InfluxDB, Postgres and many more.
https://grafana.com
GNU Affero General Public License v3.0
65.2k stars 12.16k forks source link

Dashboard: Panels with templated label names and values are displaying no data following the upgrade to Grafana version 11.3.0 #95769

Open AbhiTaker opened 2 weeks ago

AbhiTaker commented 2 weeks ago

What happened?

We have dashboards with a templated label name and value, declared as variables like this:

Image

These variables are used in panel queries in the following way:

rate(container_cpu_cfs_throttled_periods_total{$label_name="$label_value"})

This setup was functioning as expected, but after upgrading from Grafana 11.1.5 to 11.3.0, all dashboard panels stopped displaying data. Could we investigate the cause of this regression?

  1. Query Panel working without these label set -

Image

  1. Query Panel not working with these label set - Image

What did you expect to happen?

Working Panels with Data

Did this work before?

Yes, It worked in the Grafana version 11.1.5

How do we reproduce it?

  1. Define two variables in the Grafana dashboard, label_name and label_value, and include them in the queries label set like this: {$label_name="$label_value"}.

Is the bug inside a dashboard panel?

No response

Environment (with versions)?

Grafana: 11.3.0

Grafana platform?

Kubernetes

Datasource(s)?

No response

kaydelaney commented 2 weeks ago

Hi! Thanks for submitting this issue. Do you think you could provide the dashboard JSON of a dashboard that's exhibiting this problem? Tried reproducing using the instructions you provided, but I was unable to reproduce the issue.

AbhiTaker commented 2 weeks ago

Do you think you could provide the dashboard JSON of a dashboard that's exhibiting this problem?

@kaydelaney Yes, I've attached a basic node exporter dashboard which has these added variables. Thanks for looking. Let me know if you need anything else.

Node Exporter-1730828792196.json

AbhiTaker commented 6 days ago

@kaydelaney any update on this?