Describe the bug
The default Loki dashboards shipped with the Helm chart fail to load data, due to using a job label that doesn't match the metrics that are collected.
The dashboard is querying metrics like this:
loki_ingester_memory_chunks{cluster="$cluster", job=~"$namespace/(loki|enterprise-logs)-write"}
but the ServiceMonitor is generating metrics with job=namespace/loki, not `job=namespace/loki-write'
To Reproduce
Steps to reproduce the behavior:
Installed loki in EKS using the Helm chart. Installed promtail, grafana, and kube-prometheus-stack alongside.
Open the 'Loki/Chunks' dashboard for example. No data is shown.
Drill into a chart widget, and modify the query to remove -write from the job label. Data shows as expected.
Expected behavior
Default dashboards should work alongside the default ServiceMonitor configuration.
Describe the bug The default Loki dashboards shipped with the Helm chart fail to load data, due to using a job label that doesn't match the metrics that are collected. The dashboard is querying metrics like this:
loki_ingester_memory_chunks{cluster="$cluster", job=~"$namespace/(loki|enterprise-logs)-write"}
but the ServiceMonitor is generating metrics withjob=namespace/loki
, not `job=namespace/loki-write'To Reproduce Steps to reproduce the behavior:
-write
from the job label. Data shows as expected.Expected behavior Default dashboards should work alongside the default ServiceMonitor configuration.
Environment:
Screenshots, Promtail config, or terminal output