dotnet / dnceng

.NET Engineering Services
MIT License
24 stars 18 forks source link

Grafana should show data for unmonitored Helix queues #3481

Open riarenas opened 1 month ago

riarenas commented 1 month ago

Currently, Grafana will not show the queue status for queues that have been marked as unmonitored, even though work might actively be sent to those queues. This is a blind spot for our monitoring, as we don't get a clear picture of what is happening with the queues or the machines, and no alerting will be fired for them.

Release Note Category

garath commented 1 month ago

To be clear, you're talking about on the "Queue Monitoring" dashboard?

riarenas commented 1 month ago

It's the most obvious in the Queue monitoring dashboard, but i don't know if the rest of our Grafana data includes unmonitored entries.