Alerts appear to remain visible for some time after being deleted

zalando-zmon / zmon-scheduler

ZMON Scheduler

Other

9 stars 3 forks source link

Open rajatparida86 opened 5 years ago

rajatparida86 commented 5 years ago

Problem description The results of alerts are visible on the ZMON dashboards even after deleting the alert.

Expected behaviour Alerts after deletion

laceyallyn commented 5 years ago

@rajatparida86 to be clear, does this mean that our users are being paged / alerted when there is nothing wrong (increased false positives)?

rajatparida86 commented 5 years ago

@laceyallyn Did some testing on my side and see that:

The deleted alert removes itself from the dashboard after some amount of time (approx ~10-20 minutes)
The deleted alert doesn't trigger any notification