m-lab / prometheus-support

Prometheus configuration for M-Lab running on GKE
Apache License 2.0
19 stars 11 forks source link

Changes downloader alert to fire after 72h, not 21h #1035

Closed nkinkade closed 5 months ago

nkinkade commented 5 months ago

The downloader used to download databases about every 8h. We have reconfigured it to only download about every 24h. Additionally, there is no need for this alert to be super sensitive. It is okay if annotations happen with databases that are only a couple days old. However, if downloader can't download all the files for more than 3d, then fire an alert.


This change is Reviewable

cristinaleonr commented 5 months ago

If you're back here, it would be helpful to add this reasoning as a comment.