pennsignals / legacy-system-services

2 stars 0 forks source link

Clean up alarms on alertmanager #11

Open darrylmendillo opened 4 years ago

darrylmendillo commented 4 years ago

Alertmanager has too many unnecessary alarms that create noise on the slack channel #alertmanager.

They need to be filtered, silenced, or modified.

Rules are on Consul: https://uphsvlndc155.uphs.upenn.edu:8500/ui/dc1/kv/monitoring/alert_rules/

darrylmendillo commented 4 years ago

All sev 1 alarms have been rewritten in grafana.

We may not need alertmanager anymore. Look into it's current use cases.