Message delivery rate alert enhancements

medic / cht-watchdog

Configuration for deploying a monitoring/alerting stack for CHT

GNU Affero General Public License v3.0

4 stars 7 forks source link

Open eljhkrr opened 4 months ago

eljhkrr commented 4 months ago

Not immediately clear how many messages are failing - @binokaryg manually reviews monitoring API for metrics, would be great if it could be automated
After failed messages have be resent & the counter reset to 0, the alert still fires for 24 hours

eljhkrr commented 4 months ago

This alert for message delivery rate was marked as resolved while there were still failing messages from monitoring API data: