Open Firefishy opened 1 year ago
We can probably get the filestat exporter to monitor the backup directory and use prometheus to alert if things are too old.
Added initial test heartbeat code in https://github.com/openstreetmap/opentofu-statuscake/blob/main/heartbeat.tf Updates to backup script is pending, needs decision on what I do with the heartbeat ping URL, likely is a secret.
The OSM backup scripts should have better status monitoring.
An option is for the backup script on completion to call a StatusCake Push Monitoring endpoint with a "heartbeat". Each backup will have its own StatusCake Push Monitoring setup / endpoint.
The StatusCake Push Monitoring would alert if a heartbeat hasn't been called in a to-be-defined interval.