ukwa / ukwa-monitor

Dashboard and monitoring system for the UK Web Archive
0 stars 5 forks source link

Monitor crawl logs and database backups #30

Closed anjackson closed 3 years ago

anjackson commented 3 years ago

This patch adds hooks so the crawl logs and database backups can be monitored. The crawl log check will enable us to spot if the crawler has stopped checkpointing properly.

As Prometheus conventions expect different instances of the same metric to be distinguished by labels, the stats pusher code has been modified to allow the same metric name to be re-used between different entries.