ukwa / ukwa-monitor

Dashboard and monitoring system for the UK Web Archive
0 stars 5 forks source link

Add metric and alert to spot WARC backlog #24

Closed anjackson closed 3 years ago

anjackson commented 3 years ago

This metric can be used to spot if content is backing-up on Gluster:

-delta(node_filesystem_free_bytes{mountpoint='/mnt/gluster/fc',instance='gluster-fuse:9100'}[12h]) > 0

e.g see production Prometheus chart

This should be monitoried, and if it goes on for a day, raise an alert.