Checks to migrate to Icinga2

[TimStallard]

This is very much not an exhaustive list, will add things as we discover them. Only focusing on server checks for now; node bits will be migrated later.

High priority / major

• [ ] External monitoring
  • [x] Set up external-monitor as icinga2 agent
  • [x] External ping checks
  • [ ] External HTTP checks

General

• [ ] DNS checks
• [ ] Whois checks
• [ ] HTTP(S) checks
• [x] Disk checks (can we roll this into a single careful one per host?)
• [x] Host SSH checks
• [ ] Email alerts
  • [ ] "Nagios snapshot" style emails?

Other

• [ ] Website frontend for check status
• [ ] IRC bot integration (both of these can use the nice icinga2 HTTP API; we should break the code client out from sown/monitoring into a separate python module to reuse)

[TimStallard]

deleted lots of checks from icinga1 where we'd already put them in icinga2, and have started moving HTTP checks over

[drn05r]

Have added a DISKS check in ansible and monitoring. This has been deployed on the two gateway servers but nowhere else yet.