basic [external] up/down monitoring

[jhoblitt]

We desperately need basic up/down monitoring with some sort of team visibility. I think a slack channel for notifications would be more useful then a dashboard.

Obvious, simple checks:

• icmp echo
• http status
• https status + cert validity
• key dns records
• whois info (including registration expiration)

/cc @socallinuxexpo/infra

[irabinovitch]

New Relic has donated a synthetics account for our use. Datadog has done the same for infra monitoring

[irabinovitch]

We're monitoring the following now:

• http and https status are both being monitored by Datadog and New Relic Synthetics. This includes cert validity.
• Via Datadog we're monitoring DNS resolution on www.socallinuxexpo.org and lists.linuxfests.org. Are there other hostnames to monitor? If so, you can see examples of how to add more here.

New Relic data is being pulled into Datadog as well.

We're not monitoring whois, but we get email notifications from our registrars.

does this cover everything you had in mind here @jhoblitt and @jaymzh ?

[irabinovitch]

@jhoblitt ping?

[irabinovitch]

going to call this done. I've set it up to alert #infra in slack as well as email to @hriday, @jaymzh and I.