cds-snc / notification-planning-core

Project planning for GC Notify Core Team
0 stars 0 forks source link

Create an AWS Alarm for missing Kubernetes logs #174

Open ben851 opened 11 months ago

ben851 commented 11 months ago

Description

As a developer/operator of GC Notify, I would like to be alerted when kubernetes logs are no longer appearing in cloudwatch so that I can ensure the stability and security of the system.

WHY are we building?

If logs are no longer being sent to cloudwatch, we will be at risk of missing critical security and operational alarms. It is possible the notify system could go down without us knowing for several hours.

WHAT are we building?

A cloudwatch alarm that alerts us when it does not receive logs from K8s cloudwatch agent/fluentbit after a given period

VALUE created by our solution

We will better be able to respond to issues within the notify environments

Acceptance Criteria

QA Steps