search

cds-snc / notification-planning-core

Project planning for GC Notify Core Team
0 stars 0 forks source link

K8s Event Logger not being reported #413

Closed ben851 closed 2 months ago

ben851 commented 3 months ago

Describe the bug

K8s Event Logger logs are not being recorded in any environment. This seems to be related to prometheus not being enabled.

To Reproduce

Look for K8s Event Logger in cloudwatch - ain't none there other than the pod spinning up.

Expected behavior

K8s Event Logger should have thousands of logs on it reporting the status changes of individual pods.

Impact

This makes troubleshooting unexpected pod kills more difficult, since we do not have a history of the pod states.

If applicable

Impact on Notify users: N/A

Impact on Recipients: N/A

Impact on Notify team: Increased difficulty in troubleshooting

Additional context

This probably started when we moved KSM to helm.

ben851 commented 2 months ago

Closing this as it's not the case - I was looking in the wrong place.

K8s Event Logs for specific pods are under the K8s Event Logger pod, not the pod that you're looking for.