department-of-veterans-affairs / abd-vro

To get Veterans benefits in minutes, VRO software uses health evidence data to help fast track disability claims.

Other

19 stars 6 forks source link

Closed dfitchett closed 2 days ago

dfitchett commented 1 week ago

Summary

Investigate / Implement possible solution for detecting and alerting connection dropped from svc-bgs-api to RabbitMQ.

AC:

When the connection drops from rabbitmq there should be an alert that is sent to the VRO team slack channel- benefits-vro-alerts
The alert should mention to notify the partner teams

How do we set this up for all environments? We have another ticket for tagging standards that will cover this #3018

dfitchett commented 2 days ago

Added chart to detect rabbitmq connection drops with EP Merge Job Failures Overlayed
Added new monitor detecting drop in rabbitmq connection, and sending alert to #benefits-vro-alerts in slack