department-of-veterans-affairs / abd-vro

To get Veterans benefits in minutes, VRO software uses health evidence data to help fast track disability claims.
Other
20 stars 6 forks source link

Datadog Dashboard(s) for VRO Microservices- Immediate monitoring needs #1927

Closed msnwatson closed 7 months ago

msnwatson commented 1 year ago

User Story

As the VRO Team we want to have clear visibility into the health of deployed microservices, so that I can quickly respond to issues and debug any unexpected behavior with integrations with other VA systems.

Acceptance Criteria

  1. Each microservice within VRO has a dashboard displaying request volume, request status, error rates, request latency to corresponding VA systems.- we have this but it has to be custom filtered.
  2. Each microservice within VRO has a dashboard displaying request volume, request status, error rates, request latency for requests originating within VRO. -we have this but it has to be custom filtered
  3. Baseline metrics are established so that Monitors are created so that if there are spikes in error rates in the communication from VRO microservices to VA systems or between VRO microservice consumers and VRO microservices, the team will know quickly. - yes
  4. If there are any code changes required in order to emit the necessary metrics, this work should also be covered by this ticket.- none needed
  5. there is a graph showing a heatmap of the deployments - yes
agile-josiah commented 8 months ago

Add a dashboard that shows a heatmap of the deployments

agile-josiah commented 8 months ago

Datadog dashboard link