PBP | ZSF general monitoring functions

department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:

https://depo-platform-documentation.scrollhelp.site/index.html

283 stars 205 forks source link

PBP | ZSF general monitoring functions #95195

Closed wayne-weibel closed 4 weeks ago

wayne-weibel commented 1 month ago

Implement the suggested statsd + log format for 'silent failure' https://dsva.slack.com/archives/C07QVEDUQ2D/p1728588722593559

Silent Failure Logs.pdf

Pension: new statsd to feed ZSF Dashboard Burials: new statsd to feed ZSF Dashboard

Task:

[ ] implement functions for monitoring of 'silent failure'
[ ] create separate lib folder for zero_silent_failures

Acceptance:

[ ] code is able to be reused by other teams
[ ] 100% test coverage
[ ] 100% documentation

sanjabaj2 commented 1 month ago

Just a small note on PDF document. Recently (last Friday) we changed the statsd spec for the case where we send email to VANotify but don't know if it was successfully sent.

"Silent failure, user emailed (unknown if successfully emailed): statsd.increment('silent_failure_avoided***' "

Should be "statsd.increment('silent_failure_avoided_no_confirmation',". Apologies for changing spec mid-flight.