department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
282 stars 203 forks source link

Create more granular Data Dog monitoring for user submissions #95317

Open michaelclement opened 1 week ago

michaelclement commented 1 week ago

As an IVC engineer I need more explicit errors in Data Dog so that I can cut down time spent categorizing and understanding errors in production.

There are three key areas that need more in-depth monitors:

  1. JSON reception a. Did we receive a valid JSON object from the FE? b. Does it contain the fields we would expect? (e.g., log the keys in the object so we can verify what was provided - do NOT log the values per PII).
  2. PDF generation a. Was the PDF generated? b. Is the PDF file size commensurate with a populated document? E.g., was it filled with data or is it empty? c. Did the PDF make it to S3?
  3. User-facing error screen on submit a. Did the user see an error screen when submitting the form? This will help us determine if an error was represented to the user or if it was silent.
michaelclement commented 1 week ago

This is a top-level ticket. We will create individual ones for the targets above.

michaelclement commented 1 week ago

Other information we may want to surface:

baltes commented 1 week ago

I'm going to convert this to an epic and we can add other tickets under it. I want to pull in some other fixes also.

michaelclement commented 1 week ago

This may be a helpful tool - Datadog Real User Monitoring lets us do session capture/replay on the frontend.