department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
283 stars 205 forks source link

[Data] Investigating EZR schema validation error 11/20 (dateOfMarriage & spouseDateOfBirth) #97596

Open luis-simauchi opened 1 day ago

luis-simauchi commented 1 day ago

On 11/20 at 11:10 am we recorded a validation error on the EZR Error message goes as follows: 10-10EZR form validation failed. Form does not match schema. Error list: ["The property '#/spouseDateOfBirth' was not a valid schema... , "The property '#/dateOfMarriage' was not a valid schema in schema "]... But this looks like it retried and resolved because we did not see the monitor pop. I to see if this type of validation error is common? It's the first time i've seen dateOfMarriage / spouseDateOfBirth

luis-simauchi commented 1 day ago

brought the issue up to engineers on the dev slack channel

luis-simauchi commented 1 day ago

APM link: https://vagov.ddog-gov.com/apm/traces?query=%40_top_level%3A1%20env%3A%2A%20env%3Aeks-[…]z=stream&start=1732031317873&end=1732204117873&paused=false

luis-simauchi commented 1 day ago

LOG link: https://vagov.ddog-gov.com/logs?query=trace_id%3A1633593107256860076&agg_m=count&agg_m[…]stream&from_ts=1732118010492&to_ts=1732120011371&live=false

luis-simauchi commented 22 hours ago

Brandon Cooper chimed in and stated that this could be related to an ongoing / identified issue impacted multiple forms. All the errors we have been seeing are from this error: JSON::Schema::ReadFailed: Read of file at /usr/local/bundle/cache/ruby/3.3.0/gems/ruby-saml-1.17.0/lib/schemas/40ae683f-9394-59bd-b86f-2097b9679293 failed Which is thrown from the json-schema gem code when trying to load in the schema to validate it. It seems to be intermittent, but pretty consistent that some are failing here. I have yet to be able to reproduce it locally or in staging, but it does seem to be failing any of the places we are calling JSON::Validator.fully_validate in the vets-api code (that is a function from the json-schema gem code).