Spike | Migrate Upload to Light House

department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:

https://depo-platform-documentation.scrollhelp.site/index.html

281 stars 197 forks source link

Spike | Migrate Upload to Light House #83272

Open steele-lm opened 4 months ago

steele-lm commented 4 months ago

Issue Description

The 686/674 form flow currently uses the EVSS (or BGS SOAP?) service for document uploads, which frequently generates a "BGS::SubmitForm674Job failed, retries exhausted" error.

To improve the upload service and prevent this error, the upload service needs to be moved to the newer Light House interface.

Acceptance Criteria

[ ] 686/674 form flow on VA.gov uses Light House service for document upload

va-albers commented 3 months ago

Note we saw an example queue exhaustion today with the following info: dead queue id: 8e5d55d23b35e55d296d6e04 BGS::SubmitForm674Job ArgumentError: expect the argument to be a String, got BGS::ServiceException (#<BGS::ServiceException: BGS::ServiceException>)

This issue should be handled by the backup service (and later the LH migration), but we may want to look into it in case this is caused by an issue on our code?

va-albers commented 3 months ago

FYI there are similar errors in the log for BGS::SubmitForm686cJob.
BGS::SubmitForm686cJob [uuid extracted] died with error expect the argument to be a String, got BGS::ServiceException (#<BGS::ServiceException: BGS::ServiceException>). cc @sanjabaj2

steele-lm commented 3 months ago

Emily may have ideas on how to approach this. Thomas to confirm.

sanjabaj2 commented 3 months ago

I think there are 2 steps for this.

Fix now a potential bug that Steve is talking about in the comments above.
Move to lighthouse API, which may be a longer term item.