department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
281 stars 197 forks source link

Staging review artifacts testing #89411

Closed christinec-fftc closed 2 weeks ago

christinec-fftc commented 1 month ago

Follow up from Toxic Exposure: Prepare artifacts for staging review #67022

Test users: 50, 15, 68, 54

Slack thread

Overview

Perform manual testing needed for staging review. Out of all the QA artifacts needed, the scope of this ticket is specifically for the Traceability Reports

In order to generate these reports, the following manual test cases will be run by product and design:

Regression Tests

  1. C37806 526 Minimal Test

Product Changes Tests

  1. C79056 Standard Claim + TE (all of 15B, 15C, 15D)
  2. C79947 BDD (Benefits Delivery at Discharge) + TE
  3. C79948 FDC (Fully Developed Claim) + TE
  4. C79949 Standard Claim + Explicit no TE
  5. C79058 Edge Cases
  6. C87890 1.1 In Progress Form (IPF) - Standard Claim + TE (alll of 15B, 15C, 15D)
  7. C79934 VBMS Verifications

Tasks

Acceptance Criteria

mengA6 commented 1 month ago

Completed regression test in Windows > Edge. One thing to note that will be hard to find in the reports:

throughout the form, Did not see application ID with "save in progress" alert or in the text under the progress bar. https://jmp.sh/84ELIVEC (this isn't marked as a failure, since there wasn't a place for it in the steps - it's just in the notes at the top of the run)

mengA6 commented 1 month ago

Pausing on this per blocking Lighthouse issues.

I completed the regression test as mentioned above and also the Standard Claim + TE test in Windows > Edge using Citrix Access Gateway.

Notes and links to some screenshots on actual results are viewable in testrail under "R5765 Staging review artifacts testing#89411 - Mike". Scroll midway down on the center-right panel and look under "actual result" (screenshot).

mengA6 commented 1 month ago

Decided with team to prioritize the first two tests in the list. Got a submission error with an international address. Need to still test with a US address.

mengA6 commented 1 month ago

I've completed multiple runs of C37806 526 Minimal Test, C79056 Standard Claim + TE (all of 15B, 15C, 15D), and C79934 VBMS Verifications in Windows > Edge (using citrix access gateway).

C37806 526 Minimal Test passed.

C79056 Standard Claim + TE (all of 15B, 15C, 15D) failed, but I don't think any of the issues are launch-blocking.

Will need someone to retest C79934 VBMS Verifications with claim ID 600536064, submitted 8/9/24. It's not showing in VBMS 50 mins after submission. Compare against the following info:

phone: 666-666-6666. Marine Corps 5/25/2001 - 8/10/2003. Providence, RI 02906. Neck Strain (cervical strain). VA employee: yes. checking account / routing number: 987654321. mike's bank.

You should be able to see / edit any of my test runs in testrail under Staging review artifacts testing#89411 - Mike

mengA6 commented 1 month ago

created non-launch-blocking bug tickets:

  1. change "learn more about toxic exposure" link#90445
  2. Validation errors setting date fields to null #90446
  3. not seeing "your application will be saved on every change" under "step 2 of 5 conditions"#90447
  4. summary page for "other toxic exposures" Vertical spacing between list items is uneven#90448
  5. on "what type of evidence do you want us to review as part of your claim" - initial click on "private medical records" checkbox triggers a validation error and does not check the box#90449
  6. uploading private medical records, inline error "we couldn't upload your file"#90450
pacerwow commented 3 weeks ago

I think this can be closed as we've provided Platform what they asked for re QA artifacts and it looks like no remaining tasks.