department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:
https://depo-platform-documentation.scrollhelp.site/index.html
281 stars 201 forks source link

Disallowed Cypress tests not creating GitHub issues #60923

Open rsmithadhoc opened 1 year ago

rsmithadhoc commented 1 year ago

Description

It has been reported that the tests listed on Currently Disallowed Cypress Test Specs on VA.gov are no longer having a GitHub issue created for them.

Acceptance Criteria

CBonade commented 1 year ago

Placing this in the allow list epic to look into, however, classifying it as low priority. The GitHub issues were implemented in lieu of having a place to put a public Slack notification and public list when we first launched the list. As the list has a public list and regular weekly notification now, the GitHub issue side may go away.

Also, asked for some more details on which product/specs are impacted by this as there's a separate process in place based on if the product directory has a team associated with those test specs or not and the break could be in either of those processes.

CBonade commented 1 year ago

src/applications/disability-benefits/all-claims/tests/all-claims-keyboard-only.cypress.spec.js DBEx Teams 1/2 label: 526ez-Defects

src/applications/disability-benefits/all-claims/tests/long-ptsd.cypress.spec.js DBEx Teams 1/2 label: 526ez-Defects

src/applications/disability-benefits/all-claims/tests/bdd-claims.cypress.spec.js DBEx Teams 1/2 label: 526ez-Defects

src/applications/lgy/coe/form/tests/coe-keyboard-only.cypress.spec.js Non-Disability Experience Team 1 label: coe / Umbrella This is the one that caused me to open the ticket, and has since dropped off the list.

tblackwe commented 1 year ago

We had a new test get added to the list without an issue report. image.png

without the documentation of the failure that caused it to be flaky it is difficult to understand what the problem is.