department-of-veterans-affairs / va.gov-team

Public resources for building on and in support of VA.gov. Visit complete Knowledge Hub:

https://depo-platform-documentation.scrollhelp.site/index.html

281 stars 197 forks source link

Investigate methods to reduce execution time of Cypress accessibility tests #29721

Open ddzz opened 3 years ago

ddzz commented 3 years ago

Description

Currently the daily Cypress accessibility scan takes around 3.5 hours. This task is to investigate and implement a modified GitHub Actions workflow that reduces execution time. This will reduce the time needed to test any fixes for the scan and other upgrades.

Tasks

[ ] Brainstorm potential execution time reduction techniques -- aiming for 3-4 potential techniques
[ ] Develop a proof of concept for each technique
[ ] Measure the impact of each proof of concept
[ ] Discuss pros/cons of each technique with the team and other Platform stakeholders
[ ] Based on discussion and impact of each technique select one ore more techniques to be integrated

Acceptance Criteria

[ ] A ticket to implement one or more of the POCs has been created with a projected positive impact to Cypress accessibility scan execution time

ddzz commented 2 years ago

Ideas/Suggestions

Cypress tests could be executed within the same job as the content-build build. This would remove the need to archive, upload and then download the build, which takes the most time in the daily scan. The runners would need to be scaled appropriately to handle parallelization.
Another idea is to simply run tests against staging, removing the need to build content-build.

rsmithadhoc commented 2 years ago

Started a Confluence page to document the ideas https://vfs.atlassian.net/wiki/spaces/TTT/pages/2346025005/Daily+Accessibility+Scan+Improvement+Brainstorming
Exploring the feasibility of each/other potential options and starting some basic PoCs.

rsmithadhoc commented 2 years ago

On hold, I will work on it if time opens up in the sprint since this is a tech debt item.

rsmithadhoc commented 1 year ago

Updated the Confluence page
- Using staging instead of a build proof of concept added. It took ~45 minutes to run.

rsmithadhoc commented 1 year ago

https://vfs.atlassian.net/wiki/spaces/TTT/pages/2346025005/Daily+Accessibility+Scan+Improvement+Brainstorming contains the brainstorming information. Since teams are being restructured, I am going to unassign this for now.