holdenhinkle
commented
3 years ago Closed pjhill closed 3 years ago
holdenhinkle
commented
3 years ago holdenhinkle
commented
3 years ago Some important links:
holdenhinkle
commented
3 years ago Get notified about your project's activity on Percy with webhooks. Use webhooks to send Percy events and data to your servers to customize how Percy integrates with your workflow.
holdenhinkle
commented
3 years ago This ticket is complete.
pjhill
commented
3 years ago Would it be worthwhile to setup a GitHub Actions visual regression check on a fork of vets-website? It might be nice to test drive the integration with the GHA pipeline and see how approved changes propagate back to GHA.
holdenhinkle
commented
3 years ago Would it be worthwhile to setup a GitHub Actions visual regression check on a fork of
vets-website? It might be nice to test drive the integration with the GHA pipeline and see how approved changes propagate back to GHA.
Good idea. I'll work on that.
pjhill
commented
3 years ago Exploring parallelization of this tool might be prudent as well. Any tool that we add to the pipeline as a build breaking check will need to be as speedy as possible. It looks like the docs for parallelization begin with a disclaimer that it's a fairly complicated setup. Shall we have a look?
holdenhinkle
commented
3 years ago To-do:
holdenhinkle
commented
3 years ago Can we run tests in GHA only after merge to master?
Seems like we can't. => https://stackoverflow.com/questions/62846375/perform-github-action-when-trying-to-merge-branch
Hmmm…
Ways around it => https://github.community/t/trigger-workflow-only-on-pull-request-merge/17359/3
And => https://brennerm.github.io/posts/trigger-github-actions-on-pr-close.html
But what would the workflow look like? We run the Cypress tests on merge to take the Percy screenshots, but if there are Percy failures we can’t block the merge....
Darius' branch => Run Cypress tests in parallel on Jenkins #16916
Percy docs => https://docs.percy.io/docs/jenkins
Are we using the GitHub Branch Source plugin?
Where to store the PERCY_TOKEN env var?
Where can we dynamically set the following tokens?
=> It looks like we can pass them into the run command => Rake example:
$ PERCY_PARALLEL_NONCE=`date +%s` PERCY_PARALLEL_TOTAL=4 rake parallel:spec[4]Draft PR for "Integrate Percy with Darius' Cypress parallelization" - https://github.com/department-of-veterans-affairs/vets-website/pull/17000
pjhill
commented
3 years ago Another data point to gather:
Consider running test suite 3 times and recording average suite execution time. Compare that to the average time to execute the test suite with a screenshot in each spec.
holdenhinkle
commented
3 years ago Cypress tests comparison: With and without Percy - https://docs.google.com/document/d/1WYDS-_2SG6yhZHViLBYbNIBZNE45Xq8PGVx69-zy5Dc/edit?usp=sharing
Percy took 33 snapshots and test execution time took ~1 minute longer than running the tests without Percy.
holdenhinkle
commented
3 years ago I paired with Darius for a few minutes and for about an hour with Bill trying to
We're all kinda weak with our Groovy Lang skills but Bill and I made some good headway. I'll pick this up again Monday morning.
Most recent build which failed - http://jenkins.vfs.va.gov/blue/organizations/jenkins/testing%2Fvets-website/detail/test_percy_with_cypress_parallelization/37/pipeline/
From this PR - https://github.com/department-of-veterans-affairs/vets-website/pull/17000
holdenhinkle
commented
3 years ago Got Percy working with Darius' Cypress Parallelization.
Screenshots:
Jenkins:
http://jenkins.vfs.va.gov/blue/organizations/jenkins/testing%2Fvets-website/detail/test_percy_with_cypress_parallelization/102/pipeline/
Each Cypress step has logs like this:
[2021-05-05T16:21:36.346Z] + export IMAGE_TAG=jenkins-testing-vets-website-test_percy_with_cypress_parallelization-102
[2021-05-05T16:21:36.346Z] + IMAGE_TAG=jenkins-testing-vets-website-test_percy_with_cypress_parallelization-102
[2021-05-05T16:21:36.346Z] + docker-compose -p cypress-2 up -d
[2021-05-05T16:21:37.268Z] Creating network "cypress2_default" with the default driver
[2021-05-05T16:21:37.268Z] Creating cypress2_vets-website_1 ...
[2021-05-05T16:21:37.268Z] Creating cypress2_vets-website_1
[2021-05-05T16:21:42.506Z]
Creating cypress2_vets-website_1 ... done
Creating cypress2_selenium-chrome_1 ...
[2021-05-05T16:21:42.506Z] Creating cypress2_selenium-chrome_1
[2021-05-05T16:21:45.763Z]
Creating cypress2_selenium-chrome_1 ... done
++ aws ssm get-parameters --region us-gov-west-1 --names /dsva-vagov/vets-website/common/percy_token_vets-website --with-decryption
[2021-05-05T16:21:45.763Z] ++ jq '.Parameters[0].Value'
[2021-05-05T16:21:45.763Z] ++ tr -d '"'
[2021-05-05T16:21:46.684Z] + docker-compose -p cypress-2 run --rm --entrypoint=npm -e CI=true -e NO_COLOR=1 -e STEP=0 -e PERCY_PARALLEL_NONCE=1620231696019 -e PERCY_TOKEN=bb8ff2dbbc77a1d995ce021ac1f131f6fe8f78b0bc75846f834a8256121205bd vets-website --no-color run cy:test:docker
[2021-05-05T16:21:51.913Z]
[2021-05-05T16:21:51.913Z] > vets-website@1.0.1 cy:test:docker /application
[2021-05-05T16:21:51.913Z] > node script/run-cypress-tests-docker.js
[2021-05-05T16:21:51.913Z]
[2021-05-05T16:21:51.913Z] PERCY_PARALLEL_NONCE: 1620231696019
[2021-05-05T16:21:51.913Z] yarn run v1.22.10
[2021-05-05T16:21:52.174Z] $ percy exec -- cypress run --config-file config/cypress.json percy finalize --config video=false --spec ,src/applications/appeals/10182/tests/10182-notice-of-disagreement.cypress.spec.js,src/applications/appeals/10182/tests/nod.cypress.helpers.js,src/applications/ask-a-question/tests/cypress/ask-a-question.authed.cypress.spec.js,src/applications/ask-a-question/tests/cypress/ask-a-question.unauthed.cypress.spec.js,src/applications/caregivers/tests/e2e/1010cg.cypress.spec.js,src/applications/coronavirus-research/tests/reviewAndSubmit.cypress.spec.js,src/applications/coronavirus-vaccination-expansion/tests/coronavirus-vaccination-expansion-form-validation.cypress.spec.js,src/applications/coronavirus-vaccination-expansion/tests/coronavirus-vaccination-expansion.cypress.spec.js,src/applications/coronavirus-vaccination/tests/e2e/hideauth.cypress.spec.js,src/applications/coronavirus-vaccination/tests/e2e/signup.cypress.spec.js,src/applications/coronavirus-vaccination/tests/e2e/unsubscribe.cypress.spec.js,src/applications/coronavirus-vaccination/tests/e2e/unsubscribeFail.cypress.spec.js,src/applications/debt-letters/tests/e2e/debt-letters.cypress.spec.js,src/applications/debt-letters/tests/e2e/diary-codes-content.cypress.spec.js,src/applications/debt-letters/tests/e2e/diary-codes-next-step.cypress.spec.js,src/applications/disability-benefits/2346/tests/mdot.cypress.spec.js,src/applications/disability-benefits/686c-674/tests/e2e/686C-674-ancilliary.cypress.spec.js,src/applications/disability-benefits/686c-674/tests/e2e/686C-674.cypress.spec.js,src/applications/disability-benefits/996/tests/hlr-wizard.cypress.spec.js,src/applications/disability-benefits/996/tests/hlr.cypress.helpers.js,src/applications/disability-benefits/996/tests/hlr.cypress.spec.js,src/applications/disability-benefits/all-claims/tests/all-claims-wizard.cypress.spec.js,src/applications/disability-benefits/all-claims/tests/all-claims.cypress.helpers.js,src/applications/disability-benefits/all-claims/tests/all-claims.cypress.spec.js,src/applications/disability-benefits/view-payments/tests/e2e/view-payments.cypress.spec.js
[2021-05-05T16:21:52.736Z] [percy] Chromium not found, downloading...
[2021-05-05T16:21:55.996Z]
[2021-05-05T16:22:05.917Z] [percy] Successfully downloaded Chromium
[2021-05-05T16:22:06.171Z] [percy] Percy has started!
[2021-05-05T16:22:06.171Z] [percy] Created build #25: https://percy.io/a45965dd/vets-website/builds/10260515
[2021-05-05T16:22:06.171Z] [percy] Running "cypress run --config-file config/cypress.json percy finalize --config video=false --spec ,src/applications/appeals/10182/tests/10182-notice-of-disagreement.cypress.spec.js,src/applications/appeals/10182/tests/nod.cypress.helpers.js,src/applications/ask-a-question/tests/cypress/ask-a-question.authed.cypress.spec.js,src/applications/ask-a-question/tests/cypress/ask-a-question.unauthed.cypress.spec.js,src/applications/caregivers/tests/e2e/1010cg.cypress.spec.js,src/applications/coronavirus-research/tests/reviewAndSubmit.cypress.spec.js,src/applications/coronavirus-vaccination-expansion/tests/coronavirus-vaccination-expansion-form-validation.cypress.spec.js,src/applications/coronavirus-vaccination-expansion/tests/coronavirus-vaccination-expansion.cypress.spec.js,src/applications/coronavirus-vaccination/tests/e2e/hideauth.cypress.spec.js,src/applications/coronavirus-vaccination/tests/e2e/signup.cypress.spec.js,src/applications/coronavirus-vaccination/tests/e2e/unsubscribe.cypress.spec.js,src/applications/coronavirus-vaccination/tests/e2e/unsubscribeFail.cypress.spec.js,src/applications/debt-letters/tests/e2e/debt-letters.cypress.spec.js,src/applications/debt-letters/tests/e2e/diary-codes-content.cypress.spec.js,src/applications/debt-letters/tests/e2e/diary-codes-next-step.cypress.spec.js,src/applications/disability-benefits/2346/tests/mdot.cypress.spec.js,src/applications/disability-benefits/686c-674/tests/e2e/686C-674-ancilliary.cypress.spec.js,src/applications/disability-benefits/686c-674/tests/e2e/686C-674.cypress.spec.js,src/applications/disability-benefits/996/tests/hlr-wizard.cypress.spec.js,src/applications/disability-benefits/996/tests/hlr.cypress.helpers.js,src/applications/disability-benefits/996/tests/hlr.cypress.spec.js,src/applications/disability-benefits/all-claims/tests/all-claims-wizard.cypress.spec.js,src/applications/disability-benefits/all-claims/tests/all-claims.cypress.helpers.js,src/applications/disability-benefits/all-claims/tests/all-claims.cypress.spec.js,src/applications/disability-benefits/view-payments/tests/e2e/view-payments.cypress.spec.js"
[2021-05-05T16:22:06.734Z] It looks like this is your first time using Cypress: 6.9.1
[2021-05-05T16:22:06.734Z]
[2021-05-05T16:22:06.734Z] [16:22:06] Verifying Cypress can run /application/.cache/Cypress/6.9.1/Cypress [started]
[2021-05-05T16:22:09.988Z] [16:22:09] Verifying Cypress can run /application/.cache/Cypress/6.9.1/Cypress [completed]
[2021-05-05T16:22:09.988Z]
[2021-05-05T16:22:09.988Z] Opening Cypress...
[2021-05-05T16:22:14.145Z] Couldn't find tsconfig.json. tsconfig-paths will be skipped
[2021-05-05T16:22:18.300Z]
[2021-05-05T16:22:18.300Z] ====================================================================================================
[2021-05-05T16:22:18.300Z]
[2021-05-05T16:22:18.300Z] (Run Starting)
[2021-05-05T16:22:18.300Z]
[2021-05-05T16:22:18.300Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:22:18.300Z] │ Cypress: 6.9.1 │
[2021-05-05T16:22:18.300Z] │ Browser: Electron 87 (headless) │
[2021-05-05T16:22:18.300Z] │ Node Version: v14.15.5 (/tmp/yarn--1620231712016-0.39950308499491927/node) │
[2021-05-05T16:22:18.300Z] │ Specs: 22 found (applications/appeals/10182/tests/10182-notice-of-disagreement.cypres │
[2021-05-05T16:22:18.300Z] │ s.spec.js, applications/ask-a-question/tests/cypress/ask-a-question.authed.cyp │
[2021-05-05T16:22:18.300Z] │ ress.spec.js, applications/ask-a-question/tests/cypress/ask-a-question.unauthe │
[2021-05-05T16:22:18.300Z] │ d.cypress.spec.js, appl...) │
[2021-05-05T16:22:18.300Z] │ Searched: , src/applications/appeals/10182/tests/10182-notice-of-disagreement.cypress.sp │
[2021-05-05T16:22:18.300Z] │ ec.js, src/applications/appeals/10182/tests/nod.cypress.helpers.js, src/applic │
[2021-05-05T16:22:18.300Z] │ ations/ask-a-question/tests/cypress/ask-a-question.authed.cypress.spec.js, src │
[2021-05-05T16:22:18.300Z] │ /applications/ask-a-question/tests/cypress/ask-a-question.unauthed.cypress.spe │
[2021-05-05T16:22:18.300Z] │ c.js, src/applications/caregivers/tests/e2e/1010cg.cypress.spec.js, src/applic │
[2021-05-05T16:22:18.300Z] │ ations/coronavirus-research/tests/reviewAndSubmit.cypress.spec.js, src/applica │
[2021-05-05T16:22:18.300Z] │ tions/coronavirus-vaccination-expansion/tests/coronavirus-vaccination-expansio │
[2021-05-05T16:22:18.300Z] │ n-form-validation.cypress.spec.js, src/applications/coronavirus-vaccination-ex │
[2021-05-05T16:22:18.300Z] │ pansion/tests/coronavirus-vaccination-expansion.cypress.spec.js, src/applicati │
[2021-05-05T16:22:18.300Z] │ ons/coronavirus-vaccination/tests/e2e/hideauth.cypress.spec.js, src/applicatio │
[2021-05-05T16:22:18.300Z] │ ns/coronavirus-vaccination/tests/e2e/signup.cypress.spec.js, src/applications/ │
[2021-05-05T16:22:18.300Z] │ coronavirus-vaccination/tests/e2e/unsubscribe.cypress.spec.js, src/application │
[2021-05-05T16:22:18.300Z] │ s/coronavirus-vaccination/tests/e2e/unsubscribeFail.cypress.spec.js, src/appli │
[2021-05-05T16:22:18.300Z] │ cations/debt-letters/tests/e2e/debt-letters.cypress.spec.js, src/applications/ │
[2021-05-05T16:22:18.300Z] │ debt-letters/tests/e2e/diary-codes-content.cypress.spec.js, src/applications/d │
[2021-05-05T16:22:18.300Z] │ ebt-letters/tests/e2e/diary-codes-next-step.cypress.spec.js, src/applications/ │
[2021-05-05T16:22:18.300Z] │ disability-benefits/2346/tests/mdot.cypress.spec.js, src/applications/disabili │
[2021-05-05T16:22:18.300Z] │ ty-benefits/686c-674/tests/e2e/686C-674-ancilliary.cypress.spec.js, src/applic │
[2021-05-05T16:22:18.300Z] │ ations/disability-benefits/686c-674/tests/e2e/686C-674.cypress.spec.js, src/ap │
[2021-05-05T16:22:18.300Z] │ plications/disability-benefits/996/tests/hlr-wizard.cypress.spec.js, src/appli │
[2021-05-05T16:22:18.300Z] │ cations/disability-benefits/996/tests/hlr.cypress.helpers.js, src/applications │
[2021-05-05T16:22:18.300Z] │ /disability-benefits/996/tests/hlr.cypress.spec.js, src/applications/disabilit │
[2021-05-05T16:22:18.300Z] │ y-benefits/all-claims/tests/all-claims-wizard.cypress.spec.js, src/application │
[2021-05-05T16:22:18.300Z] │ s/disability-benefits/all-claims/tests/all-claims.cypress.helpers.js, src/appl │
[2021-05-05T16:22:18.300Z] │ ications/disability-benefits/all-claims/tests/all-claims.cypress.spec.js, src/ │
[2021-05-05T16:22:18.300Z] │ applications/disability-benefits/view-payments/tests/e2e/view-payments.cypress │
[2021-05-05T16:22:18.300Z] │ .spec.js │
[2021-05-05T16:22:18.300Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:22:18.300Z]
[2021-05-05T16:22:18.300Z]
[2021-05-05T16:22:18.300Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:22:18.300Z]
[2021-05-05T16:22:18.300Z] Running: applications/appeals/10182/tests/10182-notice-of-disagreement.cypres (1 of 22)
[2021-05-05T16:22:18.300Z] s.spec.js
[2021-05-05T16:22:20.188Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:22:20.188Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:22:21.111Z] Browserslist: caniuse-lite is outdated. Please run:
[2021-05-05T16:22:21.111Z] npx browserslist@latest --update-db
[2021-05-05T16:22:31.036Z] [success] [webpackbar] Webpack: Compiled successfully in 9.79s
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z] Request a Board Appeal
[2021-05-05T16:22:37.559Z] maximal-test
[2021-05-05T16:22:37.559Z] - fills the form
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z] 0 passing (21ms)
[2021-05-05T16:22:37.559Z] 1 pending
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z] (Results)
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:22:37.559Z] │ Tests: 1 │
[2021-05-05T16:22:37.559Z] │ Passing: 0 │
[2021-05-05T16:22:37.559Z] │ Failing: 0 │
[2021-05-05T16:22:37.559Z] │ Pending: 1 │
[2021-05-05T16:22:37.559Z] │ Skipped: 0 │
[2021-05-05T16:22:37.559Z] │ Screenshots: 0 │
[2021-05-05T16:22:37.559Z] │ Video: false │
[2021-05-05T16:22:37.559Z] │ Duration: 0 seconds │
[2021-05-05T16:22:37.559Z] │ Spec Ran: applications/appeals/10182/tests/10182-notice-of-disagreement.cypress.spec.js │
[2021-05-05T16:22:37.559Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:22:37.559Z]
[2021-05-05T16:22:37.559Z] Running: applications/ask-a-question/tests/cypress/ask-a-question.authed.cypr (2 of 22)
[2021-05-05T16:22:37.559Z] ess.spec.js
[2021-05-05T16:22:38.118Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:22:44.653Z] [success] [webpackbar] Webpack: Compiled successfully in 5.25s
[2021-05-05T16:22:48.808Z]
[2021-05-05T16:22:48.809Z]
[2021-05-05T16:22:48.809Z] Contact Us
[2021-05-05T16:22:48.809Z] prefill
[2021-05-05T16:22:48.809Z] - fills the form
[2021-05-05T16:22:48.809Z]
[2021-05-05T16:22:48.809Z]
[2021-05-05T16:22:48.809Z] 0 passing (23ms)
[2021-05-05T16:22:48.809Z] 1 pending
[2021-05-05T16:22:48.809Z]
[2021-05-05T16:22:48.809Z]
[2021-05-05T16:22:48.809Z] (Results)
[2021-05-05T16:22:48.809Z]
[2021-05-05T16:22:48.809Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:22:48.809Z] │ Tests: 1 │
[2021-05-05T16:22:48.809Z] │ Passing: 0 │
[2021-05-05T16:22:48.809Z] │ Failing: 0 │
[2021-05-05T16:22:48.809Z] │ Pending: 1 │
[2021-05-05T16:22:48.809Z] │ Skipped: 0 │
[2021-05-05T16:22:48.809Z] │ Screenshots: 0 │
[2021-05-05T16:22:48.809Z] │ Video: false │
[2021-05-05T16:22:48.809Z] │ Duration: 0 seconds │
[2021-05-05T16:22:48.809Z] │ Spec Ran: applications/ask-a-question/tests/cypress/ask-a-question.authed.cypress.spec.js │
[2021-05-05T16:22:48.809Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:22:48.809Z]
[2021-05-05T16:22:48.809Z]
[2021-05-05T16:22:48.809Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:22:48.809Z]
[2021-05-05T16:22:48.809Z] Running: applications/ask-a-question/tests/cypress/ask-a-question.unauthed.cy (3 of 22)
[2021-05-05T16:22:48.809Z] press.spec.js
[2021-05-05T16:22:49.732Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:22:53.889Z] [success] [webpackbar] Webpack: Compiled successfully in 4.05s
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z] Contact Us
[2021-05-05T16:22:58.049Z] general-question
[2021-05-05T16:22:58.049Z] - fills the form
[2021-05-05T16:22:58.049Z] maximal
[2021-05-05T16:22:58.049Z] - fills the form
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z] 0 passing (20ms)
[2021-05-05T16:22:58.049Z] 2 pending
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z] (Results)
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:22:58.049Z] │ Tests: 2 │
[2021-05-05T16:22:58.049Z] │ Passing: 0 │
[2021-05-05T16:22:58.049Z] │ Failing: 0 │
[2021-05-05T16:22:58.049Z] │ Pending: 2 │
[2021-05-05T16:22:58.049Z] │ Skipped: 0 │
[2021-05-05T16:22:58.049Z] │ Screenshots: 0 │
[2021-05-05T16:22:58.049Z] │ Video: false │
[2021-05-05T16:22:58.049Z] │ Duration: 0 seconds │
[2021-05-05T16:22:58.049Z] │ Spec Ran: applications/ask-a-question/tests/cypress/ask-a-question.unauthed.cypress.spec.j │
[2021-05-05T16:22:58.049Z] │ s │
[2021-05-05T16:22:58.049Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:22:58.049Z]
[2021-05-05T16:22:58.049Z] Running: applications/caregivers/tests/e2e/1010cg.cypress.spec.js (4 of 22)
[2021-05-05T16:22:59.408Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:23:02.664Z] [success] [webpackbar] Webpack: Compiled successfully in 3.01s
[2021-05-05T16:23:06.831Z]
[2021-05-05T16:23:06.831Z]
[2021-05-05T16:23:06.831Z] 10-10CG
[2021-05-05T16:23:06.831Z] requiredOnly
[2021-05-05T16:23:38.831Z] ✓ fills the form (31443ms)
[2021-05-05T16:23:38.831Z] secondaryOneOnly
[2021-05-05T16:23:53.650Z] ✓ fills the form (16001ms)
[2021-05-05T16:23:53.650Z] oneSecondaryCaregivers
[2021-05-05T16:24:15.517Z] ✓ fills the form (20369ms)
[2021-05-05T16:24:15.517Z] twoSecondaryCaregivers
[2021-05-05T16:24:41.988Z] ✓ fills the form (25655ms)
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:41.988Z] 4 passing (2m)
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:41.988Z] (Results)
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:41.988Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:24:41.988Z] │ Tests: 4 │
[2021-05-05T16:24:41.988Z] │ Passing: 4 │
[2021-05-05T16:24:41.988Z] │ Failing: 0 │
[2021-05-05T16:24:41.988Z] │ Pending: 0 │
[2021-05-05T16:24:41.988Z] │ Skipped: 0 │
[2021-05-05T16:24:41.988Z] │ Screenshots: 0 │
[2021-05-05T16:24:41.988Z] │ Video: false │
[2021-05-05T16:24:41.988Z] │ Duration: 1 minute, 33 seconds │
[2021-05-05T16:24:41.988Z] │ Spec Ran: applications/caregivers/tests/e2e/1010cg.cypress.spec.js │
[2021-05-05T16:24:41.988Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:41.988Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:41.988Z] Running: applications/coronavirus-research/tests/reviewAndSubmit.cypress.spec (5 of 22)
[2021-05-05T16:24:41.988Z] .js
[2021-05-05T16:24:41.988Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:24:41.988Z] [success] [webpackbar] Webpack: Compiled successfully in 256.64ms
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:41.988Z]
[2021-05-05T16:24:42.243Z] COVID-19 Research Form
[2021-05-05T16:24:42.243Z] when entering valid information and submitting
[2021-05-05T16:24:44.124Z] [percy] Snapshot taken: COVID-19 Research Form, Empty form
[2021-05-05T16:24:45.047Z] ✓ should load form page (2991ms)
[2021-05-05T16:24:53.127Z] [percy] Snapshot taken: COVID-19 Research Form, Completed form
[2021-05-05T16:24:56.396Z] [percy] Snapshot taken: COVID-19 Research Form, Confirmation page
[2021-05-05T16:24:56.396Z] ✓ should successfully submit the Covid Research form (11322ms)
[2021-05-05T16:24:56.396Z]
[2021-05-05T16:24:56.396Z]
[2021-05-05T16:24:56.396Z] 2 passing (14s)
[2021-05-05T16:24:56.396Z]
[2021-05-05T16:24:56.396Z]
[2021-05-05T16:24:56.396Z] (Results)
[2021-05-05T16:24:56.396Z]
[2021-05-05T16:24:56.396Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:24:56.396Z] │ Tests: 2 │
[2021-05-05T16:24:56.396Z] │ Passing: 2 │
[2021-05-05T16:24:56.396Z] │ Failing: 0 │
[2021-05-05T16:24:56.396Z] │ Pending: 0 │
[2021-05-05T16:24:56.396Z] │ Skipped: 0 │
[2021-05-05T16:24:56.396Z] │ Screenshots: 0 │
[2021-05-05T16:24:56.396Z] │ Video: false │
[2021-05-05T16:24:56.396Z] │ Duration: 14 seconds │
[2021-05-05T16:24:56.396Z] │ Spec Ran: applications/coronavirus-research/tests/reviewAndSubmit.cypress.spec.js │
[2021-05-05T16:24:56.396Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:24:56.396Z]
[2021-05-05T16:24:56.396Z]
[2021-05-05T16:24:56.396Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:24:56.396Z]
[2021-05-05T16:24:56.396Z] Running: applications/coronavirus-vaccination-expansion/tests/coronavirus-vac (6 of 22)
[2021-05-05T16:24:56.396Z] cination-expansion-form-validation.cypress.spec.js
[2021-05-05T16:24:57.318Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:24:57.318Z] [success] [webpackbar] Webpack: Compiled successfully in 36.52ms
[2021-05-05T16:24:59.200Z]
[2021-05-05T16:24:59.200Z]
[2021-05-05T16:24:59.200Z] COVID-19 SAVE LIVES Act sign up
[2021-05-05T16:24:59.200Z] when entering names with a parentheses
[2021-05-05T16:25:03.375Z] ✓ should throw a validation error (3745ms)
[2021-05-05T16:25:03.375Z]
[2021-05-05T16:25:03.375Z]
[2021-05-05T16:25:03.375Z] 1 passing (4s)
[2021-05-05T16:25:03.375Z]
[2021-05-05T16:25:03.375Z]
[2021-05-05T16:25:03.375Z] (Results)
[2021-05-05T16:25:03.375Z]
[2021-05-05T16:25:03.375Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:25:03.375Z] │ Tests: 1 │
[2021-05-05T16:25:03.375Z] │ Passing: 1 │
[2021-05-05T16:25:03.375Z] │ Failing: 0 │
[2021-05-05T16:25:03.375Z] │ Pending: 0 │
[2021-05-05T16:25:03.375Z] │ Skipped: 0 │
[2021-05-05T16:25:03.375Z] │ Screenshots: 0 │
[2021-05-05T16:25:03.375Z] │ Video: false │
[2021-05-05T16:25:03.375Z] │ Duration: 3 seconds │
[2021-05-05T16:25:03.375Z] │ Spec Ran: applications/coronavirus-vaccination-expansion/tests/coronavirus-vaccination-exp │
[2021-05-05T16:25:03.375Z] │ ansion-form-validation.cypress.spec.js │
[2021-05-05T16:25:03.375Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:25:03.375Z]
[2021-05-05T16:25:03.375Z]
[2021-05-05T16:25:03.375Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:25:03.375Z]
[2021-05-05T16:25:03.375Z] Running: applications/coronavirus-vaccination-expansion/tests/coronavirus-vac (7 of 22)
[2021-05-05T16:25:03.375Z] cination-expansion.cypress.spec.js
[2021-05-05T16:25:03.935Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:25:08.101Z] [success] [webpackbar] Webpack: Compiled successfully in 3.54s
[2021-05-05T16:25:11.357Z]
[2021-05-05T16:25:11.357Z]
[2021-05-05T16:25:11.357Z] covid-vaccine-expansion
[2021-05-05T16:25:11.357Z] test-data-veteran-no-facilities
[2021-05-05T16:25:21.280Z] ✓ fills the form (9820ms)
[2021-05-05T16:25:21.280Z] test-data-veteran
[2021-05-05T16:25:31.250Z] ✓ fills the form (9324ms)
[2021-05-05T16:25:31.250Z] test-data-spouse
[2021-05-05T16:25:39.329Z] ✓ fills the form (7688ms)
[2021-05-05T16:25:39.329Z] test-data-caregiver
[2021-05-05T16:25:45.849Z] ✓ fills the form (7253ms)
[2021-05-05T16:25:45.849Z] test-data-champva
[2021-05-05T16:25:52.366Z] ✓ fills the form (6087ms)
[2021-05-05T16:25:52.366Z] test-data-veteran-puerto-rico
[2021-05-05T16:25:58.883Z] ✓ fills the form (6913ms)
[2021-05-05T16:25:58.883Z]
[2021-05-05T16:25:58.883Z]
[2021-05-05T16:25:58.883Z] 6 passing (47s)
[2021-05-05T16:25:58.883Z]
[2021-05-05T16:25:58.883Z]
[2021-05-05T16:25:58.883Z] (Results)
[2021-05-05T16:25:58.883Z]
[2021-05-05T16:25:58.883Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:25:58.883Z] │ Tests: 6 │
[2021-05-05T16:25:58.883Z] │ Passing: 6 │
[2021-05-05T16:25:58.883Z] │ Failing: 0 │
[2021-05-05T16:25:58.883Z] │ Pending: 0 │
[2021-05-05T16:25:58.883Z] │ Skipped: 0 │
[2021-05-05T16:25:58.883Z] │ Screenshots: 0 │
[2021-05-05T16:25:58.883Z] │ Video: false │
[2021-05-05T16:25:58.883Z] │ Duration: 47 seconds │
[2021-05-05T16:25:58.883Z] │ Spec Ran: applications/coronavirus-vaccination-expansion/tests/coronavirus-vaccination-exp │
[2021-05-05T16:25:58.883Z] │ ansion.cypress.spec.js │
[2021-05-05T16:25:58.883Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:25:58.883Z]
[2021-05-05T16:25:58.883Z]
[2021-05-05T16:25:58.883Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:25:58.883Z]
[2021-05-05T16:25:58.883Z] Running: applications/coronavirus-vaccination/tests/e2e/hideauth.cypress.spec (8 of 22)
[2021-05-05T16:25:58.883Z] .js
[2021-05-05T16:25:59.137Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:25:59.391Z] [success] [webpackbar] Webpack: Compiled successfully in 115.34ms
[2021-05-05T16:26:00.319Z]
[2021-05-05T16:26:00.319Z]
[2021-05-05T16:26:00.319Z] COVID-19 Vaccination Preparation Form
[2021-05-05T16:26:00.320Z] when entering app with auth turned off
[2021-05-05T16:26:02.825Z] [percy] Snapshot taken: COVID-19 Vaccination Preparation Form, Empty form
[2021-05-05T16:26:06.979Z] [percy] Snapshot taken: COVID-19 Vaccination Preparation Form, Completed form
[2021-05-05T16:26:07.233Z] [percy] Snapshot taken: COVID-19 Vaccination Preparation Form, Confirmation page
[2021-05-05T16:26:07.488Z] ✓ should launch app from the continue button (7111ms)
[2021-05-05T16:26:07.742Z]
[2021-05-05T16:26:07.742Z]
[2021-05-05T16:26:07.742Z] 1 passing (7s)
[2021-05-05T16:26:07.742Z]
[2021-05-05T16:26:07.742Z]
[2021-05-05T16:26:07.742Z] (Results)
[2021-05-05T16:26:07.742Z]
[2021-05-05T16:26:07.742Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:26:07.742Z] │ Tests: 1 │
[2021-05-05T16:26:07.742Z] │ Passing: 1 │
[2021-05-05T16:26:07.742Z] │ Failing: 0 │
[2021-05-05T16:26:07.742Z] │ Pending: 0 │
[2021-05-05T16:26:07.742Z] │ Skipped: 0 │
[2021-05-05T16:26:07.742Z] │ Screenshots: 0 │
[2021-05-05T16:26:07.742Z] │ Video: false │
[2021-05-05T16:26:07.742Z] │ Duration: 7 seconds │
[2021-05-05T16:26:07.742Z] │ Spec Ran: applications/coronavirus-vaccination/tests/e2e/hideauth.cypress.spec.js │
[2021-05-05T16:26:07.742Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:26:07.742Z]
[2021-05-05T16:26:07.742Z]
[2021-05-05T16:26:07.742Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:26:07.742Z]
[2021-05-05T16:26:07.742Z] Running: applications/coronavirus-vaccination/tests/e2e/signup.cypress.spec.j (9 of 22)
[2021-05-05T16:26:07.742Z] s
[2021-05-05T16:26:08.670Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:26:08.670Z] [success] [webpackbar] Webpack: Compiled successfully in 48.69ms
[2021-05-05T16:26:10.028Z]
[2021-05-05T16:26:10.028Z]
[2021-05-05T16:26:10.028Z] COVID-19 Vaccination Preparation Form
[2021-05-05T16:26:10.028Z] when entering valid contact information without signing in
[2021-05-05T16:26:18.096Z] ✓ should successfully submit the vaccine preparation form (7534ms)
[2021-05-05T16:26:18.096Z]
[2021-05-05T16:26:18.096Z]
[2021-05-05T16:26:18.096Z] 1 passing (8s)
[2021-05-05T16:26:18.096Z]
[2021-05-05T16:26:18.096Z]
[2021-05-05T16:26:18.096Z] (Results)
[2021-05-05T16:26:18.096Z]
[2021-05-05T16:26:18.096Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:26:18.096Z] │ Tests: 1 │
[2021-05-05T16:26:18.096Z] │ Passing: 1 │
[2021-05-05T16:26:18.096Z] │ Failing: 0 │
[2021-05-05T16:26:18.096Z] │ Pending: 0 │
[2021-05-05T16:26:18.096Z] │ Skipped: 0 │
[2021-05-05T16:26:18.096Z] │ Screenshots: 0 │
[2021-05-05T16:26:18.096Z] │ Video: false │
[2021-05-05T16:26:18.096Z] │ Duration: 7 seconds │
[2021-05-05T16:26:18.096Z] │ Spec Ran: applications/coronavirus-vaccination/tests/e2e/signup.cypress.spec.js │
[2021-05-05T16:26:18.096Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:26:18.096Z]
[2021-05-05T16:26:18.096Z]
[2021-05-05T16:26:18.096Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:26:18.096Z]
[2021-05-05T16:26:18.096Z] Running: applications/coronavirus-vaccination/tests/e2e/unsubscribe.cypress.s (10 of 22)
[2021-05-05T16:26:18.096Z] pec.js
[2021-05-05T16:26:18.350Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:26:18.350Z] (node:596) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 preprocessor:close listeners added to [EventEmitter]. Use emitter.setMaxListeners() to increase limit
[2021-05-05T16:26:18.350Z] (Use `node --trace-warnings ...` to show where the warning was created)
[2021-05-05T16:26:18.350Z] [success] [webpackbar] Webpack: Compiled successfully in 25.37ms
[2021-05-05T16:26:19.708Z]
[2021-05-05T16:26:19.708Z]
[2021-05-05T16:26:19.708Z] COVID-19 Vaccination Preparation Form
[2021-05-05T16:26:20.631Z] ✓ should successfully unsubscribe the user (933ms)
[2021-05-05T16:26:20.631Z]
[2021-05-05T16:26:20.631Z]
[2021-05-05T16:26:20.631Z] 1 passing (969ms)
[2021-05-05T16:26:20.631Z]
[2021-05-05T16:26:20.631Z]
[2021-05-05T16:26:20.631Z] (Results)
[2021-05-05T16:26:20.631Z]
[2021-05-05T16:26:20.631Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:26:20.631Z] │ Tests: 1 │
[2021-05-05T16:26:20.631Z] │ Passing: 1 │
[2021-05-05T16:26:20.631Z] │ Failing: 0 │
[2021-05-05T16:26:20.631Z] │ Pending: 0 │
[2021-05-05T16:26:20.631Z] │ Skipped: 0 │
[2021-05-05T16:26:20.631Z] │ Screenshots: 0 │
[2021-05-05T16:26:20.631Z] │ Video: false │
[2021-05-05T16:26:20.631Z] │ Duration: 0 seconds │
[2021-05-05T16:26:20.631Z] │ Spec Ran: applications/coronavirus-vaccination/tests/e2e/unsubscribe.cypress.spec.js │
[2021-05-05T16:26:20.631Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:26:20.631Z]
[2021-05-05T16:26:20.631Z]
[2021-05-05T16:26:20.631Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:26:20.631Z]
[2021-05-05T16:26:20.631Z] Running: applications/coronavirus-vaccination/tests/e2e/unsubscribeFail.cypre (11 of 22)
[2021-05-05T16:26:20.631Z] ss.spec.js
[2021-05-05T16:26:21.554Z] (node:373) MaxListenersExceededWarning: Possible EventEmitter memory leak detected. 11 will-download listeners added to [Session]. Use emitter.setMaxListeners() to increase limit
[2021-05-05T16:26:21.554Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:26:21.554Z] [success] [webpackbar] Webpack: Compiled successfully in 23.22ms
[2021-05-05T16:26:22.918Z]
[2021-05-05T16:26:22.918Z]
[2021-05-05T16:26:22.918Z] COVID-19 Vaccination Preparation Form
[2021-05-05T16:26:23.840Z] ✓ should fail to unsubscribe the user (973ms)
[2021-05-05T16:26:23.840Z]
[2021-05-05T16:26:23.840Z]
[2021-05-05T16:26:23.840Z] 1 passing (1s)
[2021-05-05T16:26:23.840Z]
[2021-05-05T16:26:23.840Z]
[2021-05-05T16:26:23.840Z] (Results)
[2021-05-05T16:26:23.840Z]
[2021-05-05T16:26:23.840Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:26:23.840Z] │ Tests: 1 │
[2021-05-05T16:26:23.840Z] │ Passing: 1 │
[2021-05-05T16:26:23.840Z] │ Failing: 0 │
[2021-05-05T16:26:23.840Z] │ Pending: 0 │
[2021-05-05T16:26:23.840Z] │ Skipped: 0 │
[2021-05-05T16:26:23.840Z] │ Screenshots: 0 │
[2021-05-05T16:26:23.840Z] │ Video: false │
[2021-05-05T16:26:23.840Z] │ Duration: 0 seconds │
[2021-05-05T16:26:23.840Z] │ Spec Ran: applications/coronavirus-vaccination/tests/e2e/unsubscribeFail.cypress.spec.js │
[2021-05-05T16:26:23.840Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:26:23.840Z]
[2021-05-05T16:26:23.840Z]
[2021-05-05T16:26:23.840Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:26:23.840Z]
[2021-05-05T16:26:23.840Z] Running: applications/debt-letters/tests/e2e/debt-letters.cypress.spec.js (12 of 22)
[2021-05-05T16:26:24.763Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:26:24.763Z] [success] [webpackbar] Webpack: Compiled successfully in 40.90ms
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z] Debt Letters
[2021-05-05T16:26:26.121Z] - C1033 displays the current debts section and navigates to debt details
[2021-05-05T16:26:26.121Z] - C1034 displays download debt letters
[2021-05-05T16:26:26.121Z] - C1035 displays how do I pay my VA debt?
[2021-05-05T16:26:26.121Z] - C1036 displays how do I get financial help?
[2021-05-05T16:26:26.121Z] - C1037 displays how do I dispute a debt?
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z] 0 passing (26ms)
[2021-05-05T16:26:26.121Z] 5 pending
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z] (Results)
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:26:26.121Z] │ Tests: 5 │
[2021-05-05T16:26:26.121Z] │ Passing: 0 │
[2021-05-05T16:26:26.121Z] │ Failing: 0 │
[2021-05-05T16:26:26.121Z] │ Pending: 5 │
[2021-05-05T16:26:26.121Z] │ Skipped: 0 │
[2021-05-05T16:26:26.121Z] │ Screenshots: 0 │
[2021-05-05T16:26:26.121Z] │ Video: false │
[2021-05-05T16:26:26.121Z] │ Duration: 0 seconds │
[2021-05-05T16:26:26.121Z] │ Spec Ran: applications/debt-letters/tests/e2e/debt-letters.cypress.spec.js │
[2021-05-05T16:26:26.121Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:26:26.121Z]
[2021-05-05T16:26:26.121Z] Running: applications/debt-letters/tests/e2e/diary-codes-content.cypress.spec (13 of 22)
[2021-05-05T16:26:26.121Z] .js
[2021-05-05T16:26:27.043Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:26:27.043Z] [success] [webpackbar] Webpack: Compiled successfully in 29.45ms
[2021-05-05T16:26:28.400Z]
[2021-05-05T16:26:28.400Z]
[2021-05-05T16:26:28.400Z] Diary Codes
[2021-05-05T16:26:28.400Z] - renders expected content for diary code: 080
[2021-05-05T16:26:28.400Z] - renders expected content for diary code: 100
[2021-05-05T16:26:28.400Z] - renders expected content for diary code: 101, 450, 610, 617
[2021-05-05T16:26:28.400Z] - renders expected content for diary code: 117
[2021-05-05T16:26:28.400Z] - renders expected content for diary code: 123
[2021-05-05T16:26:28.400Z] - renders expected content for diary code: 500
[2021-05-05T16:26:28.400Z] - renders expected content for diary code: 600, 601
[2021-05-05T16:26:28.400Z]
[2021-05-05T16:26:28.400Z]
[2021-05-05T16:26:28.400Z] 0 passing (36ms)
[2021-05-05T16:26:28.400Z] 7 pending
[2021-05-05T16:26:28.400Z]
[2021-05-05T16:26:28.400Z]
[2021-05-05T16:26:28.400Z] (Results)
[2021-05-05T16:26:28.400Z]
[2021-05-05T16:26:28.400Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:26:28.400Z] │ Tests: 7 │
[2021-05-05T16:26:28.400Z] │ Passing: 0 │
[2021-05-05T16:26:28.400Z] │ Failing: 0 │
[2021-05-05T16:26:28.400Z] │ Pending: 7 │
[2021-05-05T16:26:28.400Z] │ Skipped: 0 │
[2021-05-05T16:26:28.400Z] │ Screenshots: 0 │
[2021-05-05T16:26:28.400Z] │ Video: false │
[2021-05-05T16:26:28.400Z] │ Duration: 0 seconds │
[2021-05-05T16:26:28.400Z] │ Spec Ran: applications/debt-letters/tests/e2e/diary-codes-content.cypress.spec.js │
[2021-05-05T16:26:28.401Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:26:28.401Z]
[2021-05-05T16:26:28.401Z]
[2021-05-05T16:26:28.401Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:26:28.401Z]
[2021-05-05T16:26:28.401Z] Running: applications/debt-letters/tests/e2e/diary-codes-next-step.cypress.sp (14 of 22)
[2021-05-05T16:26:28.401Z] ec.js
[2021-05-05T16:26:28.957Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:26:28.957Z] [success] [webpackbar] Webpack: Compiled successfully in 37.42ms
[2021-05-05T16:26:30.319Z]
[2021-05-05T16:26:30.320Z]
[2021-05-05T16:26:30.320Z] Diary Codes - Next Steps
[2021-05-05T16:26:30.320Z] - renders a debt card with next step
[2021-05-05T16:26:30.320Z] - renders a debt card without next step
[2021-05-05T16:26:30.320Z] - renders debt details with next step
[2021-05-05T16:26:30.320Z] - renders debt details with information alert when there is no next step
[2021-05-05T16:26:30.320Z]
[2021-05-05T16:26:30.320Z]
[2021-05-05T16:26:30.320Z] 0 passing (20ms)
[2021-05-05T16:26:30.320Z] 4 pending
[2021-05-05T16:26:30.320Z]
[2021-05-05T16:26:30.320Z]
[2021-05-05T16:26:30.320Z] (Results)
[2021-05-05T16:26:30.320Z]
[2021-05-05T16:26:30.320Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:26:30.320Z] │ Tests: 4 │
[2021-05-05T16:26:30.320Z] │ Passing: 0 │
[2021-05-05T16:26:30.320Z] │ Failing: 0 │
[2021-05-05T16:26:30.320Z] │ Pending: 4 │
[2021-05-05T16:26:30.320Z] │ Skipped: 0 │
[2021-05-05T16:26:30.320Z] │ Screenshots: 0 │
[2021-05-05T16:26:30.320Z] │ Video: false │
[2021-05-05T16:26:30.320Z] │ Duration: 0 seconds │
[2021-05-05T16:26:30.320Z] │ Spec Ran: applications/debt-letters/tests/e2e/diary-codes-next-step.cypress.spec.js │
[2021-05-05T16:26:30.320Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:26:30.320Z]
[2021-05-05T16:26:30.320Z]
[2021-05-05T16:26:30.320Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:26:30.320Z]
[2021-05-05T16:26:30.320Z] Running: applications/disability-benefits/2346/tests/mdot.cypress.spec.js (15 of 22)
[2021-05-05T16:26:31.245Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:26:34.498Z] [success] [webpackbar] Webpack: Compiled successfully in 3.16s
[2021-05-05T16:26:37.756Z]
[2021-05-05T16:26:37.756Z]
[2021-05-05T16:26:37.756Z] Order hearing aid batteries and accessories
[2021-05-05T16:26:37.756Z] happyPath
[2021-05-05T16:26:42.984Z] ✓ fills the form (4833ms)
[2021-05-05T16:26:42.984Z] noTempAddress
[2021-05-05T16:26:48.218Z] ✓ fills the form (5048ms)
[2021-05-05T16:26:48.218Z] noBatteries
[2021-05-05T16:26:51.470Z] ✓ fills the form (3934ms)
[2021-05-05T16:26:51.470Z] noAccessories
[2021-05-05T16:26:55.636Z] ✓ fills the form (3738ms)
[2021-05-05T16:26:55.636Z]
[2021-05-05T16:26:55.636Z]
[2021-05-05T16:26:55.636Z] 4 passing (18s)
[2021-05-05T16:26:55.636Z]
[2021-05-05T16:26:55.636Z]
[2021-05-05T16:26:55.636Z] (Results)
[2021-05-05T16:26:55.636Z]
[2021-05-05T16:26:55.636Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:26:55.636Z] │ Tests: 4 │
[2021-05-05T16:26:55.636Z] │ Passing: 4 │
[2021-05-05T16:26:55.636Z] │ Failing: 0 │
[2021-05-05T16:26:55.636Z] │ Pending: 0 │
[2021-05-05T16:26:55.636Z] │ Skipped: 0 │
[2021-05-05T16:26:55.636Z] │ Screenshots: 0 │
[2021-05-05T16:26:55.636Z] │ Video: false │
[2021-05-05T16:26:55.636Z] │ Duration: 17 seconds │
[2021-05-05T16:26:55.636Z] │ Spec Ran: applications/disability-benefits/2346/tests/mdot.cypress.spec.js │
[2021-05-05T16:26:55.636Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:26:55.636Z]
[2021-05-05T16:26:55.636Z]
[2021-05-05T16:26:55.636Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:26:55.636Z]
[2021-05-05T16:26:55.636Z] Running: applications/disability-benefits/686c-674/tests/e2e/686C-674-ancilli (16 of 22)
[2021-05-05T16:26:55.636Z] ary.cypress.spec.js
[2021-05-05T16:26:55.890Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:26:59.144Z] [success] [webpackbar] Webpack: Compiled successfully in 2.79s
[2021-05-05T16:27:01.729Z]
[2021-05-05T16:27:01.729Z]
[2021-05-05T16:27:01.729Z] 686C-674
[2021-05-05T16:27:01.729Z] ancilliary-flows
[2021-05-05T16:27:23.593Z] ✓ fills the form (18358ms)
[2021-05-05T16:27:23.593Z] add-child-report-divorce
[2021-05-05T16:27:35.746Z] ✓ fills the form (14015ms)
[2021-05-05T16:27:35.747Z] spouse-report-divorce
[2021-05-05T16:27:50.600Z] ✓ fills the form (15320ms)
[2021-05-05T16:27:50.600Z]
[2021-05-05T16:27:50.600Z]
[2021-05-05T16:27:50.600Z] 3 passing (48s)
[2021-05-05T16:27:50.600Z]
[2021-05-05T16:27:50.600Z]
[2021-05-05T16:27:50.600Z] (Results)
[2021-05-05T16:27:50.600Z]
[2021-05-05T16:27:50.600Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:27:50.600Z] │ Tests: 3 │
[2021-05-05T16:27:50.600Z] │ Passing: 3 │
[2021-05-05T16:27:50.600Z] │ Failing: 0 │
[2021-05-05T16:27:50.600Z] │ Pending: 0 │
[2021-05-05T16:27:50.600Z] │ Skipped: 0 │
[2021-05-05T16:27:50.600Z] │ Screenshots: 0 │
[2021-05-05T16:27:50.600Z] │ Video: false │
[2021-05-05T16:27:50.600Z] │ Duration: 47 seconds │
[2021-05-05T16:27:50.600Z] │ Spec Ran: applications/disability-benefits/686c-674/tests/e2e/686C-674-ancilliary.cypress. │
[2021-05-05T16:27:50.600Z] │ spec.js │
[2021-05-05T16:27:50.600Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:27:50.600Z]
[2021-05-05T16:27:50.600Z]
[2021-05-05T16:27:50.600Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:27:50.600Z]
[2021-05-05T16:27:50.600Z] Running: applications/disability-benefits/686c-674/tests/e2e/686C-674.cypress (17 of 22)
[2021-05-05T16:27:50.600Z] .spec.js
[2021-05-05T16:27:50.600Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:27:54.754Z] [success] [webpackbar] Webpack: Compiled successfully in 3.76s
[2021-05-05T16:27:58.011Z]
[2021-05-05T16:27:58.011Z]
[2021-05-05T16:27:58.011Z] 686C-674
[2021-05-05T16:27:58.011Z] add-child-add-674
[2021-05-05T16:28:24.479Z] ✓ fills the form (22527ms)
[2021-05-05T16:28:24.479Z] spouse-child-all-fields
[2021-05-05T16:28:42.498Z] ✓ fills the form (21021ms)
[2021-05-05T16:28:42.498Z]
[2021-05-05T16:28:42.498Z]
[2021-05-05T16:28:42.498Z] 2 passing (44s)
[2021-05-05T16:28:42.498Z]
[2021-05-05T16:28:42.498Z]
[2021-05-05T16:28:42.498Z] (Results)
[2021-05-05T16:28:42.498Z]
[2021-05-05T16:28:42.498Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:28:42.498Z] │ Tests: 2 │
[2021-05-05T16:28:42.498Z] │ Passing: 2 │
[2021-05-05T16:28:42.498Z] │ Failing: 0 │
[2021-05-05T16:28:42.498Z] │ Pending: 0 │
[2021-05-05T16:28:42.498Z] │ Skipped: 0 │
[2021-05-05T16:28:42.498Z] │ Screenshots: 0 │
[2021-05-05T16:28:42.498Z] │ Video: false │
[2021-05-05T16:28:42.498Z] │ Duration: 43 seconds │
[2021-05-05T16:28:42.498Z] │ Spec Ran: applications/disability-benefits/686c-674/tests/e2e/686C-674.cypress.spec.js │
[2021-05-05T16:28:42.498Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:28:42.498Z]
[2021-05-05T16:28:42.498Z]
[2021-05-05T16:28:42.498Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:28:42.498Z]
[2021-05-05T16:28:42.498Z] Running: applications/disability-benefits/996/tests/hlr-wizard.cypress.spec.j (18 of 22)
[2021-05-05T16:28:42.498Z] s
[2021-05-05T16:28:42.752Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:28:43.006Z] [success] [webpackbar] Webpack: Compiled successfully in 233.62ms
[2021-05-05T16:28:44.887Z]
[2021-05-05T16:28:44.887Z]
[2021-05-05T16:28:44.887Z] HLR wizard
[2021-05-05T16:28:46.771Z] ✓ should show the form wizard (1936ms)
[2021-05-05T16:28:48.130Z] ✓ should show other claims (1374ms)
[2021-05-05T16:28:50.011Z] ✓ should show legacy appeals question & alert (1834ms)
[2021-05-05T16:28:51.895Z] ✓ should show legacy appeals question & alert (1994ms)
[2021-05-05T16:28:51.895Z]
[2021-05-05T16:28:51.895Z]
[2021-05-05T16:28:51.895Z] 4 passing (7s)
[2021-05-05T16:28:51.895Z]
[2021-05-05T16:28:51.895Z]
[2021-05-05T16:28:51.895Z] (Results)
[2021-05-05T16:28:51.895Z]
[2021-05-05T16:28:51.895Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:28:51.895Z] │ Tests: 4 │
[2021-05-05T16:28:51.895Z] │ Passing: 4 │
[2021-05-05T16:28:51.895Z] │ Failing: 0 │
[2021-05-05T16:28:51.895Z] │ Pending: 0 │
[2021-05-05T16:28:51.895Z] │ Skipped: 0 │
[2021-05-05T16:28:51.895Z] │ Screenshots: 0 │
[2021-05-05T16:28:51.895Z] │ Video: false │
[2021-05-05T16:28:51.895Z] │ Duration: 7 seconds │
[2021-05-05T16:28:51.895Z] │ Spec Ran: applications/disability-benefits/996/tests/hlr-wizard.cypress.spec.js │
[2021-05-05T16:28:51.895Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:28:51.895Z]
[2021-05-05T16:28:51.895Z]
[2021-05-05T16:28:51.895Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:28:51.895Z]
[2021-05-05T16:28:51.895Z] Running: applications/disability-benefits/996/tests/hlr.cypress.spec.js (19 of 22)
[2021-05-05T16:28:53.777Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:29:01.868Z] [success] [webpackbar] Webpack: Compiled successfully in 7.53s
[2021-05-05T16:29:07.100Z]
[2021-05-05T16:29:07.100Z]
[2021-05-05T16:29:07.100Z] Request for Higher-Level Review
[2021-05-05T16:29:07.100Z] maximal-test
[2021-05-05T16:29:25.133Z] ✓ fills the form (17780ms)
[2021-05-05T16:29:25.133Z] minimal-test
[2021-05-05T16:29:31.681Z] ✓ fills the form (6887ms)
[2021-05-05T16:29:31.681Z]
[2021-05-05T16:29:31.681Z]
[2021-05-05T16:29:31.681Z] 2 passing (25s)
[2021-05-05T16:29:31.681Z]
[2021-05-05T16:29:31.681Z]
[2021-05-05T16:29:31.681Z] (Results)
[2021-05-05T16:29:31.681Z]
[2021-05-05T16:29:31.681Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:29:31.681Z] │ Tests: 2 │
[2021-05-05T16:29:31.681Z] │ Passing: 2 │
[2021-05-05T16:29:31.681Z] │ Failing: 0 │
[2021-05-05T16:29:31.681Z] │ Pending: 0 │
[2021-05-05T16:29:31.681Z] │ Skipped: 0 │
[2021-05-05T16:29:31.681Z] │ Screenshots: 0 │
[2021-05-05T16:29:31.681Z] │ Video: false │
[2021-05-05T16:29:31.681Z] │ Duration: 24 seconds │
[2021-05-05T16:29:31.681Z] │ Spec Ran: applications/disability-benefits/996/tests/hlr.cypress.spec.js │
[2021-05-05T16:29:31.681Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:29:31.681Z]
[2021-05-05T16:29:31.681Z]
[2021-05-05T16:29:31.681Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:29:31.681Z]
[2021-05-05T16:29:31.681Z] Running: applications/disability-benefits/all-claims/tests/all-claims-wizard. (20 of 22)
[2021-05-05T16:29:31.681Z] cypress.spec.js
[2021-05-05T16:29:33.041Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:29:33.600Z] [success] [webpackbar] Webpack: Compiled successfully in 622.41ms
[2021-05-05T16:29:36.109Z]
[2021-05-05T16:29:36.109Z]
[2021-05-05T16:29:36.109Z] 526 wizard
[2021-05-05T16:29:37.990Z] ✓ should show the form wizard (2219ms)
[2021-05-05T16:29:39.879Z] ✓ should show disagreeing with a decision questions & alert (1695ms)
[2021-05-05T16:29:42.397Z] ✓ should show BDD questions & start button (2318ms)
[2021-05-05T16:29:44.279Z] ✓ should start all-claims/original claims flow (2082ms)
[2021-05-05T16:29:44.279Z]
[2021-05-05T16:29:44.279Z]
[2021-05-05T16:29:44.279Z] 4 passing (8s)
[2021-05-05T16:29:44.279Z]
[2021-05-05T16:29:44.279Z]
[2021-05-05T16:29:44.279Z] (Results)
[2021-05-05T16:29:44.279Z]
[2021-05-05T16:29:44.279Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:29:44.279Z] │ Tests: 4 │
[2021-05-05T16:29:44.279Z] │ Passing: 4 │
[2021-05-05T16:29:44.279Z] │ Failing: 0 │
[2021-05-05T16:29:44.279Z] │ Pending: 0 │
[2021-05-05T16:29:44.279Z] │ Skipped: 0 │
[2021-05-05T16:29:44.279Z] │ Screenshots: 0 │
[2021-05-05T16:29:44.279Z] │ Video: false │
[2021-05-05T16:29:44.279Z] │ Duration: 8 seconds │
[2021-05-05T16:29:44.279Z] │ Spec Ran: applications/disability-benefits/all-claims/tests/all-claims-wizard.cypress.spec │
[2021-05-05T16:29:44.279Z] │ .js │
[2021-05-05T16:29:44.279Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:29:44.279Z]
[2021-05-05T16:29:44.279Z]
[2021-05-05T16:29:44.279Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:29:44.279Z]
[2021-05-05T16:29:44.279Z] Running: applications/disability-benefits/all-claims/tests/all-claims.cypress (21 of 22)
[2021-05-05T16:29:44.279Z] .spec.js
[2021-05-05T16:29:45.638Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:29:53.710Z] [success] [webpackbar] Webpack: Compiled successfully in 7.23s
[2021-05-05T16:29:58.945Z]
[2021-05-05T16:29:58.945Z]
[2021-05-05T16:29:58.945Z] 21-526EZ disability compensation claim form
[2021-05-05T16:29:59.200Z] full-781-781a-8940-test.json
[2021-05-05T16:41:05.711Z] ✓ fills the form (664656ms)
[2021-05-05T16:41:05.711Z] maximal-test
[2021-05-05T16:43:12.046Z] ✓ fills the form (118016ms)
[2021-05-05T16:43:12.046Z] maximal-bdd-test
[2021-05-05T16:43:26.855Z] ✓ fills the form (21969ms)
[2021-05-05T16:43:26.855Z] minimal-test
[2021-05-05T16:43:36.770Z] ✓ fills the form (11517ms)
[2021-05-05T16:43:36.770Z] minimal-bdd-test
[2021-05-05T16:43:51.578Z] ✓ fills the form (14241ms)
[2021-05-05T16:43:51.578Z] newOnly-test
[2021-05-05T16:44:09.589Z] ✓ fills the form (16009ms)
[2021-05-05T16:44:09.589Z] secondary-new-test.json
[2021-05-05T16:44:31.440Z] ✓ fills the form (22791ms)
[2021-05-05T16:44:31.440Z] upload-781-781a-8940-test.json
[2021-05-05T16:44:46.299Z] ✓ fills the form (14473ms)
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z] 8 passing (15m)
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z] (Results)
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:44:46.299Z] │ Tests: 8 │
[2021-05-05T16:44:46.299Z] │ Passing: 8 │
[2021-05-05T16:44:46.299Z] │ Failing: 0 │
[2021-05-05T16:44:46.299Z] │ Pending: 0 │
[2021-05-05T16:44:46.299Z] │ Skipped: 0 │
[2021-05-05T16:44:46.299Z] │ Screenshots: 0 │
[2021-05-05T16:44:46.299Z] │ Video: false │
[2021-05-05T16:44:46.299Z] │ Duration: 14 minutes, 45 seconds │
[2021-05-05T16:44:46.299Z] │ Spec Ran: applications/disability-benefits/all-claims/tests/all-claims.cypress.spec.js │
[2021-05-05T16:44:46.299Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z] ────────────────────────────────────────────────────────────────────────────────────────────────────
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z] Running: applications/disability-benefits/view-payments/tests/e2e/view-paymen (22 of 22)
[2021-05-05T16:44:46.299Z] ts.cypress.spec.js
[2021-05-05T16:44:46.299Z] [info] [webpackbar] Compiling Webpack
[2021-05-05T16:44:46.299Z] [success] [webpackbar] Webpack: Compiled successfully in 101.24ms
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z]
[2021-05-05T16:44:46.299Z] View payment history
[2021-05-05T16:44:46.856Z] ✓ C3916 - Should pass an aXe scan and paginate through payment data (1047ms)
[2021-05-05T16:44:47.777Z] ✓ C3917 - Should display an alert when a user has no payment data on file (918ms)
[2021-05-05T16:44:48.699Z] ✓ C3918 - Should display an alert when a user has payments received but no payments returned to VA (956ms)
[2021-05-05T16:44:49.620Z] ✓ C3919 - Should display an alert when a user has payments returned to VA but no payments received (865ms)
[2021-05-05T16:44:50.571Z] ✓ C3920 - Should display an alert when a user receives a 5xx error (804ms)
[2021-05-05T16:44:51.492Z] ✓ C3921 - Should display an alert when a user receives a 4xx error (828ms)
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z] 6 passing (5s)
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z] (Results)
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:44:51.492Z] │ Tests: 6 │
[2021-05-05T16:44:51.492Z] │ Passing: 6 │
[2021-05-05T16:44:51.492Z] │ Failing: 0 │
[2021-05-05T16:44:51.492Z] │ Pending: 0 │
[2021-05-05T16:44:51.492Z] │ Skipped: 0 │
[2021-05-05T16:44:51.492Z] │ Screenshots: 0 │
[2021-05-05T16:44:51.492Z] │ Video: false │
[2021-05-05T16:44:51.492Z] │ Duration: 5 seconds │
[2021-05-05T16:44:51.492Z] │ Spec Ran: applications/disability-benefits/view-payments/tests/e2e/view-payments.cypress.s │
[2021-05-05T16:44:51.492Z] │ pec.js │
[2021-05-05T16:44:51.492Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z] ====================================================================================================
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z] (Run Finished)
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z]
[2021-05-05T16:44:51.492Z] Spec Tests Passing Failing Pending Skipped
[2021-05-05T16:44:51.492Z] ┌────────────────────────────────────────────────────────────────────────────────────────────────┐
[2021-05-05T16:44:51.492Z] │ ✔ applications/appeals/10182/tests/10 12ms 1 - - 1 - │
[2021-05-05T16:44:51.492Z] │ 182-notice-of-disagreement.cypress. │
[2021-05-05T16:44:51.492Z] │ spec.js │
[2021-05-05T16:44:51.492Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.492Z] │ ✔ applications/ask-a-question/tests/c 23ms 1 - - 1 - │
[2021-05-05T16:44:51.492Z] │ ypress/ask-a-question.authed.cypres │
[2021-05-05T16:44:51.492Z] │ s.spec.js │
[2021-05-05T16:44:51.492Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.492Z] │ ✔ applications/ask-a-question/tests/c 15ms 2 - - 2 - │
[2021-05-05T16:44:51.492Z] │ ypress/ask-a-question.unauthed.cypr │
[2021-05-05T16:44:51.492Z] │ ess.spec.js │
[2021-05-05T16:44:51.492Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.492Z] │ ✔ applications/caregivers/tests/e2e/1 01:33 4 4 - - - │
[2021-05-05T16:44:51.492Z] │ 010cg.cypress.spec.js │
[2021-05-05T16:44:51.492Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.492Z] │ ✔ applications/coronavirus-research/t 00:14 2 2 - - - │
[2021-05-05T16:44:51.492Z] │ ests/reviewAndSubmit.cypress.spec.j │
[2021-05-05T16:44:51.492Z] │ s │
[2021-05-05T16:44:51.492Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.492Z] │ ✔ applications/coronavirus-vaccinatio 00:03 1 1 - - - │
[2021-05-05T16:44:51.492Z] │ n-expansion/tests/coronavirus-vacci │
[2021-05-05T16:44:51.492Z] │ nation-expansion-form-validation.cy │
[2021-05-05T16:44:51.492Z] │ press.spec.js │
[2021-05-05T16:44:51.492Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.492Z] │ ✔ applications/coronavirus-vaccinatio 00:47 6 6 - - - │
[2021-05-05T16:44:51.492Z] │ n-expansion/tests/coronavirus-vacci │
[2021-05-05T16:44:51.492Z] │ nation-expansion.cypress.spec.js │
[2021-05-05T16:44:51.492Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.492Z] │ ✔ applications/coronavirus-vaccinatio 00:07 1 1 - - - │
[2021-05-05T16:44:51.492Z] │ n/tests/e2e/hideauth.cypress.spec.j │
[2021-05-05T16:44:51.492Z] │ s │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/coronavirus-vaccinatio 00:07 1 1 - - - │
[2021-05-05T16:44:51.493Z] │ n/tests/e2e/signup.cypress.spec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/coronavirus-vaccinatio 957ms 1 1 - - - │
[2021-05-05T16:44:51.493Z] │ n/tests/e2e/unsubscribe.cypress.spe │
[2021-05-05T16:44:51.493Z] │ c.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/coronavirus-vaccinatio 997ms 1 1 - - - │
[2021-05-05T16:44:51.493Z] │ n/tests/e2e/unsubscribeFail.cypress │
[2021-05-05T16:44:51.493Z] │ .spec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/debt-letters/tests/e2e 19ms 5 - - 5 - │
[2021-05-05T16:44:51.493Z] │ /debt-letters.cypress.spec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/debt-letters/tests/e2e 29ms 7 - - 7 - │
[2021-05-05T16:44:51.493Z] │ /diary-codes-content.cypress.spec.j │
[2021-05-05T16:44:51.493Z] │ s │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/debt-letters/tests/e2e 21ms 4 - - 4 - │
[2021-05-05T16:44:51.493Z] │ /diary-codes-next-step.cypress.spec │
[2021-05-05T16:44:51.493Z] │ .js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/disability-benefits/23 00:17 4 4 - - - │
[2021-05-05T16:44:51.493Z] │ 46/tests/mdot.cypress.spec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/disability-benefits/68 00:47 3 3 - - - │
[2021-05-05T16:44:51.493Z] │ 6c-674/tests/e2e/686C-674-ancilliar │
[2021-05-05T16:44:51.493Z] │ y.cypress.spec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/disability-benefits/68 00:43 2 2 - - - │
[2021-05-05T16:44:51.493Z] │ 6c-674/tests/e2e/686C-674.cypress.s │
[2021-05-05T16:44:51.493Z] │ pec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/disability-benefits/99 00:07 4 4 - - - │
[2021-05-05T16:44:51.493Z] │ 6/tests/hlr-wizard.cypress.spec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/disability-benefits/99 00:24 2 2 - - - │
[2021-05-05T16:44:51.493Z] │ 6/tests/hlr.cypress.spec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/disability-benefits/al 00:08 4 4 - - - │
[2021-05-05T16:44:51.493Z] │ l-claims/tests/all-claims-wizard.cy │
[2021-05-05T16:44:51.493Z] │ press.spec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/disability-benefits/al 14:45 8 8 - - - │
[2021-05-05T16:44:51.493Z] │ l-claims/tests/all-claims.cypress.s │
[2021-05-05T16:44:51.493Z] │ pec.js │
[2021-05-05T16:44:51.493Z] ├────────────────────────────────────────────────────────────────────────────────────────────────┤
[2021-05-05T16:44:51.493Z] │ ✔ applications/disability-benefits/vi 00:05 6 6 - - - │
[2021-05-05T16:44:51.493Z] │ ew-payments/tests/e2e/view-payments │
[2021-05-05T16:44:51.493Z] │ .cypress.spec.js │
[2021-05-05T16:44:51.493Z] └────────────────────────────────────────────────────────────────────────────────────────────────┘
[2021-05-05T16:44:51.493Z] ✔ All specs passed! 20:15 70 50 - 20 -
[2021-05-05T16:44:51.493Z]
[2021-05-05T16:44:51.493Z] [percy] Stopping percy...
[2021-05-05T16:44:51.746Z] [percy] Finalized build #25: https://percy.io/a45965dd/vets-website/builds/10260515
[2021-05-05T16:44:51.746Z] [percy] Done!
[2021-05-05T16:44:51.746Z] Done in 1379.79s.Notice the PERCY_TOKEN is logged in Jenkins:
docker-compose -p cypress-2 run --rm --entrypoint=npm -e CI=true -e NO_COLOR=1 -e STEP=0 -e PERCY_PARALLEL_NONCE=1620231696019 -e PERCY_TOKEN=bb8ff2dbbc77a1d995ce021ac1f131f6fe8f78b0bc75846f834a8256121205bd vets-website --no-color run cy:test:dockerTo prevent this, we can grab the value for PERCY_TOKEN from AWS Parameter Store in the script/run-cypress-tests-docker.js file. Demian in ops confirmed we can do this and gave us this sample code:
var AWS = require('aws-sdk');
AWS.config.update({ region: 'us-gov-west-1' });
var ssm = new AWS.SSM();
function getParameter(param) {
return new Promise(function (success, reject) {
ssm.getParameter(param, function (err, data) {
if (err) {
reject(err);
} else {
success(data);
}
});
});
};
function main() {
let token = {
Name: "/dsva-vagov/vets-website/common/percy_token_vets-website",
WithDecryption: true
};
let percy_token;
var promises = [];
promises.push(getParameter(token));
Promise.all(promises)
.then(function (result) {
percy_token = result[0].Parameter.Value;
console.log(percy_token);
....
});
...
})
.catch(function (err) {
console.log(err);
});
}
main();Demian said, "if you get a permissions related stack trace, let me know and we can figure out what it needs."
I spoke to Peter about making this change. We proved Percy works with Darius' parallelization. We know there's a way to prevent the PERCY_TOKEN from being logged in the Jenkins logs. Peter and I agreed that we don't need to put any more time into this ticket because this is never going to run in Jenkins anyway.
I refreshed that Percy token.
This ticket can be closed.
holdenhinkle
commented
3 years ago Percy only supports Chrome and Firefox. It does not support IE. => https://docs.percy.io/docs/cross-browser-visual-testing
pjhill
commented
3 years ago The spike is complete and proved out what we wanted it to prove out. This is in a demoable for stakeholders as well.
User Story
As a platform participant, I need a quick and intelligent analysis of my product for unexpected regressions resulting from the changes being integrated for each build.
Expected Behavior
Visual regression testing tooling provides immediate feedback about regressions to the product that have a visual impact.
Acceptance Criteria