department-of-veterans-affairs / va-mobile-app

"If VA were a company, it would have a flagship mobile app."
https://department-of-veterans-affairs.github.io/va-mobile-app/
16 stars 2 forks source link

Automation - Increase resource class and add parallelism for test executors #4164

Closed lexicalninja closed 1 year ago

lexicalninja commented 1 year ago

Automation Ticket

Type of Change

What systems/scripts are changing?

What is the work being done?

We would like to increase the size of the executor for tests and to add parallelism as part of our plan to improve tests and test times.

@Sparowhawk did as spike on #4097 and you can see his recommendations attached to that.

This task will be to do the following: decide if we need a separate executor for test runs whatever executor we use for testing should use the x-large docker resource size

The test job should also be given [parallelism of 5](and should use parallelism of 5

Testing considerations)

What testing did you do?

What testing needs to be done by the reviewer?

What testing needs to be done to ensure that this work is complete in production?

Please create a separate branch and have the CI set up to run tests in this manner on just this branch to collect data and prove out what has worked on Dylan's local machine.

We should give it a couple runs to see if it runs and how much faster it seems to be getting.

Acceptability Criteria

TKDickson commented 1 year ago

@narin or @Sparowhawk, can one of you move this ticket to 'closed' if you're satisfied that it's accomplished what you hoped?

narin commented 1 year ago

Parallelism has been to our test runner, reducing the amount of time it takes to run unit tests from ~13 min to ~4 min! This will also hopefully cut down on flaky test failures. Closing out.