BMMRO-tech / BMMRO

MIT License
3 stars 5 forks source link

Address tests running in CI #379

Open emilyTWorks opened 1 year ago

emilyTWorks commented 1 year ago

Background

We found that increasingly the tests would fail in the pipeline, even though they would run fine locally. We’re constrained by the resources available but this is something that hampered us and got worse throughout our time

Wireframe/Behaviour

In scope

Out of scope

Tech tasks

Reminders

VladaTW commented 1 year ago

The tests in Github Actions dev-ops workflow appear to be passing or failing randomly.

In some instances assigning more generous timeout allowance helped to an extent but did not eliminate the problem.

The inconsistency of failing/passing leads to conclusion that we are likely dealing with issues caused by environment configuration, or possibly even by age of the libraries used in the Application.

Even if we fix the issue of flaky tests now, there is still a good chance we'll need to deal with it once dependencies  upgrade takes place.

Therefore, the decision has been made to pause the work on this ticket and revisit it once the said dependencies upgrades have taken place.