codeday-clarity / ci-visualizer

This holds the code for the CI CD Visualizer. See README for details of how to view the demo
http://app.ci-visualizer.com
0 stars 0 forks source link

Time spent waiting for repeated flaky builds #13

Open robmoore-i opened 3 years ago

robmoore-i commented 3 years ago

Developers want a green build for their feature branch so they can merge to the main branch safely. They run their build, and it fails. They check, they see the failure was some test, and they know that this test is flaky, and that if they run the job again, it'll probably go green. So they run it again, without making any changes! That is, they run exactly the same code against the same tests again, and expect a different result. This is because the build is flaky. Waiting for the next build is a waste caused by having flaky tests.

How much time do developers spend waiting for the repeated builds?