Change in failure rate over time

codeday-clarity / ci-visualizer

This holds the code for the CI CD Visualizer. See README for details of how to view the demo

http://app.ci-visualizer.com

0 stars 0 forks source link

Open robmoore-i opened 3 years ago

robmoore-i commented 3 years ago

Is a job becoming more flaky? Has it become less flaky?

Also: Change in job run frequency over time

Is a job being run more often? Is that why it's failing more?

Basically, we don't want to confuse these two causes of a job having more failures / day (for example):

The job runs more frequently, with the same proportion of executions resulting in failure
The proportion of executions which result in failure changes.

robmoore-i commented 3 years ago

@SamirIngley Added some stuff to this. Talk to @jonathonkindle about it.