Set up CI to block changes that decrease critical coverage metrics

IntersectMBO / plutus

The Plutus language implementation and tools

Apache License 2.0

1.57k stars 476 forks source link

Set up CI to block changes that decrease critical coverage metrics #6132

Closed ana-pantilie closed 4 months ago

ana-pantilie commented 5 months ago

As a Plutus Core developer, I want to be told if key coverage metrics decrease, so that I keep the code well tested.

Key coverage metrics:

CEK machine coverage by conformance test suite (most important by far)
others?

Acceptance criteria

There is a gate in CI that blocks PRs if the key coverage metrics decrease.

effectfully commented 4 months ago

I doubt this is ever going to happen and we don't even seem to be evolving the conformance test suite, so I'm closing this issue and if anybody disagrees do feel free to reopen.