This is related to https://github.com/input-output-hk/hydra/issues/1449 as to verify this, you need to run the tests in the right directory. And a false sense of security is created by seeing the tests green (although they generated new golden files).
Actual behavior
Our CI allowed a change to hydra-plutus to be merged to master without
The CI to actually run the hydra-plutus tests, detect breaking changes by seeing golden tests red (and their intended consequence of documenting detected breaking changes)
Context & versions
On current master cb5a8c8e9ed0af7a2f8ba422ab78f042d4ee4920, we have a green CI https://github.com/input-output-hk/hydra/actions/runs/9280096242.
BUT, the
hydra-plutus
tests are actually RED.Steps to reproduce
cb5a8c8e9ed0af7a2f8ba422ab78f042d4ee4920
cd hydra-plutus
cabal run hydra-plutus:exe:tests
This is related to https://github.com/input-output-hk/hydra/issues/1449 as to verify this, you need to run the tests in the right directory. And a false sense of security is created by seeing the tests green (although they generated new golden files).
Actual behavior
Our CI allowed a change to
hydra-plutus
to be merged tomaster
withoutExpected behavior
The CI to actually run the
hydra-plutus
tests, detect breaking changes by seeing golden tests red (and their intended consequence of documenting detected breaking changes)Hypothesis
nix build .#checks.x86_64-linux.hydra-plutus
seemingly does not run thehydra-plutus
tests.