input-output-hk / hydra

Implementation of the Hydra Head protocol
https://hydra.family/head-protocol/
Apache License 2.0
264 stars 86 forks source link

Hydra-plutus tests are actually red and golden tests got side-stepped #1458

Closed ch1bo closed 1 month ago

ch1bo commented 1 month ago

Context & versions

On current master cb5a8c8e9ed0af7a2f8ba422ab78f042d4ee4920, we have a green CI https://github.com/input-output-hk/hydra/actions/runs/9280096242.

BUT, the hydra-plutus tests are actually RED.

Steps to reproduce

  1. Checkout cb5a8c8e9ed0af7a2f8ba422ab78f042d4ee4920
  2. cd hydra-plutus
  3. cabal run hydra-plutus:exe:tests

This is related to https://github.com/input-output-hk/hydra/issues/1449 as to verify this, you need to run the tests in the right directory. And a false sense of security is created by seeing the tests green (although they generated new golden files).

Actual behavior

Our CI allowed a change to hydra-plutus to be merged to master without

Expected behavior

The CI to actually run the hydra-plutus tests, detect breaking changes by seeing golden tests red (and their intended consequence of documenting detected breaking changes)

Hypothesis

locallycompact commented 1 month ago

https://github.com/input-output-hk/hydra/pull/1459

ch1bo commented 1 month ago

Fixed by #1459