sigstore / sigstore-conformance

Conformance testing for Sigstore clients
https://sigstore.dev
7 stars 10 forks source link

how should we enable staging #130

Closed jku closed 6 months ago

jku commented 6 months ago

So I'm looking at doing some final testing before enabling staging test by default (changing the default value of the action input) however...

I started thinking about how this goes in the future (assume we have many more tests that support testing on staging):

Alternatively we might want to require running the action separately for staging: this makes it easy to manage the xfail lists separately.

jku commented 6 months ago

I think I kind of like the idea of separate action invocations: this also looks more meaningful on GitHub: "failure in Staging conformance" requires very different action from "failure in conformance"

I'll make a PR of this and will do some testing...