We have found that if we set a step as "best effort" in OpenShift CI and that step fails, it will still show the job as passing. This behavior makes sense, but we would like to set a step as best effort so that we can run multiple test suites in a row, but ultimately if any of them fail, we would like the job to show as a failed.
We have found that if we set a step as "best effort" in OpenShift CI and that step fails, it will still show the job as passing. This behavior makes sense, but we would like to set a step as best effort so that we can run multiple test suites in a row, but ultimately if any of them fail, we would like the job to show as a failed.
Rehearsal proving this behavior: https://prow.ci.openshift.org/view/gs/test-platform-results/pr-logs/pull/openshift_release/53583/rehearse-53583-periodic-ci-rhpit-interop-tests-main-test-best-effort-option-test-step/1805264730751766528