kata-containers / tests

Kata Containers tests, CI, and metrics
https://katacontainers.io/
Apache License 2.0
139 stars 196 forks source link

ci/openshift-ci: Add wrapper to ignore invariant failures #5789

Closed ldoktor closed 1 year ago

ldoktor commented 1 year ago

we are getting quite a lot of invariant tests failures, add this script that will be used by "openshift/release" pipelines to post-process the openshift-tests executions to ignore these for now (while reporting the failures to xunit results).

Note the invariant tests are related on monitoring stability, which is tricky when you replace containers with VMs. Anyway we still want to investigate those but at this point we need to focus on the functional tests more.

ldoktor commented 1 year ago

This file will be used in https://github.com/openshift/release/pull/44073

ldoktor commented 1 year ago

Actually we can perhaps test changes better by using pastebin in openshift/release and then modifying the file directly (it might result in need to merge broken runs but it's still probably cleaner than using two repos)