search

operator-framework / operator-lifecycle-manager

A management framework for extending Kubernetes with Operators
https://olm.operatorframework.io
Apache License 2.0
1.7k stars 542 forks source link

Aggregate e2e test results into a single JUnit report #2578

Open timflannagan opened 2 years ago

timflannagan commented 2 years ago

Feature Request

Is your feature request related to a problem? Please describe. A clear and concise description of what the problem is. Example: "I have an issue when (...)"

This is a follow-up for the e2e parallelization work that was done through https://github.com/operator-framework/operator-lifecycle-manager/pull/2520.

Describe the solution you'd like A clear and concise description of what you want to happen. Add any considered drawbacks.

Now that the overall e2e suite is split across four, parallel instances, the result of running those individual test jobs results in four JUnit reports (on top of any cluster debugging information) being produced, vs. a single JUnit report like the previous behavior. Combining them into a single report will with future work around building CI metrics to help identify flakes, regressions, etc.

timflannagan commented 2 years ago

See https://github.com/operator-framework/operator-lifecycle-manager/pull/2520#discussion_r786933926 for more information.