crc-org / crc

CRC is a tool to help you run containers. It manages a local OpenShift 4.x cluster, Microshift or a Podman VM optimized for testing and development purposes
https://crc.dev
Apache License 2.0
1.26k stars 242 forks source link

[QE] Reportportal launch for failed pipeline run #4412

Open lilyLuLiu opened 1 month ago

lilyLuLiu commented 1 month ago

Currently, if the pipeline run failed before reportportal-import task, there is no record of the failure(as pipeline run periodically clean). Add a post task for pipeline run if it's failed. This task will create a XML file that include the failure details and import the xml file to reportportal.

albfan commented 2 weeks ago

Do we have any example of this error?

lilyLuLiu commented 2 weeks ago

We aim to using reportportal to check all tests as ocp clear pipeline runs in one or two days. But if pipeline failed before task reportportal-import(like the picture), there is nothing imported into reportportal. We even don't know there is a test run failed from reportportal. Image

So we need a final task that triggered if the pipeline run failed. This task will collect the failed info and import to reportportal.