search

crc-org / crc

CRC is a tool to help you run containers. It manages a local OpenShift 4.x cluster, Microshift or a Podman VM optimized for testing and development purposes
https://crc.dev
Apache License 2.0
1.26k stars 242 forks source link

[QE] Do not mark skipped tests as "To investigate" #4435

Open albfan opened 2 weeks ago

albfan commented 2 weeks ago

By default skipped test are marked as "To investigate" like if that status was problematic.

There's config for avoid that behaviour, but we cannot control it.

There's API to disable those status

albfan commented 2 weeks ago

Some skipped tests are caused by previous fail, so is not exact that skipped test should be ignored.

About report portal version:

https://reportportal.io/docs/releases/

We are in 5.7.2, till 23.2 skippedIsNotIssue for API import request will not be available.

Right now we can change manually "To investigate" to "No defect", but is not clear what API requestion (probably test-item-controller update) can change that.

A possible solution would be to list all the test item created and change skipped ones to "No defect"

Probably we will wait for reportportal upgrade to use skippedNotIssue parameter