quipucords / camayoc

Test automation framework that facilitates functional testing of quipucords.
https://camayoc.readthedocs.io/
GNU General Public License v3.0
5 stars 4 forks source link

Mark more tests as nightly_only #529

Closed mirekdlugosz closed 3 months ago

mirekdlugosz commented 3 months ago

These three tests cover parts that are very rarely modified, while taking about 3 minutes to complete. Hence a proposal to move them to nightly pipeline, to save some time in PR checks.

The drawback is obvious - they won't run even for PRs that actually modify extended/disabled products, so there's a risk of merging breaking change. We should run standalone job for these PRs, but I bet we won't remember. Hopefully pipeline will still be stable then, so we will notice some failures in nightly run, which should prompt us to investigate.

codecov[bot] commented 3 months ago

Codecov Report

All modified and coverable lines are covered by tests :white_check_mark:

Project coverage is 78.48%. Comparing base (2a21c4b) to head (7ed0a82). Report is 1 commits behind head on main.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #529 +/- ## ======================================= Coverage 78.48% 78.48% ======================================= Files 7 7 Lines 688 688 ======================================= Hits 540 540 Misses 148 148 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.