search

SatelliteQE / robottelo

Robottelo is a test suite that exercises The Foreman.
GNU General Public License v3.0
61 stars 114 forks source link

Fix and extend the RH recommended repos case #16930

Open vsedmik opened 1 week ago

vsedmik commented 1 week ago

Problem Statement

The "recommended repos" test case has been failing for a while, blocking us from seeing product bugs. Also some of the recommended repos has changed over a time.

Solution

This PR updates and extends the test case. It could be backported with minor changes in the constants to 6.16.z and 6.15.z, I would handle the changes in the cherry-picks.

At this time it is expected to fail in stream. It must keep failing until https://github.com/Katello/katello/pull/11205 is baked in stream AND the 6.17 repos are added to match the Satellite version.

Related Issues

https://issues.redhat.com/browse/SAT-29446 https://issues.redhat.com/browse/SAT-29448

PRT test Cases example

requires https://github.com/SatelliteQE/airgun/pull/1631

trigger: test-robottelo
pytest: tests/foreman/ui/test_repository.py -k recommended_repos
vsedmik commented 1 week ago

trigger: test-robottelo pytest: tests/foreman/ui/test_repository.py -k recommended_repos

Satellite-QE commented 1 week ago

PRT Result

Build Number: 9373
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/ui/test_repository.py -k recommended_repos --external-logging
Test Result : ========== 1 failed, 28 deselected, 38 warnings in 1726.67s (0:28:46) ==========
LadislavVasina1 commented 6 days ago 
trigger: test-robottelo
pytest: tests/foreman/ui/test_repository.py -k recommended_repos
Satellite-QE commented 6 days ago

PRT Result

Build Number: 9376
Build Status: UNSTABLE
PRT Comment: pytest tests/foreman/ui/test_repository.py -k recommended_repos --external-logging
Test Result : ========== 1 failed, 28 deselected, 38 warnings in 798.92s (0:13:18) ===========