Add detection of product(s) when test scenarios are updated/added

ComplianceAsCode / content-test-filtering

System for Automatic Filtering of Tests for ComplianceAsCode project

8 stars 6 forks source link

Add detection of product(s) when test scenarios are updated/added #19

Open matusmarhefka opened 3 years ago

matusmarhefka commented 3 years ago

CTF should properly detect which product(s) are targeted by updated or newly added test scenarios. Currently this doesn't work as expected, for example see https://github.com/ComplianceAsCode/content/pull/7634/checks?check_run_id=3687722905 from https://github.com/ComplianceAsCode/content/pull/7634 where RHEL7 scenarios got added but CTF detected product as RHEL8.

ggbecker commented 3 years ago

if you consider that tests are run in a fedora container even if it would report RHEL7, the tests wouldn't be applicable anyway. I agree that it should report RHEL7 in this case but maybe we have to think about an option to override the platform so the test would be run on the fedora container.