This PR creates a set of integration tests using the tmt tool, a script that generates ARF reports with different configurations, modifies the smoke test to use the given ARF file, and creates a GitHub action to run these integration tests weekly.
The tests use ARF results generated with the latest content available as an SSG package and content from the ComplianceAsCode/content repository.
Some integration tests could have failed because the test used the latest released openscap-report package. The goal is to check the released package of openscap-repot is behave right with changes in content in ComplianceAsCode/content and with shipped content in the SSG package.
The integration test could be executed in Tesitng Farm with PackIt. It would need some adjustments to the content product. In Testing Farm could be provided RPM package from changes in PR. Execution of this test in Testing Farm takes about 30min.
That's why I decided to run the integration test scheduled with GitHub Actions. I think using these tests for changes in PR would be pointless.
Honny1
commented
1 year ago
This PR creates a set of integration tests using the
tmttool, a script that generates ARF reports with different configurations, modifies the smoke test to use the given ARF file, and creates a GitHub action to run these integration tests weekly.The tests use ARF results generated with the latest content available as an SSG package and content from the ComplianceAsCode/content repository.
Some integration tests could have failed because the test used the latest released openscap-report package. The goal is to check the released package of openscap-repot is behave right with changes in content in ComplianceAsCode/content and with shipped content in the SSG package.
The integration test could be executed in Tesitng Farm with PackIt. It would need some adjustments to the content product. In Testing Farm could be provided RPM package from changes in PR. Execution of this test in Testing Farm takes about 30min.
That's why I decided to run the integration test scheduled with GitHub Actions. I think using these tests for changes in PR would be pointless.