This provides a system test to compare a set of RTC jobs submitted to both hyp3-test-api and hyp3-api, using hyp3-api as the "gold standard".
Note: gold terminology is used by gdalcompare and so we're following that terminology. In other science communities "baseline" would be used in place of "golden", or more appropriately (b/c mathematicians), "reference" would be used.
There are six jobs that exercise the different RTC customization options in combination with each other
Limitations
This is one bit pytest test, so there is no way provided to do the test steps independently. The test steps are:
submission to hyp3-api
submission to hyp3-test-api
wait for both submissions to finish
download products from hyp3-api
download products from hyp3-test-api
compare each product
Providing a hyp3_testing package with the helper functions instead as a pytest.fixture would allow some of these steps to be performed independently, but would require packaging hyp3_testing
This provides a system test to compare a set of RTC jobs submitted to both
hyp3-test-apiandhyp3-api, usinghyp3-apias the "gold standard".Note: gold terminology is used by gdalcompare and so we're following that terminology. In other science communities "baseline" would be used in place of "golden", or more appropriately (b/c mathematicians), "reference" would be used.
There are six jobs that exercise the different RTC customization options in combination with each other
Limitations This is one bit
pytesttest, so there is no way provided to do the test steps independently. The test steps are:hyp3-apihyp3-test-apihyp3-apihyp3-test-apiProviding a
hyp3_testingpackage with the helper functions instead as apytest.fixturewould allow some of these steps to be performed independently, but would require packaginghyp3_testing