Test get-kvp-core-req41 is failing on Beta environment

[dstenger]

Describe the bug Test get-kvp-core-req41 is failing on Beta environment. No error message is printed and all sub-tests are passing.

This failure is not occurring on Production environment although on both environments test suite version 1.17 is running.

So, the failure might be related to the update of the TEAM Engine version (5.5.2) on Beta.

To Reproduce Steps to reproduce the behavior:

1. Go to https://cite.ogc.org/te2/.
2. Execute WFS 2.0 test suite with endpoint http://ows.eox.at/cite/mapserver?service=WCS&version=2.0.1&request=GetCapabilities.
3. View result of test get-kvp-core-req41.

Expected behavior It is expected that get-kvp-core-req41 is passing on Beta environment as well (or at least an error message shall be printed).

[bpross-52n]

This is what I found out: Actually, the test should also fail on production. At least one of the subtests fails. This request for example should return an exception containing 'InvalidAxisLabel', which it does not. So it is an inheritance issue. The behavior of the current beta is at least more correct, imho. The problem is, that each subtest calls another test first (see here, and here) checking for the correct status code. This test passes and the following checks for the exception text (see here) are somehow not taken into account. One quick solution would be to put both checks (statuscode and exception text) in one test. But we should probably have another look at the inheritance, especially with nested tests.

[dstenger]

Next steps:

• Create unit tests in TEAM Engine to reproduce the failure.
• Fix the problem either in TEAM Engine or by refactoring the test suite.

[dstenger]

An issue was created for TEAM Engine: https://github.com/opengeospatial/teamengine/issues/560