search

opengeospatial / teamengine

TEAM Engine (Test, Evaluation, And Measurement Engine) is an engine for testing web services and other resources written in JAVA. It executes test scripts written in Compliance Test Language (CTL), TestNG and other languages. It is lightweight and easy to run as a command line or to setup as a service. It can be used to test any type of service or encoding. It is also the official tool used by the Open Geospatial Consortium (OGC) for compliance testing.
Apache License 2.0
45 stars 41 forks source link

Create best practice documentation for failures caused by nested CTL tests #560

Closed dstenger closed 1 year ago

dstenger commented 1 year ago

Is your feature request related to a problem? Please describe. Problem is described in https://github.com/opengeospatial/ets-wcs20/issues/113.

Describe the solution you'd like Unit tests shall reflect the problem described in https://github.com/opengeospatial/ets-wcs20/issues/113. Optionally, a new issue for a fix is created.

bpross-52n commented 1 year ago

The observed behavior is caused by a grouping of multiple tests in one test which also contains assertions. If this is the case, the assertions are not displayed correctly. It was discussed to create additional documentation on how to design tests in a way that the assertions and reasons of failures are displayed correctly.

dstenger commented 1 year ago

Documentation shall be updated in file https://github.com/opengeospatial/teamengine/blob/master/src/site/markdown/ctl.md.