search

opengeospatial / teamengine

TEAM Engine (Test, Evaluation, And Measurement Engine) is an engine for testing web services and other resources written in JAVA. It executes test scripts written in Compliance Test Language (CTL), TestNG and other languages. It is lightweight and easy to run as a command line or to setup as a service. It can be used to test any type of service or encoding. It is also the official tool used by the Open Geospatial Consortium (OGC) for compliance testing.
Apache License 2.0
45 stars 41 forks source link

Fix inheritance #474

Closed hwbllmnn closed 2 years ago

hwbllmnn commented 3 years ago

This fixes the inheritance of results with a values > 1. This currently doesn't work correctly in certain circumstances, e.g. when passing with warning (result 4) but the warning node is not the last test in the suite.

dstenger commented 2 years ago

@hwbllmnn Do you have a test service which is triggering your fix and can be used to verify the fix?

hwbllmnn commented 2 years ago

Hi @dstenger,

this happens for us when running the GDI-DE metadata tests against this dataset in the GDI-DE Testsuite here. We're using the unmodified latest release of the TEAM-Engine.

You can find the corresponding CTL scripts here. After unzipping, you'll find the corresponding CTL scripts in gdide-inspire-new/scripts folder and the corresponding resources in gdide-inspire-new/resources (you can ignore the gdide-inspire-new/lib folder, those are GDI-DE testsuite specific). Execute the suite gdide:gdide-metadata-new with the following params:

[file=/tmp/dataset15386518893462132224dataset, url=https://www.geodaten-mv.de/geomis/id/e304658a-cd0d-40b1-acfa-08ff76ab4fc1, GDI-DE_INSPIRE_konditional=true, GDI-DE_konditional=true, GDI-DE_INSPIRE_verpflichtend=true, ISO-Schemavalidierung=true]

(I'm unsure if you really need the file-Parameter, to be safe, just copy the URLs contents to the file)