search

opengeospatial / teamengine

TEAM Engine (Test, Evaluation, And Measurement Engine) is an engine for testing web services and other resources written in JAVA. It executes test scripts written in Compliance Test Language (CTL), TestNG and other languages. It is lightweight and easy to run as a command line or to setup as a service. It can be used to test any type of service or encoding. It is also the official tool used by the Open Geospatial Consortium (OGC) for compliance testing.
Apache License 2.0
45 stars 41 forks source link

Failed test should always show the detailed requests with URLs to test server #586

Closed bangph closed 1 year ago

bangph commented 1 year ago

For example, I have a hard-time when testing WCS 2.0.1 with scaling extension (my test history log is https://cite.opengeospatial.org/teamengine/viewTestLog.jsp?test=s0175/d13242e89_1/d12054e200_1/d12054e2933_1). It failed with this test:

[Test wcs2:GetCoverage_exception](https://cite.opengeospatial.org/teamengine/listings/te_base_scripts_wcs_2.0.1_ctl_ext_get-int.html#wcs2:GetCoverage_exception)

But I don't know which request it sent to server and expected the Exception in the response ... Clicking on View Details link in the image below for wcs:GetCoverage_exception it shows to me a not useful message:

Log for test s0175/d13242e89_1/d12054e200_1/d12054e2933_1

Test wcs2:GetCoverage_exception type Mandatory default result Passed (s0175/d13242e89_1/d12054e200_1/d12054e2933_1)

Assertion: check getcoverage result.

Message d16803e342_1:
   [FAILURE] The result should contain an ows:Exception.

Result: Failed

image

It should show exactly which URLs the test used to send to my test server.

bangph commented 1 year ago

@dstenger please improve that for teamengine.

bangph commented 1 year ago

I've found that, I can download the logs of the session and I checked the content file at Log for test s0175/d13242e89_1/d12054e200_1/d12054e2933_1 to understand better why WCS 2.0.1 scaling extension failed for get-scal-req9-kvp. It needs to throw exception if there is duplicated scaling parameters. e.g.

/ows?SERVICE=WCS&VERSION=2.0.1&REQUEST=GetCoverage&CoverageId=test_mean_summer_airtemp&SCALESIZE=Lat(10)&SCALESIZE=Lat(10