opengeospatial / teamengine

TEAM Engine (Test, Evaluation, And Measurement Engine) is an engine for testing web services and other resources written in JAVA. It executes test scripts written in Compliance Test Language (CTL), TestNG and other languages. It is lightweight and easy to run as a command line or to setup as a service. It can be used to test any type of service or encoding. It is also the official tool used by the Open Geospatial Consortium (OGC) for compliance testing.
Apache License 2.0
45 stars 41 forks source link

Current TeamEngine is very lagging and not usable #505

Closed bangph closed 2 years ago

bangph commented 2 years ago

I've tried in both Firefox and Chrome browsers.

When it goes to this URL https://cite.opengeospatial.org/teamengine/test.jsp it opens an empty pop up windows and I've tried multiple times to click on "OK" button, but it doesn't run any tests like years ago when I just had to click one time only on the button.

Please see the image: image

bangph commented 2 years ago

@dstenger Please check this as I couldn't perform the test on TeamEngine https://cite.opengeospatial.org/teamengine/test.jsp

dstenger commented 2 years ago

Thank you for reporting. There is a known issue with Chrome web browser (please see https://github.com/opengeospatial/teamengine/issues/501). With Firefox I was just able to do a test run with your provided URL. However, the test report was empty which is probably not expected. Can you please also check if it is working on Beta environment? https://cite.ogc.org/te2/

bangph commented 2 years ago

@dstenger thanks for quick reply. I tested Beta on Firefox, it works fast. However, OGC WCS 2.0.1 test core has java exception. Please see full log at https://pastebin.com/nqK8BYL7

dstenger commented 2 years ago

Thanks for reporting back. Can you please describe the error more in detail? Is the StackTrace printed in the test result or is it displayed instead of a test result?

bangph commented 2 years ago

@dstenger After the session finished quickly, it has this repport image

then, I clicked on See the detailed old test report.. It opens a new tab on Firefox with the stack trace.

dstenger commented 2 years ago

Thank you for the detailed feedback. The problem seems to be connected to the one documented in https://github.com/opengeospatial/teamengine/issues/499.

This problem, however, just occurs on Beta (te2). Can you please re-check if a test run on Production is possible? I am able to view the detailed old test report there when using the service provided by you. I used Firefox 97.0.1 (64-Bit) for testing. So, I am still not able to reproduce the error documented in the description of this issue (please note that there is a problem with Chrome).

bangph commented 2 years ago

@dstenger I tested again on the official CITE test with Firefox 97.0.1 (64 bit), this time, it runs fast.

The log error is not useful though for me to understand why and what caused it failed.

` Log for test s0137

Test wcs2:main type Mandatory default result Passed (s0137)

Assertion: Prune query parameters if present.

Request d13242e33_1: Method: get URL: http://conformance.rasdaman.com/rasdaman/ows Error in call to extension function {public org.w3c.dom.NodeList com.occamlab.te.TECore.request(org.w3c.dom.Document,java.lang.String) throws java.lang.Throwable}: Exception in extension function java.lang.RuntimeException: Parser {http://www.occamlab.com/te/parsers}XMLValidatingParser threw an exception. Result: Failed

image

I clicked on: Test wcs2:main (View Details): Failed

`

Anyway, what I wanted for this ticket is OGC CITE can be run fast, so I can check what is wrong on my endpoint.