opengeospatial / ets-wfs20

Executable Test Suite for WFS 2.0
Other
8 stars 11 forks source link

Different results between official, beta and IDE on version 1.40 #264

Closed ihsanyapicioglu closed 6 months ago

ihsanyapicioglu commented 7 months ago

Describe the bug When the WFS 2.0 implementation is being tested against the version 1.40, there are 6 failures in official website (https://cite.opengeospatial.org/teamengine/). All failures are NPE.

On the beta website (https://cite.opengeospatial.org/te2) and in the code downloaded through the github and installed in the IDE and tests are passed without any failure.

All three platforms have the same version 1.40. Our suspicion is that the version running on the https://cite.opengeospatial.org/teamengine/ is somehow modified.

Here is our getCapabilities url to test;

http://wfst.axl.aero/AxlRest/wfs?service=WFS&version=2.0.0&request=GetCapabilities

To Reproduce Steps to reproduce the behavior:

  1. Go to the official webpage of team engine : https://cite.opengeospatial.org/teamengine/
  2. Select the WFS test version 1.40 and perform the test by using the url : http://wfst.axl.aero/AxlRest/wfs?service=WFS&version=2.0.0&request=GetCapabilities

Expected behavior Successful test results in the official page as well as these results are already successful the other platforms (beta and IDE)

Additional context You could find 3 different result files after performing on each places results.zip

dstenger commented 7 months ago

Thank you for reporting. I was able to reproduce the behavior and agree with your findings. 6 tests of Transactional WFS conformance class fail with a NullPointerException on Production which does not occur on Beta. We will do further investigations.

dstenger commented 7 months ago

I transfer this issue to ets-wfs20 issue tracker as the problem is related to the test suite itself.

ihsanyapicioglu commented 7 months ago

Hi, Thank you for the update

dstenger commented 6 months ago

@ihsanyapicioglu The problem should be solved. Can you please re-test your service and confirm if it works for you?

ihsanyapicioglu commented 6 months ago

@dstenger Just re-tested and it works fine. Thank you for the update