opengeospatial / ets-wms13

Repository for the Exectutable Test Suite for WMS 1.3.0
Apache License 2.0
2 stars 4 forks source link

WMS 1.3.0 interactive tests are failing on the online TEAM Engine platform #103

Open pblottiere opened 1 year ago

pblottiere commented 1 year ago

Hello,

QGIS Server is certified for WMS 1.3.0 for several years now and OGC tests are run in continuous integration with GitHub Action on a daily basis (for each PR actually).

Lastly we tried to renew the certification for the last LTR (QGIS Server 3.28) with the online TEAM Engine platform (http://cite.opengeospatial.org/teamengine/) but we're facing an issue with "basic" tests. Actually, all tests are green except for interactive tests:

During the test, it looks like QGIS Server is not returning the correct image because the image is not displayed on the HTML page:

screenshot

However, I tried to execute the corresponding WMS requests (retrieved from QGIS Sever logs) and everything looks good. For example:

Does the image above depict a large diamond that fills the frame?

http://138.201.120.72:8080/certification_qgisserver_3_28?&VERSION=1.3.0&REQUEST=GetMap&LAYERS=cite%3ABasicPolygons&STYLES=&CRS=CRS:84&BBOX=-1,-1,1,1&WIDTH=300&HEIGHT=300&FORMAT=image%2Fjpeg

image

Does the image above depict a map of the Blue Lake vicinity with a surrounding neatline?

http://138.201.120.72:8080/certification_qgisserver_3_28?&VERSION=1.3.0&REQUEST=GetMap&LAYERS=cite%3AStreams,cite%3ALakes,cite%3APonds,cite%3ABridges,cite%3ARoadSegments,cite%3ADividedRoutes,cite%3ABuildings,cite%3AMapNeatline&STYLES=&CRS=CRS:84&BBOX=-0.005,-0.0025,.005,0.0025&WIDTH=400&HEIGHT=200&FORMAT=image%2Fjpeg

image

Please can you give me some hints or let me know if I'm missing something?

Thanks a lot for your work and have a good day.

dstenger commented 1 year ago

Thank you for reporting.

This seems to be a display error. I just tested https://cite.ogc.org/teamengine/ with Firefox 112.0.1 (64-Bit) and Chromium Version 113.0.5672.63 and, in both cases, the images are displayed correctly.

Which Web Browser are you using to execute the tests (and which version)?

pblottiere commented 1 year ago

Hello @dstenger,

This seems to be a display error.

OK, good news for QGIS Server then :).

I just tested https://cite.ogc.org/teamengine/ with Firefox 112.0.1 (64-Bit) and Chromium Version 113.0.5672.63 and, in both cases, the images are displayed correctly.

Which Web Browser are you using to execute the tests (and which version)?

I'm on an up-to-date ArchLinux and I tested with Firefox and Chromium:

~> firefox --version
Mozilla Firefox 110.0
~> chromium --version
Chromium 110.0.5481.100 Arch Linux

Thank you for your answer.

pblottiere commented 1 year ago

I'm on an up-to-date ArchLinux and I tested with Firefox and Chromium:

Mmm actually no, the last version of Firefox is also 113.0 for ArchLinux. I'm going to upgrade my system and I let you know.

dstenger commented 1 year ago

The root cause of the problem seems that your service is using HTTP instead of HTTPS. The Web Browser rewrites the URL of your service to HTTPS which does not return a map. So, there is a problem when testing HTTP services with HTTPS TEAM Engine which must be tackled inside the code of the test suite.

@pblottiere However, there is a workaround you can use:

dstenger commented 1 year ago

Also, I migrated this issue to the ets-wms13 tracker because the fix will be created there.

dstenger commented 1 year ago

Proposal for fix inside test suite:

dstenger commented 1 year ago

@pblottiere I hope your problem is solved by using the above described workaround. If you have any further questions, please post them here.

pblottiere commented 1 year ago

Hello @dstenger,

Sorry for the delay, I was on vacation.

The root cause of the problem seems that your service is using HTTP instead of HTTPS. The Web Browser rewrites the URL of your service to HTTPS which does not return a map.

Oh ok! I always used an HTTP service for the formal certification with Teamengine, so I've never asked myself that question really... New policy of Web Browsers?

However, there is a workaround you can use:

  1. Press right mouse button over broken image.
  2. Select "Open image in new tab" (or similar).
  3. Image should be displayed correctly in new tab.

I just tried on Firefox but unfortunately, it doesn't work :

image

But I retrieved the corresponding URL by inspecting the web page, so I successfully complete the testsuite :tada:.

Thanks a lot for investigating @dstenger :+1: