search

geosolutions-it / MapStore2

The solution to create and share maps, dashboards, geostories with 3D support on the web. And it is open-source too!
https://mapstore.geosolutionsgroup.com/
Other
508 stars 394 forks source link

ArcGIS Interoperability #10040

Closed tdipisa closed 4 months ago

tdipisa commented 7 months ago

Description

It is requested to improve on the interoperability to support better ArcGIS services in MapStore. This issue involves two main activities for which the following task is in common:

subtasks

Support of tokens for private layers - MapStore token support

ArcGIS WMS Server interoperability for GetFeatureInfo requests

Thanks to https://github.com/geosolutions-it/MapStore2/pull/9048, the serverType property has been recently added in MapStore to define which type of server is providing the WMS service. It should be possible to use this option to exclude the exceptions parameter not supported in an ArcGIS WMS service. During the development phase it is requested to evaluate if it is necessary an additional serverType or the NO_VENDOR type used also by other services is enough. Possibly also hide some functionalities not supported by WMS endpoint that does not support GetFeatureInfo application/json responses with geometry, to do so it is necessary also to store the information related to the list of supported get feature info responses.

Some notes about findings from the preliminary investigation:

Involved sub tasks are: subtasks

Review WMS get feature info request based on server type Hide the highlight feature icon of get feature info plugin if GeoJSON response is not supported. This include work related to the storing of additional information in the layer config or alternative strategy

ArcGIS MapServer Catalog and Layer support

The work for this task focus on the support of ArcGIS MapServer endpoints inside MapStore. The task should include following improvement inside MapStore:

Some notes about findings from the preliminary investigation:

Involved sub tasks are: subtasks

Support of ArcGIS MapServer endpoint in MapStore: catalog, layer visualization, get feature info and base layer settings

Acceptance criteria

Other useful information

Here a branch where a base implementation sa been tested during the preliminary evaluation of this work. That should be completely refactored to be accepted in MapStore, take this just as a prototype.

Igi-ID commented 5 months ago

These two public services have been used during development of the arcgis support so far:

More specifically:

These can also be used for easier testing when development is concluded.

Igi-ID commented 5 months ago

The current state of development is the following (updating this post as progress is made):

subtasks Support of tokens for private layers - MapStore token support

  1. WMS interoperability and GFI support

subtasks Review WMS get feature info request based on server type Hide the highlight feature icon of get feature info plugin if GeoJSON response is not supported. This include work related to the storing of additional information in the layer config or alternative strategy

  1. ArcGIS MapServer Catalog and Layer support

subtasks Support of ArcGIS MapServer endpoint in MapStore: catalog, layer visualization, get feature info and base layer settings

Specific issues:

allyoucanmap commented 5 months ago

@tdipisa @Igi-ID Some feedback:

Cesium layer visualization is not availble Leaflet layer visualization is not available

just pushed some initial code to support arcgis mapserver layer on Cesium and Leaflet see https://github.com/geosolutions-it/MapStore2/commit/92eadf0b2e68c4b4d61e163d99eb1a93591dd58a on dev_10040 so please push the code locally. The Leaflet implementation is not currently supporting tiling but for the moment we could skip this but we should ensure the Cesium implementation is working properly.

Catalog search tool (which filters available records) not implemented yet.

If the mapserver does not support pagination we should use a similar approach to the WMS one where we simulate the pagination and filter client side

raster sets with an empty layers property are not currently handled (due to data structure, at the base in fetchData). These are usually background images, orthophotos and the like.

Do you have an url example? Probably this case need to use a sort of TMS approach, looking at the Cesium code it is possible to request cached tiles stored in the tileInfo property. We should verify if it's the case.

the format of the identify feature is not handled (currently hardcoded), meaning you cannot change the format from the global settings, nor layer settings (menu unavailable).

I think it's fine for the moment to prevent the selection of the identify but I would like to understand where it has been hardcoded, could you please share the hardcoded part?

identify feature intersects tile with geometry (bbox?) rather than feature geometry with point. As a consequence, you can click even outside geometries, but inside the bounding box of a tile and get a successful request, highlighting all geometries within that tile. Metadata is aggregated in the identify panel.

Did you try to use a point geometry without reconstruct a small bbox based on scale level?

I'm seeing this implementation with an implementation similar to WMS but probably it's not needed

image

maybe we could use lat and long from center property and use the supported geometry point available in MapServer query

image

Identify feature may occasionally fail by not registering the layer at all, especially in the case of spatially overlapping layers.

Could you provide steps to reproduce this?

Updating OL layers is not handled to its full extent and there is currently a critical failure related to reprojection.

Could you double check if this has been solved with my new commit?

I think this is not needed because we are not rendering features client side, the source is based on image tiles and not vector image

Bounding box as well as few other relevant information points are not part of the layer object.

I think it's missing an additionl request to the layer id endpoint to get layer metadata, we can place this request in the addLayerAndDescribeEpic. This action is triggered when the layer is added from catalog so we can add an if statement for arcgis with the request to layer.url/layer.name. This endpoint should contain all the needed info for bounding box and probably also if the layer is queryable or not, at the moment we expect at minimum the following information for the layer:

{
    type: 'arcgis',
    url: '/rest/MapServer',
    name: '0',
    visibility: true,
    opacity: 1,
    bbox: { ... }
}

Note: please does not pass the id of the layer so mapstore is able to create a uuid

Zoom to feature (identify panel) is not working.

Zoom to feature is not working because is missing the bbox property in the layer options

Add layer feature in layer properties panel is not working.

Could you explain this issue with replicable steps?

Igi-ID commented 5 months ago

I'll update this post when some answers are better formed.

@tdipisa @Igi-ID Some feedback:

Cesium layer visualization is not availble Leaflet layer visualization is not available

just pushed some initial code to support arcgis mapserver layer on Cesium and Leaflet see 92eadf0 on dev_10040 so please push the code locally. The Leaflet implementation is not currently supporting tiling but for the moment we could skip this but we should ensure the Cesium implementation is working properly.

Catalog search tool (which filters available records) not implemented yet.

If the mapserver does not support pagination we should use a similar approach to the WMS one where we simulate the pagination and filter client side

Noted on both points above. Thank you for bringing up server side pagination, I'll re-check that and proceed accordingly.

raster sets with an empty layers property are not currently handled (due to data structure, at the base in fetchData). These are usually background images, orthophotos and the like.

Do you have an url example? Probably this case need to use a sort of TMS approach, looking at the Cesium code it is possible to request cached tiles stored in the tileInfo property. We should verify if it's the case.

http://www.pcn.minambiente.it/arcgis/rest/services/immagini/IGM_25000/MapServer

the format of the identify feature is not handled (currently hardcoded), meaning you cannot change the format from the global settings, nor layer settings (menu unavailable).

I think it's fine for the moment to prevent the selection of the identify but I would like to understand where it has been hardcoded, could you please share the hardcoded part?

https://github.com/geosolutions-it/MapStore2/blob/92eadf0b2e68c4b4d61e163d99eb1a93591dd58a/web/client/utils/mapinfo/arcgis.js#L54

identify feature intersects tile with geometry (bbox?) rather than feature geometry with point. As a consequence, you can click even outside geometries, but inside the bounding box of a tile and get a successful request, highlighting all geometries within that tile. Metadata is aggregated in the identify panel.

Did you try to use a point geometry without reconstruct a small bbox based on scale level?

Good pointer, will retest

I'm seeing this implementation with an implementation similar to WMS but probably it's not needed

image

maybe we could use lat and long from center property and use the supported geometry point available in MapServer query

image

Identify feature may occasionally fail by not registering the layer at all, especially in the case of spatially overlapping layers.

Could you provide steps to reproduce this?

My report on the issue is incomplete and badly phrased. It's essentially this reported bug: https://github.com/geosolutions-it/MapStore2/issues/10227

namely, when we put layers into a group and select the group in the panel, GFI will resolve with 'No active queryable layer'.

Updating OL layers is not handled to its full extent and there is currently a critical failure related to reprojection.

Could you double check if this has been solved with my new commit?

Solved indeed.

I think this is not needed because we are not rendering features client side, the source is based on image tiles and not vector image

Bounding box as well as few other relevant information points are not part of the layer object.

I think it's missing an additionl request to the layer id endpoint to get layer metadata, we can place this request in the addLayerAndDescribeEpic. This action is triggered when the layer is added from catalog so we can add an if statement for arcgis with the request to layer.url/layer.name. This endpoint should contain all the needed info for bounding box and probably also if the layer is queryable or not, at the moment we expect at minimum the following information for the layer:

{
    type: 'arcgis',
    url: '/rest/MapServer',
    name: '0',
    visibility: true,
    opacity: 1,
    bbox: { ... }
}

Note: please does not pass the id of the layer so mapstore is able to create a uuid

Great pointer, making the adjustments.

Zoom to feature (identify panel) is not working.

Zoom to feature is not working because is missing the bbox property in the layer options

So related to the point above as expected, will retest when bbox is available

Add layer feature in layer properties panel is not working.

Could you explain this issue with replicable steps?

This is also a case of bad phrasing, the issue is related to the add layer to selected group action and the scenario is the following:

https://github.com/geosolutions-it/MapStore2/assets/90094775/a7207a6a-de05-445e-8d40-367dc13e6e7f

tdipisa commented 4 months ago

These two public services have been used during development of the arcgis support so far:

More specifically:

These can also be used for easier testing when development is concluded.

This also is another one available for testing: https://sampleserver6.arcgisonline.com/arcgis/rest/services