RACE SMOS integration Via xcube Viewer

[AlessandroScremin]

Need to ivnestigate how to llink visaulisations via DASHBOARD and the xcube viewer.

Since there a more and more data processed by Brockman as ZARR into the xcube viewer we should avoid replication of effort and storage.

The main scope is to investigate if there are APIs to use xcube viewer functionalities (visualisation and analytics) via the Dashboard.

[Schpidi]

@gunbra32 could you please comment on this as agreed in our EDC call earlier today? thanks

[gunbra32]

There are generally two possible ways to integrate data provided by xcube viewer+server into the dashboard.

i) either integrate the entrie viewer ii) use one of xcube server's APIs. Find a self-description here: https://edc-api.brockmann-consult.de/api/openapi.html

( a third, rather mid-term option would be to implement a new plugin to the server if needed and then revert to ii)

Regarding SMOS data, we about to pass the SRR but have not created a large SMOS cube to be integrated. We could, however, do so upon request.

[santilland]

Hello @gunbra32 in principle i think the use of the xcube api is very similar to the one VEDA uses and if there are no surprises it should be possible to directly integrate, as i commented here https://github.com/eurodatacube/eodash/issues/2202#issuecomment-1587093142 The main potential issues i see are:

• what kind of authentication is expected for this endpoint
• i have no way of actually testing the endpoint as it is configured to point to localhost:8080 so none of the requests work

[gunbra32]

hi @santilland,

indeed, you found a bug in the openapi webpage of xcube server. You may, however, paste the url directly in the browser. No authentication is required.

[santilland]

Hello @gunbra32 i was trying the stac endpoint which seems to not exist, i managed to access the WMTS get capabilities though. Could you shortly list which endpoints we should expect to work?

[lubojr]

APIs that the xcube viewer uses should be ok to integrate although not implemented yet on eodash side: https://edc-api.brockmann-consult.de/api/viewer/

Analytics: example POST request https://edc-api.brockmann-consult.de/api/timeseries/bc~ws-s2-l2-Hamburg-20m-v3.zarr/Chlorophyll?aggMethods=mean%2Cstd&startDate=2020-08-14T10%3A15%3A59Z&endDate=2021-07-06T10%3A36%3A29Z

Tiles GET: https://edc-api.brockmann-consult.de/api/tiles/bc~ws-s2-l2-Hamburg-20m-v3.zarr/Chlorophyll/13/2648/4325?crs=EPSG%3A3857&vmin=0&vmax=40&cbar=chl_DeM2&time=2023-04-19T10%3A26%3A01Z

@aapopescu The question is which datasets should we add?

For example Dataset: Earth System Data Cube -> Variable Surface Soil Moisture analytics work fine, but viewer does show transparent tiles.

We would need to get the individual times from the https://edc-api.brockmann-consult.de/api/catalog/collections/datacubes/items - but in eodash reference generation, we can not yet parse datacube extension of STAC - cc @santilland

[lubojr]

Integration of any xcube-server in dashboards is now very easy and integrates both the server tiles api (with vmin, vmax and colorscale selection) and the analytics api as well.

@aapopescu Should we therefore integrate the Surface Soil Moisture from https://edc-api.brockmann-consult.de/ ?

[santilland]

Brockmann should have a dedicated service for this (now or soon) - waiting for inputs on this

[aapopescu]

Service is available @santilland

[lubojr]

@aapopescu Which endpoint URL is hosting the service?

[aapopescu]

this is an Insights on demand service from EDC, provided by Brockmann. @AlessandroScremin can you please help to create a NoR sponsoring request (cc: @gunbra32)?

[FedericoRondoni]

Dear @aapopescu and @gunbra32 I'm following up on this issue (I have just checked the conversation above). Could you please clarify what data we need for this request (SMOS product type, date range, area of interest, etc.)? Also (@gunbra32), what service do we have to request via the NoR pricewizard? Kind regards, Federico

[aapopescu]

follow-up via email with Brockmann for the NoR service definition

[gunbra32]

@aapopescu Which endpoint URL is hosting the service?

We generated two cubes for 2023, one for Ocean Salinity and one for Soil Moisture. Both are available at the public endpoint here for testing: https://api.earthsystemdatalab.net/api/

Note that we will change the chunking and generate a levelled version for performance in the coming days. I will post an update here.

[santilland]

@gunbra32 any update on the re-generation?

[AliceBalfanz]

@santilland The datasets are now available:

https://api.earthsystemdatalab.net/api/ogc/collections/datacubes/items/smos-sm https://api.earthsystemdatalab.net/api/ogc/collections/datacubes/items/smos-os