Create WEKEO DIAS drivers

[sbrunato]

Original report by Oyono (Bitbucket: aoyono, GitHub: aoyono).

---

https://www.wekeo.eu/

[sbrunato]

Original changes by Oyono (Bitbucket: aoyono, GitHub: aoyono).

---

set version to "0.7.0"; set milestone to "0.7.0"

[sbrunato]

Original changes by Oyono (Bitbucket: aoyono, GitHub: aoyono).

---

changed state from "new" to "resolved"

[sbrunato]

Update CSW plugin (see if #94 is needed) and finalize wekeo provider integration

[maximlt]

Currently, search with wekeo is implemented with the CSW search plugin.

Some research has shown that:

• The CSW endpoint offered by wekeo only allows to get access to the collections metadata, not to the products themselves. This request, for instance, shows that wekeo offers 232 collections.
• wekeo offers now a REST Api called Harmonised Data Access API. It has an open-source client hda developed by the ECMWF.
• Some scripts and notebooks, available online, show how to use the HDA API (here and here) The functions used in the 2nd notebook can be found in wekeo's Jupyter Hub (Sign in -> Dashboard -> JupyterHub)
• The package eo_harvest uses the HDA API of wekeo to search and download products
• wekeo requires a token to access to its HDA API, once generated it is valid for 1 hour only.

Wekeo's search plugin won't rely on the CSW plugin anymore (which will still stay around), it will instead rely on the HDA API.

[sbrunato]

By the use of HDA API , in particular the querymetadata, you can see the list of parameters to use for product request. After that no metadata on a product instance is given due to the fact that this interface has for objective to standardize the request and some metadata are not available on all products (ie. CMEMS or Land)

For example, the only metada available for a given S1_SAR_GRD product is:

 {
      "downloadUri": null,
      "filename": "S1B_IW_RAW__0SDV_20200110T174650_20200110T174723_019758_0255B5_F9FC.SAFE",
      "order": null,
      "productInfo": {
        "datasetId": "EO:ESA:DAT:SENTINEL-1:SAR",
        "product": "S1B_IW_RAW__0SDV_20200110T174650_20200110T174723_019758_0255B5_F9FC.SAFE",
        "productEndDate": "2020-01-10T17:47:23.200000Z",
        "productStartDate": "2020-01-10T17:46:50.800000Z"
      },
      "size": 1672255055,
      "url": "040ff724-6884-5366-ac68-eb96a78d2c4f/S1B_IW_RAW__0SDV_20200110T174650_20200110T174723_019758_0255B5_F9FC.SAFE"
    },

Some other examples, tried using both https://github.com/ecmwf/hda and https://wekeo-broker.apps.mercator.dpi.wekeo.eu/databroker/ui/ (same result):

{'downloadUri': None,
 'filename': 'S3B_SR_1_SRA_A__20200703T140134_20200703T145203_20200729T051430_3029_040_352______MAR_O_NT_004',
 'order': None,
 'productInfo': {'datasetId': 'EO:EUM:DAT:SENTINEL-3:SR_1_SRA___',
  'product': 'S3B_SR_1_SRA_A__20200703T140134_20200703T145203_20200729T051430_3029_040_352______MAR_O_NT_004',
  'productEndDate': '2020-07-03T14:52:03.163000Z',
  'productStartDate': '2020-07-03T14:01:33.595000Z'},
 'size': 2469606195,
 'url': '5f9a904e-f130-43a1-9958-ecb1d7774701/S3B_SR_1_SRA_A__20200703T140134_20200703T145203_20200729T051430_3029_040_352______MAR_O_NT_004'}

{'downloadUri': None,
 'filename': 'c_gls_LAI300-RT0_202104200000_GLOBE_OLCI_V1.1.1.nc',
 'order': None,
 'productInfo': {'datasetId': 'EO:CLMS:DAT:CGLS_GLOBAL_LAI300_V1_333M',
  'product': 'c_gls_LAI300-RT0_202104200000_GLOBE_OLCI_V1.1.1.nc',
  'productEndDate': '2021-04-20T00:00:00Z',
  'productStartDate': '2021-04-20T00:00:00Z'},
 'size': 1267728384,
 'url': 'Vegetation/Properties/LAI_300m_V1/2021/04/20/LAI300-RT0_202104200000_GLOBE_OLCI_V1.1.1/c_gls_LAI300-RT0_202104200000_GLOBE_OLCI_V1.1.1.nc'}