CS-SI / eodag

Earth Observation Data Access Gateway
https://eodag.readthedocs.io
Apache License 2.0
327 stars 45 forks source link

Update wekeo configuration following API changes #1371

Closed amarandon closed 1 day ago

amarandon commented 4 weeks ago

Another problem with FIRE_HISTORICAL via wekeo_ecmwf:

{"status_code":500,"title":"Search Product","detail":"Required param data_format missing"}

Wekeo's AI assistant is telling me this:

ECMWF datasets have recently transitioned to new platforms, which include changes like replacing the 'format' parameter with 'data_format'.

I tried setting the parameter when doing the search:

search_result = dag.search(
    start="2016-03-01T00:00:00Z", end="2016-04-02T00:00:00Z",
    provider="wekeo_ecmwf", productType="FIRE_HISTORICAL",
    data_format="netcdf",
)

But it's not included in the query params:

2024-10-24 16:50:13,072 eodag.search.qssearch            [DEBUG   ] Query parameters:
{'dataset_id': 'EO:ECMWF:DAT:CEMS_FIRE_HISTORICAL_V1', 'year': ['2016'], 'month': ['03'], 'day': ['01'],
'product_type': 'reanalysis', 'variable': ['fire_danger_index'], 'system_version': ['4_1'], 'format': ['grib'],
'grid': 'original_grid', 'dataset_type': 'consolidated_dataset', 'itemsPerPage': 20, 'startIndex': 0}

I also tried updating the configuration of the product FIRE_HISTORICAL for the provider wekeo_ecmwf like this:

    FIRE_HISTORICAL:
      productType: EO:ECMWF:DAT:CEMS_FIRE_HISTORICAL_V1
      providerProductType: reanalysis
      variable:
        - fire_danger_index
      version:
        - "4_1"
      data_format:
        - "grib"
        - "netcdf"
      # format:
      #   - "grib"

But data_format is not included in the request (note that in this case format is also removed):

2024-10-24 16:38:11,210 eodag.search.qssearch            [DEBUG   ] Query parameters:
{'dataset_id': 'EO:ECMWF:DAT:CEMS_FIRE_HISTORICAL_V1', 'year': ['2016'], 'month': ['03'], 'day': ['01'],
'product_type': 'reanalysis', 'variable': ['fire_danger_index'], 'system_version': ['4_1'], 'grid': 'original_grid',
'dataset_type': 'consolidated_dataset', 'itemsPerPage': 20, 'startIndex': 0}

Additional info from @jlahovnik :

If the parameter name has changed you have to update the metadata mapping of the provider: image If you update this mapping to '{{"data_format": ...}}, you don't have to update all the default values of the product types.