earthobservations / gribmagic

Generic weather forecast downloader
https://community.panodata.org/t/developing-gribmagic/233
MIT License
21 stars 2 forks source link

[unity] DWD ICON: Data for specific fields is published on multiple levels #3

Open amotl opened 3 years ago

amotl commented 3 years ago

Hi again,

while looking at #2, we found that the folders hosting parameters for temperature [1,2] and wind [3,4] not only contain model-level data, but also pressure-level data. So, we will probably have to improve model_variables_levels_mapping.yml and the respective downstream infrastructure to accept a list of labels on the right hand side of the mapping.

With kind regards, Andreas.

[1] https://opendata.dwd.de/weather/nwp/icon/grib/00/t/ [2] https://opendata.dwd.de/weather/nwp/icon-eu/grib/00/t/ [3] https://opendata.dwd.de/weather/nwp/icon/grib/00/u/ [4] https://opendata.dwd.de/weather/nwp/icon-eu/grib/00/u/

mhaberler commented 3 years ago

I played with this dwd downloader (that's where the mappings happen) and extended it like so:

   {
        "model": "icon-d2",
        "scope": "germany",
        "intervalHours": 12,
        "grids": ["icosahedral", "regular-lat-lon"],
        "pattern": {
          "single-level":
          "https://opendata.dwd.de/weather/nwp/{model!L}/grib/{modelrun:>02d}/{param!L}/{model!L}_{scope}_{grid}_{levtype}_{timestamp:%Y%m%d}{modelrun:>02d}_{step:>03d}_2d_{param!L}.grib2.bz2",
          "model-level":
          "https://opendata.dwd.de/weather/nwp/{model!L}/grib/{modelrun:>02d}/{param!L}/{model!L}_{scope}_{grid}_{levtype}_{timestamp:%Y%m%d}{modelrun:>02d}_{step:>03d}_{level:>d}_{param!L}.grib2.bz2",
          "time-invariant":
          "https://opendata.dwd.de/weather/nwp/{model!L}/grib/{modelrun:>02d}/{param!L}/{model!L}_{scope}_{grid}_{levtype}_{timestamp:%Y%m%d}{modelrun:>02d}_{step:>03d}_{level:>d}_{param!L}.grib2.bz2"
         },
         "minlevel": 1,
         "maxlevel": 65,
         "destpattern": "{model!L}/grib/{modelrun:>02d}/{param!L}",
        "openDataDeliveryOffsetMinutes": 90
    },

I do not have that repo online yet NB I did not care about pressure-level data