alexander-petkov / wfas

A placeholder for the WFAS project.
5 stars 1 forks source link

ICON Forecast data #44

Open alexander-petkov opened 3 years ago

alexander-petkov commented 3 years ago

Add ICON forecast model data to Geoserver Source: https://www.dwd.de/EN/ourservices/nwp_forecast_data/nwp_forecast_data.html

We need the global icon data, from this link: https://opendata.dwd.de/weather/nwp/icon/

alexander-petkov commented 3 years ago

Trasnforming data

To transform the data from the original triangular grid to lat/lon coordinate based grid (0.125x0.125), follow the instructions in Sec 2.4: https://www.dwd.de/DE/leistungen/opendata/help/modelle/Opendata_cdo_EN.pdf?__blob=publicationFile&v=3

1. Download necessary files (we chose 0.125 deg resolution) https://opendata.dwd.de/weather/lib/cdo/ICON_GLOBAL2WORLD_0125_EASY.tar.bz2 https://opendata.dwd.de/weather/lib/cdo/icon_grid_0026_R03B07_G.nc.bz2

  1. After extracting the downloaded archives, transform data with cdo:
    cdo -f grb2 remap,${TARGET_GRID_DESCRIPTION},${WEIGHTS_FILE} ${input_file} ${output_file}

    NOTE: The GLOBAL2WORLD archive contains the weight nc file, and is not necessary to generate it as described in the documentation. The output file is in lat/lon, in our case at 0.125x0.125 resolution.

Example of the transformation: Screenshot from 2021-09-17 20-12-33

alexander-petkov commented 3 years ago

Reference documentation: https://www.dwd.de/DWD/forschung/nwv/fepub/icon_database_main.pdf

alexander-petkov commented 3 years ago

Datasets:

  1. Temperature: t_2m Temperature at 2m above ground (K)
  2. Relative Humidity: relhum_2m Relative humidity at 2m above ground (%)
  3. Cloud cover: clc Cloud cover (%)
  4. Solar Radiation: ASWDIR_S Surface down solar direct radiation(average since model start) (Wm-2)
  5. Wind: u_10m Zonal wind at 10m above ground (m s−1) v_10m Meridional wind at 10m above ground (m s−1) Looks like Wind speed and direction are to be calculated.
  6. Total Precipitation: tot_prec Total precipitation (accumulated since model start) (kg/m-2)
wmjolly commented 3 years ago

Is Total Precipitation also included?

On Mon, Sep 20, 2021 at 12:08 PM alexander-petkov @.***> wrote:

Datasets:

  1. Temperature: t_2m Temperature at 2m above ground (K)
  2. Relative Humidity: relhum_2m Relative humidity at 2m above ground (%)
  3. Cloud cover: clc Cloud cover (%)
  4. Solar Radiation: ASWDIR_S Surface down solar direct radiation(average since model start) (Wm-2)
  5. Wind: u_10m Zonal wind at 10m above ground (m s−1) v_10m Meridional wind at 10m above ground (m s−1) Looks like Wind speed and direction are to be calculated.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/alexander-petkov/wfas/issues/44#issuecomment-923158297, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4G3D4C6ZHUJHAZ5XD2YEDUC52BXANCNFSM5EMKUDNQ .

alexander-petkov commented 3 years ago

Is Total Precipitation also included?

Thanks for catching this, I will amend the comment with the variables. TOT_PREC4 Total precipitation (accumulated since model start)

wmjolly commented 3 years ago

Can we make sure Precipitation is calculated per forecast period and not as an accumulation? It's so much easier to use that way. I think you had to do the same thing for GFS.

On Tue, Sep 21, 2021 at 11:37 AM alexander-petkov @.***> wrote:

Is Total Precipitation also included? Thanks for catching this, I will amend the comment with the variables. TOT_PREC4 Total precipitation (accumulated since model start)

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/alexander-petkov/wfas/issues/44#issuecomment-924209003, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4G3D22JAVT2JBL6QP7HGDUDC7EBANCNFSM5EMKUDNQ .

alexander-petkov commented 3 years ago

Can we make sure Precipitation is calculated per forecast period and not as an accumulation? It's so much easier to use that way. I think you had to do the same thing for GFS.

Yes, we will have to derive hourly or 3-hour accumulation.

wmjolly commented 3 years ago

Hourly accumulated would be ideal

On Tue, Sep 21, 2021, 17:28 alexander-petkov @.***> wrote:

Can we make sure Precipitation is calculated per forecast period and not as an accumulation? It's so much easier to use that way. I think you had to do the same thing for GFS.

Yes, we will have to derive hourly or 3-hour accumulation.

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/alexander-petkov/wfas/issues/44#issuecomment-924461282, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4G3D5H7SEW4QPD5OS54QLUDEIJPANCNFSM5EMKUDNQ .

alexander-petkov commented 3 years ago

ICON datasets are configured, now I just have to test the update. Also to check the units. Screenshot from 2021-09-23 20-50-41

wmjolly commented 3 years ago

So awesome! Thanks

On Thu, Sep 23, 2021, 20:52 alexander-petkov @.***> wrote:

ICON datasets are configured, now I just have to test the update. Also to check the units. [image: Screenshot from 2021-09-23 20-50-41] https://user-images.githubusercontent.com/39599557/134610952-8ed0a66c-d53a-498c-a6c8-8e3693d6373e.png

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/alexander-petkov/wfas/issues/44#issuecomment-926302705, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4G3DYOIUF5AI4MPLWVCIDUDPRWZANCNFSM5EMKUDNQ .