search

ACCESS-NRI / ESMValTool-workflow

2 stars 1 forks source link

Download CDS-UERRA #15

Open rbeucher opened 1 year ago

rbeucher commented 1 year ago

Source: https://cds.climate.copernicus.eu/cdsapp#!/dataset/reanalysis-uerra-europe-soil-levels

svenbuder commented 1 year ago

@rbeucher GRIB or NetCDF?

svenbuder commented 1 year ago

I had to split the download into the 4 different hour windows because of the maximum file number limit. I have started to queue downloads for NetCDF format: 1) via their html form for 00:00 (in progress since 40+ minutes now) 2) via the cdsapi client on cadi) into /g/data/kj13/datasets/UERRA-HARMONIE (queued until 1 is done). The downloads are not very well documented. I have the impression each download will produce a *.nc file. Will update once I make progress

rbeucher commented 1 year ago

Netcdf definitely

svenbuder commented 1 year ago

Downloading timed out. Trying to download annual data now via copyq and API.

rbeucher commented 1 year ago

Argh. Many issues with the downloads. Let's have a look this week. I was hoping to have all the data by the 1st of July...

Get Outlook for Androidhttps://aka.ms/AAb9ysg

From: Sven Buder @.> Sent: Tuesday, June 27, 2023 10:09:23 AM To: ACCESS-NRI/ESMValTool-workflow @.> Cc: Romain Beucher @.>; Mention @.> Subject: Re: [ACCESS-NRI/ESMValTool-workflow] Download CDS-UERRA (Issue #15)

Downloading timed out. Trying to download annual data now via copyq and API.

— Reply to this email directly, view it on GitHubhttps://github.com/ACCESS-NRI/ESMValTool-workflow/issues/15#issuecomment-1608499102, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AA4CVFUENK3W4GEYFMYSDPLXNIQDHANCNFSM6AAAAAAZCURW5M. You are receiving this because you were mentioned.Message ID: @.***>

svenbuder commented 1 year ago

Got it working if I do it on an annual basis (needs 22min to compile the download request and then download 6ish GB of data). Started to put that into copyq PBS jobs.

rbeucher commented 1 year ago

[like] Romain Beucher reacted to your message:

From: Sven Buder @.> Sent: Tuesday, June 27, 2023 5:11:10 AM To: ACCESS-NRI/ESMValTool-workflow @.> Cc: Romain Beucher @.>; Mention @.> Subject: Re: [ACCESS-NRI/ESMValTool-workflow] Download CDS-UERRA (Issue #15)

Got it working if I do it on an annual basis (needs 22min to compile the download request and then download 6ish GB of data). Started to put that into copyq PBS jobs.

— Reply to this email directly, view it on GitHubhttps://github.com/ACCESS-NRI/ESMValTool-workflow/issues/15#issuecomment-1608809306, or unsubscribehttps://github.com/notifications/unsubscribe-auth/AA4CVFVLMFW4KYSKXEFU3MDXNJTO5ANCNFSM6AAAAAAZCURW5M. You are receiving this because you were mentioned.Message ID: @.***>

rbeucher commented 1 year ago

only used in recipe_check_obs so assigning low-priority

rbeucher commented 6 days ago

This issue is stale because it has been open 30 days with no activity. Remove stale label or comment or this will be closed in 5 days.