search

BigDataWUR / AgML-CY-Bench

CY-Bench (Crop Yield Benchmark) is a comprehensive dataset and benchmark to forecast crop yields at subnational level. CY-Bench standardizes selection, processing and spatio-temporal harmonization of public subnational yield statistics with relevant predictors. Contributors include agronomers, climate scientists and machine learning researchers.
https://cybench.agml.org/
Other
18 stars 8 forks source link

AgERA5 download script #311

Open krsnapaudel opened 3 months ago

krsnapaudel commented 3 months ago

Download full rasters, without bounding boxes. This is to maintain an up-to-date repository that can produce data for new countries. After this the R script in #199 does not need a special case for AgERA5 paths. See #308.

The code is derived from @AbdelrahmanAmr3's earthstat.

AbdelrahmanAmr3 commented 3 months ago

Hi @krsnapaudel, Thank you for using my script. here is my review and some enhancements that make it clearer and easier to follow.

krsnapaudel commented 2 months ago

@AbdelrahmanAmr3: Please review again. Thanks.

krsnapaudel commented 3 days ago

@ellaampy Would you be willing to try this out and provide feedback or approve? Thanks.

ellaampy commented 1 day ago

@krsnapaudel the logic looks fine. I followed the instructions to create a token and tried to run for a single year. Got this error Recovering from connection error [HTTPSConnectionPool(host='cds.climate.copernicus.eu', port=443): Max retries exceeded with url: /api/catalogue/v1/messages (Caused by ConnectTimeoutError(<urllib3.connection.HTTPSConnection object at 0x7f1b48687640>, 'Connection to cds.climate.copernicus.eu timed out. (connect timeout=60)'))], attemps 1 of 500 Retrying in 120 seconds

krsnapaudel commented 1 day ago

@ellaampy Did you accept the license terms for AgERA5?

ellaampy commented 1 day ago

@krsnapaudel you're right. I missed that. now it is running. I'll let it continue and see if any files are downloaded image