search

informatics-lab / PangeoLectures

Training material on the principles and practices of The Pangeo Way
2 stars 4 forks source link

save era5 and xbt data to azure #15

Closed stevehadd closed 2 years ago

stevehadd commented 2 years ago

In order to make the notebooks work as seamlessly as possiblt, we should create a copy of the XBT and ER5 data loaded in the notebooks to azure storage, as accessing the data on AWS S3 requires AWS credentials (its public, but you need to have credentials), which I expect most participants will not have. The XBT data is fairly small, and we can pick a subset of era 5 data to copy.

stevehadd commented 2 years ago

we should also demonstrate getting data from the copernicus data store. https://cds.climate.copernicus.eu/api-how-to

stevehadd commented 2 years ago

create a zarr file from the downloaded era5 data to demonstrate how it is different to netcdf5 and better for cloud data acess.

stevehadd commented 2 years ago

this is now working. The notebooks do not contain the secret key, so we might need to think about a better long term solution. created #16 to look into that so closing this issue.