search

H2Oxford / h2ox-data

A repo for building, serving, and reducing time-chunked ERA5 data on GCP.
MIT License
2 stars 0 forks source link

approach #1

Open Lkruitwagen opened 3 years ago

Lkruitwagen commented 3 years ago

Want to be able to do this, but with gcp: https://github.com/zflamig/dask-era5/blob/main/notebook/era5_fargate_dask.ipynb

Google Dask DataProc: https://cloud.google.com/blog/products/data-analytics/improve-data-science-experience-using-scalable-python-data-processing

Pangeo? What is that, how does it work?

Lkruitwagen commented 3 years ago

https://speakerdeck.com/rabernat/cloud-native-climate-data-with-zarr-and-xarray?slide=19

Lkruitwagen commented 3 years ago

https://github.com/pangeo-data/pangeo-datastore/issues/49

Lkruitwagen commented 3 years ago

https://zarr-developers.github.io/slides/scipy-2019.pdf

Lkruitwagen commented 3 years ago

https://discourse.pangeo.io/t/netcdf-to-zarr-best-practices/1119

Lkruitwagen commented 3 years ago

https://nbviewer.jupyter.org/gist/TomAugspurger/b4f95f5432fced544d1f23e18ea8368f