search

OpenScienceComputing / unige-pangeo-course

Apache License 2.0
2 stars 1 forks source link

How can I push Copernicus data on the cloud? #4

Open mmagaldi77 opened 2 months ago

mmagaldi77 commented 2 months ago

Hello guys @rsignell @andreall . I am not aware of a method to access remotely to Copernicus data without passing through their APIs. Can you please share how to push data once I downloaded netcdf files with their APIs?

Thanks in advance

MBendoni commented 2 months ago

Hi Marcello,

at the moment I am able to read CMEMS datasets remotely following the instructions reported here:

https://help.marine.copernicus.eu/en/articles/8287609-copernicus-marine-toolbox-api-open-a-dataset-or-read-a-dataframe-remotely

Once you installed the copernicus marine toolbox (https://help.marine.copernicus.eu/en/articles/7970514-copernicus-marine-toolbox-installation ; I did it creating a virtual environment through miniconda), you can access data using the same syntax of xarray.

I have yet to check how easy it is to manipulate data and download it.

mmagaldi77 commented 2 months ago

Hi Marcello,

at the moment I am able to read CMEMS datasets remotely following the instructions reported here:

https://help.marine.copernicus.eu/en/articles/8287609-copernicus-marine-toolbox-api-open-a-dataset-or-read-a-dataframe-remotely

Once you installed the copernicus marine toolbox (https://help.marine.copernicus.eu/en/articles/7970514-copernicus-marine-toolbox-installation ; I did it creating a virtual environment through miniconda), you can access data using the same syntax of xarray.

I have yet to check how easy it is to manipulate data and download it.

Fantastic @MBendoni now that @andreall installed the toolbox in the shared environment I am going to try to execute the example at the link on nebari

robertasciascia commented 2 months ago

I'm reposting here the link to the workflow I've followed for my recent scripts https://help.marine.copernicus.eu/en/articles/7949409-copernicus-marine-toolbox-introduction

rsignell commented 2 months ago

I'm haven't tried the toolbox, but this is the way I downloaded ERA5 files from Copernicus and converted them to cloud-optimized data on object storage: Video: https://discourse.pangeo.io/t/wednesday-october-12th-2022-my-era5-journey-from-api-to-arco/2814 Code: https://github.com/rsignell-usgs/pangeo_showcase_20221012