search

ldeo-glaciology / pangeo-MAR

0 stars 0 forks source link

To do 1: use gsutil to upload MAR NCs to GCS #1

Closed jkingslake closed 2 years ago

jkingslake commented 2 years ago

use the google cloud services (GCS) command-line interface gsutil to upload a few MAR netcdfs to ldeo-glaciology bucket

jkingslake commented 2 years ago

Be sure to upload to gs://ldeo-glaciology-private if you dont want to make the data publicly accessible.

When you have a few NCs up there let us know their names and location in the bucket and people can start helping with the next step (#2).

jkingslake commented 2 years ago

@raf-antwerpen did this. The yearly netcdfs of daily 2D and 3D variables are accessible here: 'gs://ldeo-glaciology/MAR/20km/MARv3.12-20km-daily-ERA5*'

Load them using

NCs_urls = ['https://storage.googleapis.com/' + x + '#mode=bytes' for x in NCs] 
ds = xr.open_mfdataset(NCs_urls, engine='netcdf4', concat_dim='TIME')