Data: CM2.6

[jbusecke]

• [x] Find available atmospheric data
• [ ] Available variables with time frequency:
  • Example: SST (1day)
• [x] Bring them to the cloud.

Data Location Atmospheric daily output: gs://cmip6/GFDL_CM2_6/control/atmos_daily.zarr Oceanic daily output:

from intake import open_catalog
cat = open_catalog("https://raw.githubusercontent.com/pangeo-data/pangeo-datastore/master/intake-catalogs/ocean/GFDL_CM2.6.yaml")
ds  = cat["GFDL_CM2_6_control_ocean_surface"].to_dask()

Air-Sea fluxes monthly output:

ds  = cat["GFDL_CM2_6_control_ocean_boundary_flux"].to_dask()

Model grid:

ds  = cat["GFDL_CM2_6_grid"].to_dask()

[jbusecke]

@rabernat could you point us to the resources of the uni of arizona? that you mentioned in our meeting today?

[cisaacstern]

@jbusecke, sounds good! I will wait for you/others to

• [ ] Find available atmospheric data

that have

• [ ] Available variables with time frequency:
• Example: SST (1day)

and then I will

• [ ] Bring them to the cloud.

[jbusecke]

I just submitted a PR to https://github.com/pangeo-forge/staged-recipes/pull/99 to get daily atmospheric data into the cloud.

[jbusecke]

The converted zarr store of the daily atmospheric data is on gyre at /swot/SUM03/jbusecke/CM2.6/pangeo_forge_recipe/CM2.6_atmos_daily.zarr. What is the best way to upload that to the cloud? cc @rabernat @cisaacstern

[jbusecke]

This is the control run, so I should probably rename it to avoid confusion.

[cisaacstern]

What is the best way to upload that to the cloud?

What cloud bucket are we using for this project?

[jbusecke]

@rabernat That would be your line of expertise.

[rabernat]

I will upload it with the rest of the CM2.6 data, whose location is described here: https://github.com/pangeo-data/pangeo-datastore/blob/master/intake-catalogs/ocean/GFDL_CM2.6.yaml

[rabernat]

Upload in progress to gs://cmip6/GFDL_CM2_6/control/atmos_daily.zarr/.

For reference, the commands I used were

gcloud auth activate-service-account --key-file <service_account_key_file>.json
cd /swot/SUM03/jbusecke/CM2.6/pangeo_forge_recipe/
gsutil -m -i cmip6-updates@gcp-public-data-noaa-cmip6.iam.gserviceaccount.com cp -r CM2.6_atmos_daily.zarr gs://cmip6/GFDL_CM2_6/control/atmos_daily.zarr

[rabernat]

The data are uploaded. Please give a look and check that it looks right.

[jbusecke]

I just did a few tests on the pangeo google deployment and this seems ok to me. Works really fast too! Ill wrap up this issue for now, we can always reopen it if problems arise.