search

NCAR / cesm-lens-aws

Examples of analysis of CESM LENS data publicly available on Amazon S3 (us-west-2 region) using xarray and dask
https://doi.org/10.26024/wt24-5j82
BSD 3-Clause "New" or "Revised" License
43 stars 23 forks source link

catalog-builder broken after addition of grid.zarr variables in AWS #46

Closed bonnland closed 4 years ago

bonnland commented 4 years ago

The catalog builder is crashing when it tries to parse the recently added grid variables on AWS. The folder structure is not expected:

['ncar-cesm-lens', 'lnd', 'monthly', 'cesmLE-RCP85-FSNO.zarr']
['ncar-cesm-lens', 'lnd', 'monthly', 'cesmLE-RCP85-H2OSNO.zarr']
['ncar-cesm-lens', 'lnd', 'monthly', 'cesmLE-RCP85-QRUNOFF.zarr']
['ncar-cesm-lens', 'lnd', 'monthly', 'cesmLE-RCP85-RAIN.zarr']
['ncar-cesm-lens', 'lnd', 'monthly', 'cesmLE-RCP85-SNOW.zarr']
['ncar-cesm-lens', 'lnd', 'monthly', 'cesmLE-RCP85-SOILLIQ.zarr']
['ncar-cesm-lens', 'lnd', 'monthly', 'cesmLE-RCP85-SOILWATER_10CM.zarr']
['ncar-cesm-lens', 'ocn', 'grid.zarr', '.zattrs']
Traceback (most recent call last):
  File "catalog-builder.py", line 42, in <module>
    build_catalog()
  File "catalog-builder.py", line 27, in build_catalog
    _, experiment, variable = path_components[-1].split('.')[0].split('-')
ValueError: not enough values to unpack (expected 3, got 1)
bonnland commented 4 years ago

@andersy005 Does the grid.zarr folder need to go in ocn/monthly? Or is it intended to cover a broader group of datasets than this?

andersy005 commented 4 years ago

Since the grid variables don't depend on time, it makes sense to just put the grid.zarr store under ncar-cesm-lens/ocn/static

bonnland commented 4 years ago

closed by #47