search

asascience-open / xarray-subset-grid

Subset Xarray datasets in space
https://xarray-subset-grid.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
6 stars 4 forks source link

File missing on S3 #64

Open ChrisBarker-NOAA opened 1 month ago

ChrisBarker-NOAA commented 1 month ago

The CI is failing, 'cause there's a file on the CI that is no longer there:

See #32b70f3

s3://nextgen-dmac-cloud-ingest/nos/wcofs/nos.wcofs.2ds.best.nc.zarr

@jonmjoyce : any ideas? is it gone, or renamed?

jonmjoyce commented 1 month ago

The bucket s3://nextgen-dmac-cloud-ingest/ should not be used for development. Ideally you should access the experimental bucket hosted by NODD for kerchunk aggregations: https://registry.opendata.aws/noaa-nodd-kerchunk/

For WCOFS, use s3://noaa-nodd-kerchunk-pds/nos/wcofs/wcofs.fields.best.nc.zarr

We recently experienced some data changes that corrupted the ingest that was running for s3://nextgen-dmac-cloud-ingest/. This was an internally used RPS development bucket and we will no longer be supporting it.

ChrisBarker-NOAA commented 1 month ago

thanks!

s3://noaa-nodd-kerchunk-pds/nos/wcofs/wcofs.fields.best.nc.zarr

Is now working. We really shouldn't be doing that in the tests -- except maybe tests that specific to the NODD stuff, but at least I got it running again.