Tracking Issue: Sync GCS holdings to AWS S3

leap-stc / cmip6-leap-feedstock

Apache License 2.0

13 stars 5 forks source link

Tracking Issue: Sync GCS holdings to AWS S3 #134

Open jbusecke opened 6 months ago

jbusecke commented 6 months ago

I set up this issue to keep track of efforts to sync the ingested data to AWS S3.

Feedback very welcome and more details and discussions coming soon.

Balinus commented 1 month ago

Can a warning be added directly on the AWS Zarr store? Currently, Zarr store is first between the zarr and netcdf store files. We had the impression it was the favored way to get the data. There is also no warning that the sync is broken.

https://registry.opendata.aws/cmip6/

Cheers!