search

cedadev / kerchunk-tools

Tools to work with kerchunk
BSD 3-Clause "New" or "Revised" License
3 stars 0 forks source link

Where to write short-term and long-term outputs from Kerchunk and Intake generators? #42

Open agstephens opened 1 year ago

agstephens commented 1 year ago

Temporary store for testing

/gws/nopw/j04/cedaproc/kerchunk-store/

Use sub-directories for kerchunk files (POSIX) and cloud (S3).

Eventual locations for real outputs

/badc/cmip6/metadata/catalogs/intake
/badc/cmip6/metadata/catalogs/kerchunk
dwest77a commented 8 months ago

Kerchunk pipeline creates temporary storage under eg.

/gws/nopw/j04/cmip6_prep_vol1/kerchunk-pipeline/...

Final outputs likely to be ingested at locations such as:

/badc/cmip6/metadata/kerchunk/...