NCAS-CMS / cfstore

A CF compliant data store with interfaces to local and remote storage.
MIT License
2 stars 1 forks source link

CFA workflow for HPC -> JASMIN disk -> JASMIN tape -> JASMIN disk #128

Open bnlawrence opened 1 year ago

bnlawrence commented 1 year ago

We need to document the expected workflow for data as

A sketch of this is here:

IMG_5971

The initial use case is CANARI, but we want this to be a generic workflow.

bnlawrence commented 1 year ago

Here are a couple of flowcharts expressing some of the stuff on that white board workflow workflow-1

bnlawrence commented 1 year ago

Already seen an error. Fragments are not moved from tape to disk, they're copied. Hence the stuff on disk in GWS is always a replicant of stuff on tape. Will update these and stick them in the repository.