Redo tape backups of zcatalog files for guadalupe and iron

desihub / desida

Scripts and configuration for DESI Data Assemblies and Releases.

BSD 3-Clause "New" or "Revised" License

0 stars 0 forks source link

Redo tape backups of zcatalog files for guadalupe and iron #12

Closed weaverba137 closed 11 months ago

weaverba137 commented 11 months ago

Based on discussion with @sbailey:

The "original" files that are now in (guadalupe|iron)/zcatalog/v0 have actually been modified by the addition of the ZCATVER header keyword.
The really original files still exist on HPSS in HTAR files that should be renamed.

So the procedure will be:

[x] Create new checksum files for (guadalupe|iron)/zcatalog/v[01].
[x] Rename really original tape backups of zcatalog.
[x] Create tape backups for (guadalupe|iron)/zcatalog/v[01].
[x] Update the top-level inventory-(guadalupe|iron).txt files.
[x] Update checksums of top-level files.
[x] Redo tape backups of top-level files.

weaverba137 commented 11 months ago

I'm using the following convention to organize tape backups:

v0.0: the genuinely original pipeline outputs.
v0.1: the original pipeline outputs with ZCATVER header added.
v1.0: the patched pipeline outputs.
v1.1: the patched pipeline outputs with DESINAME column added.

Once all tape backups are redone, I'll remove v0.0 and v1.0 and rename v0.1 --> v0, v1.1 --> v1.

weaverba137 commented 11 months ago

While working on this, I discovered the zcatpatch directory had been added to run/scripts, so I'm redoing the backups of the run directory as well.

weaverba137 commented 11 months ago

Just need to finish the tape backup of iron/run.