search

DUNE / data-mgmt-ops

3 stars 3 forks source link

Jake's protodune flux files, archive #737

Open StevenCTimm opened 1 month ago

StevenCTimm commented 2 days ago

json files are here--they look ok /exp/dune/data/users/calcuttj/G4Beamline/H4_G4BL_DUNE/jsons/p1GeV/

root files are here /pnfs/dune/persistent/dunepro/beam_data/simulation/G4beamlineVersion3.06/v34b_1GeV_G4beamlineVersion3.06/

Attempted to copy first one into the merging dropbox /pnfs/dune/scratch/dunepro/dropbox/merging

StevenCTimm commented 2 days ago

so there are some of each that exist already:
let us know when further directories of json files are waiting.

StevenCTimm commented 2 days ago

declad is not happy--the xrdcp is failing as such:

11/13/2024 14:30:14.979: MoverTask[H4_v34b1GeV-27.7_10M999.root]: [DEBUG] met adata download command: xrdcp --cksum adler32 --rm-bad-cksum --force --silent ro ot://fndca1.fnal.gov//pnfs/fnal.gov/usr/dune/scratch/dunepro/dropbox/merging/H4 v34b1GeV-27.7_10M_999.root.json /tmp/H4_v34b1GeV-27.7_10M_999.root.json 11/13/2024 14:30:14.979: MoverTask[H4_v34b1GeV-27.7_10M_999.root]: [DEBUG] run Command: mv /pnfs/fnal.gov/usr/dune/scratch/dunepro/dropbox/merging/H4_v34b1GeV -27.7_10M_999.root.json /pnfs/dune/scratch/dunepro/ingest/quarantine/H4_v34b1G eV-27.7_10M_999.root.json 11/13/2024 14:30:14.995: MoverTask[H4_v34b1GeV-27.7_10M_999.root]: failed with error: Quarantine for metadata file H4_v34b1GeV-27.7_10M_999.root.json failed : mv: cannot stat '/pnfs/fnal.gov/usr/dune/scratch/dunepro/dropbox/merging/H4_v3 4b1GeV-27.7_10M_999.root.json': No such file or directory

---but not clear why it is trying to quarantine in the first place... checking

StevenCTimm commented 2 days ago

will track this in a separate ticket.. actually I think I know what may be wrong.

StevenCTimm commented 2 days ago

so you have to add a checksum to each metadata (gave you the syntax in slack) and also the status "core.file_content_status": "good", to make the DeclaD take those.

Can't edit the json files in the dropbox , have to copy to temp area, edit, remove the old one and put in the new one. but should be able to edit them in the json area where you have them.