search

tomeichlersmith / hps

0 stars 0 forks source link

mille data file format tester #13

Closed tomeichlersmith closed 1 year ago

tomeichlersmith commented 1 year ago

We need a way to check if a generated mille data file is corrupted or not. a 4/200 ~ 2% rate is way too high to just do it manually each time. I'm thinking a C executable using the same functions that pede uses or a python executable based off the readMilleBinary.py script shipped with MillepedeII.

Thanks for looking into this more. I think your solution of just rerunning these partitions is reasonable, but we need a nice way of finding the corrupted files and deleting them. hps-mc has a way to only submit jobs with missing output files, so after you remove the corrupted files this could be used to easily submit the jobs that are needed.

Originally posted by @cbravo135 in https://github.com/tomeichlersmith/hps/issues/12#issuecomment-1447288486

cbravo135 commented 1 year ago

This check could be at the end of the pede_job.py and just delete the file before the job ends if it fails.

cbravo135 commented 1 year ago

In this case it would just be a new component that would be the last in the sequence.

tomeichlersmith commented 1 year ago

done and in latest MillepedeII release