nils-braun / b2luigi

Task scheduling and batch running for basf2 jobs made simple
GNU General Public License v3.0
17 stars 11 forks source link

More useful error messages for temporary outputs don't exist #159

Open meliache opened 2 years ago

meliache commented 2 years ago

For tasks which use b2luigi.on_temporary_files, if the run-function fails to produce the temporary outputs, the first error message that the user sees is a FileNotFoundError when b2luigi tries to move the files to the correct location. E.g. someone recently sent me the traceback

FileNotFoundError: [Errno 2] No such file or directory: '/nfs/dust/belle2/user/<user>/XsllDataMoriond/results/b17/git_hash=release-05-02-18/input_files=hashed_da87ca2d321f178adb5683a1f64a9fe7/run_fei=False/feiHadronicBzero=True/feiHadronicBplus=True/Upsilon4SBpmuplus.root-luigi-tmp-0806291073' -> '/nfs/dust/belle2/user/<user>/XsllDataMoriond/results/b17/git_hash=release-05-02-18/input_files=hashed_da87ca2d321f178adb5683a1f64a9fe7/run_fei=False/feiHadronicBzero=True/feiHadronicBplus=True/Upsilon4SBpmuplus.root'

The cause of this is very obvious when you not what b2luigi.on_temporary_files does, but the user that sent the traceback to me was just using Basf2PathTask's not even being aware that they use temporary outputs and was very confused by this error message.

I suggest adding a more helpful message what might cause it and how to possibly fix it.