DDMAL / Rodan

:dragon_face: A web-based workflow engine.
https://rodan2.simssa.ca/
46 stars 13 forks source link

When a workflow run fails, it would be nice if it still produced a log file #1175

Open kyrieb-ekat opened 3 months ago

kyrieb-ekat commented 3 months ago

This is an issue mostly encountered in training, but is a measure which I think would regardless be helpful for jobs that fail without an error message. When training runs fail and don't produce an error message (input, runtime, resource, etc.), it would be nice if the log file (if available) was still produced. This is particularly helpful because failed and completed jobs don't leave records- if the log file is produced somehow there may be better ways to problem solve for either adjusting the workflow or addressing something else happening behind the scenes.