databio / pypiper

Python toolkit for building restartable pipelines
http://pypiper.databio.org
BSD 2-Clause "Simplified" License
45 stars 9 forks source link

Pipeline "failure reason" loses some information #226

Open vreuter opened 3 months ago

vreuter commented 3 months ago

NBD b/c the info is still available in the stack trace generally (always, I think), but for example, on a KeyError, the message would look like this:

Failure reason: 'z_px'

which loses the error type and could potentially be confusing, if that's consumed by any log reading tool that displays the failure reason, or if the traceback were lost. Ideally, we could also emit the error type in the message. Failure reason: 'z_px'

https://github.com/databio/pypiper/blob/d1e3ece3605ef0d15c0d70ea2dca174abe9ac0a7/pypiper/manager.py#L2000