Closed lsawade closed 3 years ago
@lsawade, could you please also attache the client sandbox? Thanks!
updated!
Thanks!
Hi, after computing some more elaborate workflows. I confirm that this issue persist in my stack. Even a Hello, World!
task will show up as failed.
Hi @lsawade , sorry for the delayed reply! In the client sandbox, radical.log
shows the following error messages for all tasks:
radical.log:1612660245.419 : radical.saga.cpi : 1978733 : 35184425103728 : ERROR : DoesNotExist: file copy failed: /usr/bin/cp: cannot stat '/scratch/gpfs/lsawade/radical.pilot.sandbox/re.session.traverse.princeton.edu.lsawade.018665.0007/pilot.0000/unit.000000/STDOUT': No such file or directory
radical.log:1612660245.427 : umgr_staging_output.0000 : 1978733 : 35184425103728 : ERROR : work <bound method Default.work of <radical.pilot.umgr.staging_output.default.Default object at 0x200002e49340>> failed
This appears to be the reason why the tasks fail. And indeed, the task stdout is available in unit.000000.out
, not in STDOUT
. Is that staging directive created by your application code or by EnTK?
oh boi!
This is something I have kept from the first EnTk tutorials, but hasn't given me any trouble:
t.download_output_data = ['STDOUT', 'STDERR']
I don't actually need this anyway, so I'm going to get rid of it.
Next time, I'll make sure to grep ERROR
in the log before I open an issue.
Alright, closing, because that
This appears to be the reason why the tasks fail. And indeed, the task stdout is available in
unit.000000.out
, not inSTDOUT
. Is that staging directive created by your application code or by EnTK?
was the issue.
Great, I am glad it wasn't more serious :-) But it also tells us again that we need to improve error reporting...
Hi!
Rather weird, I just updated my stack using
pip install --upgrade radical.<package>
. Now, even though theTask
s run smoothly without failing (output in simulations and STDOUT is fine), theTask state
shows up in the log asFAILED
.Stack
Terminal log
Session Sandbox
re.session.traverse.princeton.edu.lsawade.018665.0007.zip
Client Sandbox
client.sandbox.zip