search

yuch7 / cwlexec

A new open source tool to run CWL workflows on LSF
Other
36 stars 8 forks source link

Default queue is used in a workflow even though another queue is specified in a config file #5

Closed drjrm3 closed 6 years ago

drjrm3 commented 6 years ago

I have a simple foo.sh script which is wrapped with foo.cwl. foo_wf.cwl is a workflow which scatters over foo.cwl. When specifying a queue in a config file, all scatter jobs correctly hit that queue, but the final Scatter gather job action is sent to my default queue, not the queue specified in my config file.

See attached for a fully reproducible example (aside from queues 'priority' and 'short' being specified).

WrongQueueError.tar.gz

liuboxa commented 6 years ago

Fixed in d5cab33, the gather job is used to wait the scatter jobs, so we should treat it as the part of scatter step.

Test result: error output:

[03:40:33.655] INFO  - Start a gather job for scatter step (foo).
[03:40:33.671] INFO  - Scatter gather job (foo) was submitted. Job <44579> is submitted to queue <short>.

correct output:

[04:22:07.361] INFO  - Start a gather job for scatter step (foo).
[04:22:07.379] INFO  - Scatter gather job (foo) was submitted. Job <44585> is submitted to queue <priority>.