Open WalterKolczynski-NOAA opened 1 month ago
Thank you for the report @WalterKolczynski-NOAA. And thank you especially for the reproducer. That makes it a lot easier for me to drill down on the problem. I will investigate and see if i can figure out what is going on. The reported behavior is definitely incorrect. I can test myself, but I'm assuming the behavior is the same when the outer metatask leaves the mode unspecified (the default is parallel).
Yes. I believe I tried both implicit and explicit parallel just in case.
Oops, I thought I had changed the queue back to batch
before I submitted. If you use the debug
queue, it will be harder to see the problem because there is a two-job at-a-time limit. Fixed now.
What is wrong
When placing a serial metatask inside of a parallel metatask, all of the serial tasks will be queued at once when the dependency is met instead of running sequentially.
What should have happened
The serial tasks should wait for the task before them in sequence before being queued while sequences runs independently in parallel. Only the first task in each sequence should start when the explicit dependencies are satisfied.
Schedulers impacted
Seen on both slurm and pbspro
Steps to reproduce