flatironinstitute / disBatch

Tool to distribute a list of computational tasks over a pool of compute resources. The pool can grow or shrink.
Apache License 2.0
39 stars 8 forks source link

Directive to run once on every node? #5

Closed dylex closed 7 years ago

dylex commented 7 years ago

To prepare an environment, for example.

You might also imagine a per-node barrier, to allow such a thing to run before other tasks on that node, but not block other nodes.

dylex commented 7 years ago

DISBATCH PERNODE submits a task to run once on each node, but which otherwise acts like a normal (repeat) task. No node barrier (yet).