As discussed with @debsankha, for now we do not provide any chunking of tasks. The original line of thought was that chunking would significantly decrease overhead of the scheduling. However, in the worker-based computation scheme, communication is fast via the network, in contrast to the overhead-rich communication of single-job submission via the gridengine scheduler.
As discussed with @debsankha, for now we do not provide any chunking of tasks. The original line of thought was that chunking would significantly decrease overhead of the scheduling. However, in the worker-based computation scheme, communication is fast via the network, in contrast to the overhead-rich communication of single-job submission via the gridengine scheduler.