genericworkflownodes / GenericKnimeNodes

Base package for GenericKnimeNodes
https://github.com/genericworkflownodes/GenericKnimeNodes
Other
15 stars 16 forks source link

parallelise ZipLoop - feature request #242

Open lars20070 opened 5 years ago

lars20070 commented 5 years ago

In principle, Parallel Chunk Loop in combination with Port to URI and URI to Port allow the execution of OpenMS/Knime workflows with multiple threads. But the implementation of Parallel Chunk Loop has problems (NullPointerException) and is incomplete (multiport start missing).

IMO, it would be best to implement a parallelised version of ZipLoop which replaces the old one. We will then have the same behaviour as in TOPPAS now.

Below the start of a loop in order to run a multi-threaded workflow in the Knime workflow engine. IMO, it's bad UX and a major hurdle for adoption.

boilernodes

In comparison, this is what the equivalent workflow in TOPPAS looks like. Parallel execution is entirely managed by the TOPPAS workflow engine in the background.

toppas10