TheRoddyWMS / BatchEuphoria

A library to access different kinds of cluster backends
MIT License
3 stars 5 forks source link

Rework local job manager model #130

Open dankwart-de opened 5 years ago

dankwart-de commented 5 years ago

The way how parallel local execution should be modeled is to have a LocalJobManager with a limited size thread-pool and a job queue. With the current model instead we have a runParallel() method in the very-very-very client code, leaking job execution model into the the bioinformatic code.

Originally posted by @vinjana in https://github.com/TheRoddyWMS/BatchEuphoria/pull/129/files