Closed georgerennie closed 2 years ago
I used this for a while on personal stuff and found it could be a bit temperamental sometimes (not sure if it was weird race conditions or what) and the codebase has diverged so I'm gonna close the PR for now. Would be quite nice to be able to run tasks in parallel at somepoint in the future but maybe a different approach would be needed.
This is planned using a different approach, #182 already refactored the sby task loop so it can support multiple tasks concurrently within the same process. This is required for the currently in development autotune feature (#158) and eventually I want to use it to also implement -j
.
This allows up to N tasks to be run in parallel within a multiprocessing Pool. The default behaviour is still one task at once.