Use spawn to start processes and add an option to use new processes.

stewartmiles commented 2 years ago

Use spawn to start new processes from multiprocessing.Pool() to avoid deadlocks when using multi-threaded frameworks like Pytest, TensorFlow etc. e.g https://britishgeologicalsurvey.github.io/science/python-forking-vs-spawn/
Added an option to use new processes rather than reusing existing processes when running test suites. Some frameworks (e.g TensorFlow) do not always shut down cleanly which causes later test suite invocations to hang if they're run in the same process. This patch adds --disable-process-pooling to force each test suite to run in a new process.

Fixes #11

craigahobbs commented 2 years ago

Thanks for the pull request! Looks good at a glance. I want to take a closer look and, barring any issues, should get it merged in and released later this week.

stewartmiles commented 2 years ago

@craigahobbs thanks for your speedy response.

craigahobbs / unittest-parallel

Use spawn to start processes and add an option to use new processes. #12