quaquel / EMAworkbench

workbench for performing exploratory modeling and analysis
BSD 3-Clause "New" or "Revised" License
128 stars 90 forks source link

Reimplement MultiprocesserEvaluator using ProcessPoolExecutor #325

Open quaquel opened 11 months ago

quaquel commented 11 months ago

The current implementation of the MultirpocessingEvaluator predates concurrent.futures. A lot of what is currently done can readily be supported by using a ProcessPoolExecutor directly. Moreover, the logging setup can be simplified using the QueueHandler and QueueListerener now available in logging. Together this will reduce the code in the workbench and make the implementation more similar to the MPIEvaluator.