search

georgian-io-archive / foreshadow

An automatic machine learning system
https://foreshadow.readthedocs.io
Apache License 2.0
29 stars 2 forks source link

Multiprocess #157

Closed jzhang-gp closed 5 years ago

jzhang-gp commented 5 years ago

Description

Turning on multiprocess in the ParallelProcessor. To enable this, we have to:

Note that turning on parallel processing on small dataset is actually counterproductive since the overhead of spawning processes is high. In this case it's better to use single process. This will be a TODO to let user select whether to use multiprocess. In the future we may want to let the framework decide what to do.

jzhang-gp commented 5 years ago

closing in favour of a new one.