Substitute multiprocessing.Pool.map for non-parallel map

SciLifeLab / bcbb

Useful bioinformatics code, primarily in Python and R

http://bcbio.wordpress.com

10 stars 11 forks source link

Substitute multiprocessing.Pool.map for non-parallel map #274

Closed guillermo-carrasco closed 11 years ago

guillermo-carrasco commented 11 years ago

Multiprocessing map is giving a lot of problems when some of the sub-calls fail, basically hangs the whole process. I've decided to use the sequential map instead, and use all processors for each subtask.

vals commented 11 years ago

Looks legit, might be a point to have a look at joblib in the future

guillermo-carrasco commented 11 years ago

Agree :+1: