Open shane-kercheval opened 5 years ago
e.g. commented this out
if parallelization_cores == 0 or parallelization_cores == 1:
ppv_tpr_tuple = list(map(get_ppv_tpr, get_ppv_tpr_args))
else:
cores = cpu_count() if parallelization_cores == -1 else parallelization_cores
# with ThreadPool(cores) as pool:
# https://codewithoutrules.com/2018/09/04/python-multiprocessing/
with get_context("spawn").Pool(cores) as pool:
ppv_tpr_tuple = list(pool.map(get_ppv_tpr, get_ppv_tpr_args))
and changed to
ppv_tpr_tuple = list(map(get_ppv_tpr, get_ppv_tpr_args))
commented def test_Resampler_fold_indexes_parallelized(self):
out
commented def test_resamplers_RandomForest_classification_parallization(self)
out
commented def test_resampling_roc_pr_thresholds_resampler_parallelization(self)
out
These files
with ThreadPool(cores) as pool:
sometimes this hanges
Tried changing to with get_context("spawn").Pool(cores) as pool:
based on https://codewithoutrules.com/2018/09/04/python-multiprocessing/, which seemed to work,
but now i'm getting various warnings, so i'm disabling parallelization for now until i have time to investigate further.