EvanForsythe / ERCnet

9 stars 2 forks source link

Investigate using uncapped memory for Joblib parallel workers #90

Open tgattsIV opened 1 year ago

tgattsIV commented 1 year ago

Currently we are capping some parallelization to be single core as a way to resolve memory usage errors during runtime. This may be solved by changing the default memory allocation for each worker by the OS. Joblib documentation has examples.