search

HenrikBengtsson / future.batchtools

:rocket: R package future.batchtools: A Future API for Parallel and Distributed Processing using batchtools
https://future.batchtools.futureverse.org
84 stars 9 forks source link

WISH: Update the default to use a finite number of HPC workers #57

Closed HenrikBengtsson closed 4 years ago

HenrikBengtsson commented 4 years ago

In future.batchtools (>= 0.8.1-9000) it's possible to configure the default number of HPC workers (#52), which currently remains at +Inf. We might want to change the default to a large, limited number to lower the risk of overloading the HPC scheduler.