mschubert / clustermq

R package to send function calls as jobs on LSF, SGE, Slurm, PBS/Torque, or each via SSH
https://mschubert.github.io/clustermq/
Apache License 2.0
146 stars 27 forks source link

Respect machine limits on multi-core execution #236

Closed mschubert closed 3 years ago

mschubert commented 3 years ago

For local paralellism, do not exceed total cores or memory available (maybe also cores provided by batch system if multicore used inside scheduler)

Make the max configurable.

mschubert commented 3 years ago

Actually duplicate of #219