facebookincubator / submitit

Python 3.8+ toolbox for submitting jobs to Slurm
MIT License
1.3k stars 125 forks source link

Improving performance with NVidia GPU affinity? #1756

Open giorgos117 opened 11 months ago

giorgos117 commented 11 months ago

Hello,

I currently use the following to set GPU affinity:

slurm_additional_parameters = {'gres': f'gpu:{args.tasks_per_node}', 'gpu-bind': f'single:1'}

Is it possible to improve on this by using the NVidia GPU affinity package?

[https://github.com/NVIDIA/gpu_affinity]

Best regards,

George