Multi-GPU training on a single machine

facebookresearch / suncet

Code to reproduce the results in the FAIR research papers "Semi-Supervised Learning of Visual Features by Non-Parametrically Predicting View Assignments with Support Samples" https://arxiv.org/abs/2104.13963 and "Supervision Accelerates Pre-training in Contrastive Semi-Supervised Learning of Visual Representations" https://arxiv.org/abs/2006.10803

MIT License

486 stars 67 forks source link

Multi-GPU training on a single machine #9

Closed MidoAssran closed 3 years ago

MidoAssran commented 3 years ago

ADDED - option to run main.py locally on multiple gpus

main.py now spans a process for each device the user requests
data_manager.py moved GaussianBlur into a standalone class to fix pickling issues with multiprocessing
utils.py can now initialize pytorch distributed using localhost for single machine training