Closed HuguesTHOMAS closed 1 year ago
Hi,
Which command should be used to start the pretraining on multiple GPUs? I guessed from looking at the code, that the parameter --launcher pytorch needs to be set. Is there something else to set like environment variables etc?
--launcher pytorch
Best, Hugues
You can directly specify multiple GPUs, for example, CUDA_VISIBLE_DEVICES=0,1,2,3
Hi,
Which command should be used to start the pretraining on multiple GPUs? I guessed from looking at the code, that the parameter
--launcher pytorch
needs to be set. Is there something else to set like environment variables etc?Best, Hugues