multiple GPUS

[Rookielike]

thanks for providing your code .when training,gpu id was set to 0 and 1.but it was occupied in my server.so i change ids to 1and 2 ,one error occured :all tensors must be on devices[0]. then i added os.environ['CUDA_VISIBLE_DEVICES'] = "3,6" ,it didn't work How can i solve this problem? thanks for your reading

[chaoyuaw]

Have you tried to only use --gpus to specify the GPUs that you want to use, but not changing CUDA_VISIBLE_DEVICES? Would that work?

[SkySailing]

https://discuss.pytorch.org/t/how-to-solve-the-problem-of-runtimeerror-all-tensors-must-be-on-devices-0/15198