I found that if i use multi gpu(2 or 3) to train the model, it cannot work and raises OOM error. But if I use single gpu to train it under same parameters except --num_gpus , it works. Am I using multi gpu incorrectly? All the gpus are same with same size of memory.
I found that if i use multi gpu(2 or 3) to train the model, it cannot work and raises OOM error. But if I use single gpu to train it under same parameters except
--num_gpus
, it works. Am I using multi gpu incorrectly? All the gpus are same with same size of memory.