How to run code with multiple GPUs

gabeur / mmt

Multi-Modal Transformer for Video Retrieval

http://thoth.inrialpes.fr/research/MMT/

Apache License 2.0

255 stars 41 forks source link

How to run code with multiple GPUs #18

Closed code10086web closed 3 years ago

code10086web commented 3 years ago

Hi, friends, when I run the code with the following command. At the same time, I changed "n_gpu: 1" to "n_gpu: 2" in the LSMDC_full_trainval.json. I get some error messages. I hope you can give me some suggestions.

Command

CUDA_VISIBLE_DEVICES=0,1 python -m train --config configs_pub/eccv20/LSMDC_full_trainval.json

Error

gabeur commented 3 years ago

The code we provided is single GPU. Our experiments last less than 4 hours on a single V100 GPU. If you want to implement multi GPU, we recommend using the torch.nn.parallel.DistributedDataParallel method.