-
-
For multi GPU, it outputs:
```
RuntimeError: arguments are located on different GPUs at /pytorch/torch/lib/THC/generic/THCTensorMathBlas.cu:236
```
How to fix it?
-
#24 adds a multi-GPU PyTorch example that demonstrates how to use Distributed Data Parallel training. However, training with multiple GPUs does not speed up training in the example. See https://gith…
-
First and foremost, I would like to express my sincere gratitude for your outstanding work. It has been incredibly insightful and inspiring. However, I am currently facing some challenges in reproduci…
-
I used 4 GPUs on 1 node:
`torchrun --standalone --proc_per_node=4 train.py --compile=False`
But, the training speed is just like 1 GPU,why?
-
Hi, I am trying to finetune Whisper according to the blog post [here](https://huggingface.co/blog/fine-tune-whisper). The finetuning works great in a single GPU scenario, however, fails with multi GPU…
-
Hello, I am trying to get my hands dirty with training bert from scratch etc. and I have 4 gpus at my disposal. I want to see if there is a way that I can distribute the training across all of them. T…
-
hi alls,
In multi-gpu training, I encounter strange errs, sometimes in "tr.iter*.1.log", sometimes in "cv.iter*.1.log", "*" means a rand iterator number, following is the err info:
> c…
-
I see that tensorflow detected 2 GPU's but the training is only happening in 1 GPU. Please advise?
-
according to the "option.py". it's ok to use "--n_GPUs". Howerver, it didn't work