-
CUDA_VISIBLE_DEVICES=0,1,2,3 python3 -m torch.distributed.launch --nproc_per_node=4 train.py xxx
The codes above cannot run on multiple GPUs.
It is weird that all the trainning are running on th…
-
Hi,
I want to try to run multi-GPU. But when I set GPU number bigger than 1.
It output
`Warning: THIS FUNCTION IS DEPRECATED. It will be removed after 2020-04-01. Instructions for updating: Use …
-
When training, GPU usage is relatively low, a card occupied up, suddenly reduced. Training data is VOC, does data sets need to be change?
-
https://github.com/CanyonWind/Single-Path-One-Shot-NAS-MXNet/blob/df1c1ffdd150695745b5abd4002be330be5d13b0/oneshot_nas_blocks.py#L166
https://github.com/CanyonWind/Single-Path-One-Shot-NAS-MXNet/bl…
-
Hello @WongKinYiu
I am running this command to train on mutiple GPUs on a redhat 8.7 server:
python -m torch.distributed.launch --nproc_per_node 2 --master_port 9527 train_aux.py --workers 5 --devi…
-
RuntimeError: CUDA error: device-side assert triggered
CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect.
For debugging consider …
-
Hi, I have used 8 gpus to train dlrm recently. The command I use is `python3 -m torch.distributed.launch --nproc_per_node 4 python3 dlrm_s_pytorch.py --arch-sparse-feature-size=64 --arch-mlp-bot="13-5…
-
### Problem Description
rocm-smi --setpoweroverdrive 200 does allow lowering the power usage anymore. This was functional (6.1.2) prior to upgrading. We would lower the temperature significantly with…
-
**Describe the bug**
With the command below to run the Auto3DSeg dints algo network search on 2-GPU, I get an error message:
**To Reproduce**
```
torchrun --nnodes=1 --nproc_per_node=2 ./tmp_sim…
-