RuntimeErrorRuntimeError: CUDA error: invalid device ordinal Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. : CUDA error: invalid device ordinal Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions.

hustvl / Vim

Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Model

Apache License 2.0

2.55k stars 159 forks source link

RuntimeErrorRuntimeError: CUDA error: invalid device ordinal Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. : CUDA error: invalid device ordinal Compile with `TORCH_USE_CUDA_DSA` to enable device-side assertions. #61

Open stdio159 opened 2 months ago

stdio159 commented 2 months ago

RuntimeErrorRuntimeError: CUDA error: invalid device ordinal Compile with TORCH_USE_CUDA_DSA to enable device-side assertions. : CUDA error: invalid device ordinal Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.

zhuqiangLu commented 2 months ago

Hi, I got the same error and solved it by correcting the nproc_per_node in script, basically I only have 4 gpu, should I have to change it from 8 to 4. Hope it helps.

zjy-2020 commented 2 months ago

Hello, I have encountered the same problem, have you solved it?