Open ToJl9TopTonop opened 4 months ago
I don't have multiple GPUs to test this. But it seems a bit strange that cuda:0 works, and cuda:1 doesn't. The device name "cuda:1" is just passed to pytorch without any additional checks.
curiously I am also finding this, when I did not previously.
My understanding is that setting "CUDA_VISIBLE_DEVICES=1" makes CUDA only expose a single device to the application. You're telling the application to use the second device, but as far as it can tell there's only one (the one that CUDA is exposing to it). So I think you either want to use CUDA_VISIBLE_DEVICES or select a device in the application, not both.
(At least that was my experience, I ran into the same problem with the SD webui when trying to select a GPU)
@ToJl9TopTonop Please confirm if this is still an issue for you and if not, what was your solution so I can document it in the wiki.
What happened?
train device cuda:1 does not work. train device cuda:0 works. train device cuda works.
Simple solution (crutch): In start-ui.bat add set CUDA_VISIBLE_DEVICES=1![image](https://github.com/Nerogar/OneTrainer/assets/65403943/fccf5173-fa20-4d95-b5f9-f42233426a3d)
What did you expect would happen?
there are video cards: RTX 4060 ti 16gb - cuda:0 or CUDA_VISIBLE_DEVICES=0 tesla p40 24gb - cuda:1 or CUDA_VISIBLE_DEVICES=1 <- I need to select this one tesla p4 8gb - cuda:2 or CUDA_VISIBLE_DEVICES=2
Relevant log output
Output of
pip freeze
No response