search

mlfoundations / open_clip

An open source implementation of CLIP.
Other
9.93k stars 959 forks source link

Logging for cuda usage could be a little confused when specifying gpu-id #829

Closed Vikho closed 6 months ago

Vikho commented 7 months ago

When I use the training script and specifyexport CUDA_VISIBLE_DEVICES=1, the logging shows_cuda:0_, which is inconsistent with the actual usage (indeed using cuda:1). This may cause some confusion for those who are new to GPU deep learning.

rwightman commented 6 months ago

using CUDA_VISIBLE_DEVICES is a low level alteration, it changes the device enumeration visible to the application so 0 is what the application sees.