Open Haruka1307 opened 2 months ago
Could you try export CUDA_VISIBLE_DEVICES=6
instead?
Could you try
export CUDA_VISIBLE_DEVICES=6
instead?
It works for 80G momory devices but not for less memory devices. Could you please share any advice for other devices like 32G instead of CPU-based method?
Could you try
export CUDA_VISIBLE_DEVICES=6
instead?It works for 80G momory devices but not for less memory devices. Could you please share any advice for other devices like 32G instead of CPU-based method?
You may try fix device_map to
device_map = {'': 'cuda:0'}
? .I think auto device map may lead to put model to cuda 1
Hi!
I try to do step 2 on device cuda"6" since cuda "0" is in use,so I move the batches and model to cuda"6". I print device of batch and model in obtain_gradients_with_adam function to confirm.
But err occurs as below:
I didn't figure out that...