RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1! (when checking argument for argument weight in method wrapper_CUDA__native_layer_norm)

dvlab-research / LLaMA-VID

LLaMA-VID: An Image is Worth 2 Tokens in Large Language Models (ECCV 2024)

Apache License 2.0

693 stars 43 forks source link

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1! (when checking argument for argument weight in method wrapper_CUDA__native_layer_norm) #76

Open daocodedao opened 6 months ago

daocodedao commented 6 months ago

chat with 2 GPU :

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cuda:1! (when checking argument for argument weight in method wrapper_CUDA__native_layer_norm)

yanwei-li commented 6 months ago

Hi, could you please provide more details like which script and your settings.

freja-zy commented 4 months ago

I also meet this problem. Do you solve it?