RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:5 and cuda:6!

Ucas-HaoranWei / Vary-toy

Official code implementation of Vary-toy (Small Language Model Meets with Reinforced Vision Vocabulary)

565 stars 41 forks source link

Open readyFly opened 5 months ago

readyFly commented 5 months ago

Vary-toy用8卡运行推理的时候报错 RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:5 and cuda:6!

Ucas-HaoranWei commented 5 months ago

Vary-toy需要8卡运行吗？单卡8G多就能运行，如果需要，请参考https://github.com/Ucas-HaoranWei/Vary/issues/27