X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.25k stars 171 forks source link

RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:2 and cuda:0! (when checking argument for argument weight in method wrapper_CUDA__cudnn_convolution) #196

Open wanghanyang123 opened 9 months ago

wanghanyang123 commented 9 months ago

多卡设备运行 Quick Start Code 时报错,修改 device 设置单卡可以。但是单卡显存太小(T4卡),只能 8bit 或者 4bit ,请问怎么可以调整成多卡且默认float16运行吗?