X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.33k stars 176 forks source link

Error while training #86

Closed lambertjf closed 1 year ago

lambertjf commented 1 year ago

Get this error every time I want to train, about 30 minutes into training.

RuntimeError: DDP expects same model across all ranks, but Rank 2 has 128 params, while rank 0 has inconsistent 0 params.

I can't find anything about this error online really. Any ideas?

LiYuhangUSTC commented 1 year ago

Sorry for replying in a closed issue. How do you solve the problem?