X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.25k stars 171 forks source link

感谢大佬工作,请问下一阶段训练的loss是怎么设计的?论文和代码中都没有比较明确的提示; #90

Closed fanbooo closed 1 year ago

MAGAer13 commented 1 year ago

We only compute the loss for the reponse through predicting the next token.