X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.25k stars 171 forks source link

The loss value of stage2. #154

Open Ivesfu opened 1 year ago

Ivesfu commented 1 year ago

Hi to the team, thanks for your hard work and mPLUG-Owl demostrated great performance!

When I reproduce the project, I did the second stage of training with my own data.

However, I noticed that the Loss started to drop from 3.7.

I was wondering about this and I was curious about what is the approximate range of the Loss when you team training the stage2?

Thanks a lot!