Can you transform the v0 checkpoint to the compatible version of new branch?

X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family

https://www.modelscope.cn/studios/damo/mPLUG-Owl

MIT License

2.25k stars 171 forks source link

Can you transform the v0 checkpoint to the compatible version of new branch? #52

Closed lovecambi closed 1 year ago

lovecambi commented 1 year ago

I've used the v0 checkpoint for some experiments.

LukeForeverYoung commented 1 year ago

If you want to use the v0 checkpoint, you could switch to the v0 branch. The latest model has fixed several issues and removed some dependencies that were difficult to install (such as FusedLayerNorm in Apex), making it incompatible with the v0 checkpoint. Converting the v0 checkpoint to fit the current model may result in precision issues.

MAGAer13 commented 1 year ago

Besides, for the latest version we follow the same recipe and no more extra data is used. Sorry for your inconvenience.