search

Vision-CAIR / MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)
https://minigpt-4.github.io
BSD 3-Clause "New" or "Revised" License
25.4k stars 2.91k forks source link

stage1.pth load error: size mismatch for llama_proj.weight and bias #133

Open created-Bi opened 1 year ago

created-Bi commented 1 year ago

hello, have you changed the parameter size of the llama_proj module?

image

could you double check and re-update the stage1.pth?

yPanStupidog commented 1 year ago

Save problem met here.

TsuTikgiau commented 1 year ago

I guess this is due to the wrong combination. This would happen when you load the 7b version of minigpt-4 but load the 13b vicuna, or load the 13b version of minigpt-4 but sue the 7b vicuna

TsuTikgiau commented 1 year ago

ah I just noticed that you are talking about the stage 1. Previously we only provide the stage 1 checkpoint for 13B vicuna. Now we updated the readme to include the 7B version