finetune the projection layer and the llm decoder in the second finetune stage

Vision-CAIR / MiniGPT-4

Open-sourced codes for MiniGPT-4 and MiniGPT-v2 (https://minigpt-4.github.io, https://minigpt-v2.github.io/)

https://minigpt-4.github.io

BSD 3-Clause "New" or "Revised" License

25.4k stars 2.91k forks source link

Open nkjulia opened 1 year ago

nkjulia commented 1 year ago

anyone have done such thing successfully?

nkjulia commented 1 year ago

@xiaoqian-shen 请问下，是否可以project-layer+LLM一起finetune呢

xmy0916 commented 1 year ago

@nkjulia 训不动的我试了，A100，batchsize 1放开llm都训不动 vicuna 7b

631068264 commented 1 year ago