search

X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.25k stars 171 forks source link

Details of Lora's fine tuning #159

Closed AshOneN closed 11 months ago

AshOneN commented 11 months ago

What are the lora rank and layer ranges

MAGAer13 commented 11 months ago

rank=8, and apply lora on all the layers of LLM.