search

xiaoachen98 / Open-LLaVA-NeXT

An open-source implementation for training LLaVA-NeXT.
398 stars 20 forks source link

Results with lora_qv_proj_only=True? #24

Open collinmccarthy opened 3 weeks ago

collinmccarthy commented 3 weeks ago

First, thank you so much for this repo, it's helped me get up to speed on LLaVA-v1.6/NeXt a lot faster!

Second, do you have any results yet indicating if --lora_qv_proj_only=True gives better results than using LoRA for all linear modules?

Thanks!