luogen1996 / LaVIN

[NeurIPS 2023] Official implementations of "Cheap and Quick: Efficient Vision-Language Instruction Tuning for Large Language Models"
502 stars 36 forks source link

请问有考虑用 lora来替换部分adapter吗? #7

Closed CheungZeeCn closed 1 year ago

CheungZeeCn commented 1 year ago

RT

luogen1996 commented 1 year ago

暂时没有。一是没有必要,二是我们觉得lora的性能不如repadapter,我们之前的论文有做过实验 。如果你感兴趣的话可以做一下这方面的实验,我们欢迎任何人贡献新的代码和权重。

CheungZeeCn commented 1 year ago

@luogen1996 嗯嗯 后来跟着ref 看到了相关描述 感谢答疑。