Meituan-AutoML / MobileVLM

Strong and Open Vision Language Assistant for Mobile Devices
Apache License 2.0
1.04k stars 66 forks source link

any lora for stage 2? #22

Closed shawnricecake closed 8 months ago

shawnricecake commented 9 months ago

Hi,

can we use lora to finetune the llama part based on the pretrained weights of llama in stage 2?

Thanks

er-muyue commented 9 months ago

Within the scope of MobileVLM license, you are free to use our pretrained weights in your projects. In addition, we also provide the stage2 lora-fintune code script, please refer to here.

er-muyue commented 8 months ago

Hi, hope your question has been resolved. If you have any further concerns, please feel free to re-open it or open a new issue. Thanks!