Any plan for supporting Lora peft loading - Githubissues

EvolvingLMMs-Lab / lmms-eval

Accelerating the development of large multimodal models (LMMs) with lmms-eval

https://lmms-lab.github.io/

Other

1.02k stars 52 forks source link

Any plan for supporting Lora peft loading #96

Open hxhcreate opened 3 weeks ago

hxhcreate commented 3 weeks ago

Before you open an issue, please check if a similar issue already exists or has been closed before.

When you open an issue, please be sure to include the following

[ ] A descriptive title: [xxx] XXXX
[ ] A detailed description

Thank you for your contributions!

Luodian commented 3 weeks ago

Yes! I think this would not be hard since LLaVA naturally support it. But for other models, should write customized loading process.

Basically, it's a model side change, lmms-eval only provide the interfaces for inputs, outputs and calculate scores for each task.