TUDB-Labs / mLoRA

An Efficient "Factory" to Build Multiple LoRA Adapters
Apache License 2.0
252 stars 39 forks source link

[feature] VeRA adapter support, and add document "how to develop new adapter" #234

Closed yezhengmao1 closed 2 months ago

yezhengmao1 commented 2 months ago

VeRA does not perform well on the small model, possibly due to insufficient parameters.

yezhengmao1 commented 2 months ago

CI pass: https://github.com/TUDB-Labs/mLoRA/actions/runs/9810175285/job/27089744165