search

TUDB-Labs / mLoRA

An Efficient "Factory" to Build Multiple LoRA Adapters
Apache License 2.0
271 stars 50 forks source link

Support model inference with adapters #240

Open LianxinGao opened 4 months ago

LianxinGao commented 4 months ago

Currently, we cannot use mLora for model inference with adapters; implementing a simple tool would be better.