punica-ai / punica

Serving multiple LoRA finetuned LLM as one
https://arxiv.org/abs/2310.18547
Apache License 2.0
883 stars 40 forks source link

Support qwen? #38

Open cgq0816 opened 5 months ago

cgq0816 commented 5 months ago

Thanks!

Xingxiangrui commented 4 months ago

+1 for this. Please Support More model structures.