search

punica-ai / punica

Serving multiple LoRA finetuned LLM as one
https://arxiv.org/abs/2310.18547
Apache License 2.0
883 stars 40 forks source link

Choosing adapters on inference #21

Closed BaiStone2017 closed 6 months ago

BaiStone2017 commented 7 months ago

Hi, thanks for the great work. Is it possible to use certain adapters while inferring?

abcdabcd987 commented 7 months ago

Can you clarify?

abcdabcd987 commented 6 months ago

Close for inactivity. Feel free to reopen.