does the Loras all trained start from a base model.

punica-ai / punica

Serving multiple LoRA finetuned LLM as one

https://arxiv.org/abs/2310.18547

Apache License 2.0

883 stars 40 forks source link

Closed lucasjinreal closed 7 months ago

lucasjinreal commented 7 months ago

does the Loras all trained start from a base model.

abcdabcd987 commented 7 months ago

yes. LoRA models need to share the same base model.