THUDM / ChatGLM2-6B

ChatGLM2-6B: An Open Bilingual Chat LLM | 开源双语对话语言模型
Other
15.68k stars 1.85k forks source link

[单卡支持多个Lora] <如何在微调的时候支持多个Lora 同时训练> #624

Open merlintang opened 10 months ago

merlintang commented 10 months ago

Is your feature request related to a problem? Please describe.

No response

Solutions

we provide a solution base on reusing the base model to fine tune multiple chatglm. we hope to contribute to the community. more details see here: https://github.com/TUDB-Labs/multi-lora-fine-tune, any comments are welcome

Additional context

No response