InternLM / InternEvo

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
https://internevo.readthedocs.io/zh-cn/latest/?badge=latest
Apache License 2.0
311 stars 52 forks source link

[Feature] how to finetuning lora #286

Open wen020 opened 4 months ago

wen020 commented 4 months ago

Describe the feature

Does InternEvo support fine-tuning using LoRA?

Will you implement it?

gaoyang07 commented 3 months ago

Will do. Stay tuned.