search

OpenBMB / VisCPM

[ICLR'24 spotlight] Chinese and English Multimodal Large Model Series (Chat and Paint) | 基于CPM基础模型的中英双语多模态大模型系列
1.06k stars 93 forks source link

finetune #15

Closed nikeaddidaslining closed 11 months ago

nikeaddidaslining commented 1 year ago

Hello！ i want to ask about how to finetuning with lora？

Cuiunbo commented 11 months ago

If you need to quickly and cost-effectively fine-tune VisCPM, you can refer to the finetune code in the CPMbee repository. In it, opendelta is used for LoRA-related operations. Below is a link you might want to check out: https://github.com/OpenBMB/CPM-Bee/blob/main/src/finetune_cpm_bee.py