X-PLUG / mPLUG-Owl

mPLUG-Owl: The Powerful Multi-modal Large Language Model Family
https://www.modelscope.cn/studios/damo/mPLUG-Owl
MIT License
2.25k stars 171 forks source link

ms-swift对于mPLUG-Owl2和mPLUG-Owl2.1微调(finetune)的支持 #217

Open Jintao-Huang opened 5 months ago

Jintao-Huang commented 5 months ago

mPLUG-Owl仓库本身已经提供了非常优秀的微调脚本: https://github.com/X-PLUG/mPLUG-Owl/tree/main/mPLUG-Owl2/scripts.

ms-swift多模态大模型微调框架集成了mPLUG-Owl2和mPLUG-Owl2.1的推理与微调, 并书写了最佳实践: https://github.com/modelscope/swift/blob/main/docs/source/Multi-Modal/mplug-owl2%E6%9C%80%E4%BD%B3%E5%AE%9E%E8%B7%B5.md

如果有感兴趣的小伙伴, 可以来使用😊

The mPLUG-Owl2 repository itself provides excellent fine-tuning scripts: https://github.com/X-PLUG/mPLUG-Owl/tree/main/mPLUG-Owl2/scripts.

The ms-swift multimodal large model fine-tuning framework integrates the inference and fine-tuning of mPLUG-Owl2 and mPLUG-Owl2.1, and documents the best practices: https://github.com/modelscope/swift/blob/main/docs/source/Multi-Modal/mplug-owl2%E6%9C%80%E4%BD%B3%E5%AE%9E%E8%B7%B5.md

If any interested individuals, feel free to use it! 😊