Use PEFT or Full-parameter to finetune 400+ LLMs or 100+ MLLMs. (LLM: Qwen2.5, Llama3.2, GLM4, Internlm2.5, Yi1.5, Mistral, Baichuan2, DeepSeek, Gemma2, ...; MLLM: Qwen2-VL, Qwen2-Audio, Llama3.2-Vision, Llava, InternVL2, MiniCPM-V-2.6, GLM4v, Xcomposer2.5, Yi-VL, DeepSeek-VL, Phi3.5-Vision, ...)
4.06k
stars
358
forks
source link
怎么从零开始(from scratch)训练多模态大模型? #2097
Open
ChingKwanCheung opened 1 month ago
请问怎么使用swift框架复现开源多模态大模型的构建过程(例如internvl2,qwen2-vl),命令行参数要怎么配置,是否有最佳实践?