modelscope / swift

ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 35+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)

https://github.com/modelscope/swift/blob/main/docs/source/LLM/index.md

Apache License 2.0

2.13k stars 205 forks source link

support vllm & multimodal #1229

Open Jintao-Huang opened 3 days ago

Jintao-Huang commented 3 days ago

PR type

[ ] Bug Fix
[x] New Feature
[ ] Document Updates
[ ] More Models or Datasets Support

support vllm & multimodal (infer & deploy)