modelscope / swift

ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 35+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)

https://github.com/modelscope/swift/blob/main/docs/source/LLM/index.md

Apache License 2.0

2.13k stars 205 forks source link

Fix glm4v batch_size>1 #1223

Closed Jintao-Huang closed 4 days ago

Jintao-Huang commented 4 days ago

PR type

[x] Bug Fix
[ ] New Feature
[ ] Document Updates
[ ] More Models or Datasets Support

FIX https://github.com/modelscope/swift/issues/1219, https://github.com/modelscope/swift/issues/1216, https://github.com/THUDM/GLM-4/issues/233