search

modelscope / swift

ms-swift: Use PEFT or Full-parameter to finetune 250+ LLMs or 40+ MLLMs. (Qwen2, GLM4, Internlm2, Yi, Llama3, Llava, MiniCPM-V, Deepseek, Baichuan2, Gemma2, Phi3-Vision, ...)
https://github.com/modelscope/swift/blob/main/docs/source/LLM/index.md
Apache License 2.0
2.2k stars 213 forks source link

关于VLM的评测支持 #1117

Open Wimen opened 3 weeks ago

Wimen commented 3 weeks ago

文档里在评测模块提到支持两种pattern的评测集：选择题格式的CEval和问答题格式的General-QA，General-QA的格式暂不包含对图片的支持，请问后续计划加入VLM的评测功能吗

wangxingjun778 commented 3 weeks ago

计划6月下旬会增加多模态评测的支持。