请问VLM的自定义评测集怎么做？

modelscope / evalscope

A streamlined and customizable framework for efficient large model evaluation and performance benchmarking

https://evalscope.readthedocs.io/en/latest/

Apache License 2.0

227 stars 30 forks source link

Closed stay-leave closed 2 weeks ago

stay-leave commented 2 months ago

大佬您好！没找到关于这个的教程，可以指点下吗？我的想法是先用swift的infer，然后自己写指标计算代码，不知道这个项目有没有便捷方式

Yunnglin commented 2 months ago

VLM自定义评测集目前还没支持，后续会加上的

Yunnglin commented 2 months ago