search

open-compass / VLMEvalKit

Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.34k stars 188 forks source link

[Model] mPLUG-Owl3 Added #403

Closed SYuan03 closed 2 months ago

SYuan03 commented 2 months ago

Link: https://huggingface.co/mPLUG/mPLUG-Owl3-7B-240728

  1. On RealWorldQA, achieve Overall 0.48627450980392156 image
  2. add support in tools [version map]

More:

  1. The chat_inner interface has not been completed.
kennymckormick commented 2 months ago

@SYuan03 Please resolve the comments and fix the conflicts.