search

OpenGVLab / Ask-Anything

[CVPR2024 Highlight][VideoChatGPT] ChatGPT with video understanding! And many more supported LMs such as miniGPT4, StableLM, and MOSS.
https://vchat.opengvlab.com/
MIT License
2.85k stars 230 forks source link

Suggestion about MVBench #197

Closed LiJiaqi96 closed 1 week ago

LiJiaqi96 commented 1 week ago

Hi, I notice that multiple submissions of the same group to MVBench would result in multiple (rather than one) records on the leaderboard. Is it possible to make some updates for this issue, in order that the rank on the leaderboard can be more reasonable? Maybe the leaderboard display the best result of the same model name could be a good choice:)

yinanhe commented 1 week ago

Thanks for raising a very good question, we actually reserve the revision model name block in the submission page, if the user want to update the number in the origin list, he/she can consider filling this field. We will also clean the repeated data regularly.

LiJiaqi96 commented 1 week ago

Thanks for your efforts!