search

open-compass / MMBench

Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
Apache License 2.0
163 stars 10 forks source link

How to download the entire leaderboard? #18

Closed zhimin-z closed 10 months ago

zhimin-z commented 11 months ago

Including all the evaluation results shown on the webpage?

YuanLiuuuuuu commented 11 months ago

Sorry for the late reply. Do you want to download all the results on the webpage as one file?

zhimin-z commented 11 months ago

Sorry for the late reply. Do you want to download all the results on the webpage as one file?

Thanks for your reply. Is that possible? I see some other leaderboards provide a button to download the file as csv for individual panels.

YuanLiuuuuuu commented 11 months ago

Currently, we do not support such feature, and will have a discussion about the possibility to add it.

kennymckormick commented 10 months ago

Hi, @zhimin-z , we have made the leaderboard downloadable as a single json file. Check the homepage of VLMEvalKit for the download link: https://github.com/open-compass/VLMEvalKit/blob/739915bd3a17de825e90d9106b568166b7d4806e/README.md?plain=1#L16.

zhimin-z commented 10 months ago

Hi, @zhimin-z , we have made the leaderboard downloadable as a single json file. Check the homepage of VLMEvalKit for the download link: https://github.com/open-compass/VLMEvalKit/blob/739915bd3a17de825e90d9106b568166b7d4806e/README.md?plain=1#L16.

This is no longer accessible... @kennymckormick