MMStar-Benchmark MMStar issues - Githubissues

MMStar-Benchmark / MMStar

This repo contains evaluation code for the paper "Are We on the Right Way for Evaluating Large Vision-Language Models"

https://mmstar-benchmark.github.io

131 stars 2 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Is there any code not using VLMEvalKit?

#11 URRealHero opened 1 month ago
0
How to contribute to the mmstar leaderboard？

#10 lucasjinreal opened 1 month ago
0
Eval Error: ZeroDivisionError: float division by zero

#9 GasolSun36 opened 2 months ago
0
Dataset Metadata

#8 LengSicong opened 3 months ago
0
Qwen-VL-Chat doesn't follow prompt

#7 RifleZhang opened 4 months ago
1
The calculation of ML metrics is not quite appropriate.

#6 echo840 closed 4 months ago
1
Update README.md

#5 kennymckormick closed 4 months ago
0
How are the values of MG and ML calculated?

#4 mary-0830 closed 4 months ago
3
Great work

#3 gordonhu608 closed 4 months ago
1
Error when inference

#2 Cuiunbo closed 4 months ago
1
any plan to release the dataset in the near future?

#1 demoninpiano closed 4 months ago
1