issues
search
open-compass
/
MMBench
Official Repo of "MMBench: Is Your Multi-modal Model an All-around Player?"
Apache License 2.0
163
stars
10
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
无法访问https://mmbench.opencompass.org.cn/mmbench-submission
#44
Purshow
closed
2 weeks ago
2
Error when Your excel file can not be successfully loaded by `pd.read_excel`, please double check and submit again
#43
jiangyitong
opened
4 weeks ago
1
Math dataset
#42
moghadas76
opened
1 month ago
1
The evaluation service of the website is blocked, and it is not possible to upload evaluation file
#41
liyang-7
closed
1 month ago
0
Not able to upload .xlsx submission file for MMBench_TEST_EN. Showing upload error.
#40
rodosingh
opened
1 month ago
1
mmbench-v1.1
#39
aoji0606
closed
3 weeks ago
4
[dataset] The download link[VLMEvalKit & Legacy] seems to be broken.
#38
YunfengLiu
closed
1 month ago
2
Confusion about mmbench testset v1 vs v1.1
#37
khiemkhanh98
closed
1 month ago
3
Update README.md
#36
kennymckormick
closed
2 months ago
0
您好，请问1.1版本更新的具体内容是什么？
#35
hl0737
closed
2 months ago
2
Update README.md
#34
kennymckormick
closed
5 months ago
0
where is the images in dataset?
#33
ALR-alr
closed
2 months ago
5
V1.1 Test 评测
#32
Sync-yxh
closed
5 months ago
6
About the number of dataset.
#31
zhouqiji
closed
5 months ago
1
difference between "lmms-lab/MMBench" in huggingface
#30
Coobiw
closed
6 months ago
2
Consult the 'circle eval' code
#29
Baiqi-Li
closed
5 months ago
1
什么时候能测评一下llama 3
#28
ytcheng
closed
5 months ago
1
可以放出gpt4v的L3分数吗？
#27
shipengai
closed
5 months ago
1
Unable to log in to the mmbench website
#26
jdy18
closed
8 months ago
0
Evaluation server return 0 score
#25
czczup
closed
9 months ago
5
Scores of L-3 Abilities on the Leaderboard
#24
TsuTikgiau
closed
5 months ago
2
How can i download the image?
#23
SCAUapc
closed
10 months ago
2
Where is the report or paper on CCBench?
#22
zhimin-z
closed
10 months ago
2
Evaluation returns all zeros
#21
simplelifetime
closed
10 months ago
6
An error in CCBench file
#20
schuper
closed
5 months ago
2
binascii.Error: Incorrect padding
#19
Isaachhh
closed
10 months ago
1
How to download the entire leaderboard?
#18
zhimin-z
closed
10 months ago
5
Still in the queue in two total days
#17
simplelifetime
closed
5 months ago
1
[BUG] A potential bug on the evaluation server in handling submissions with the same file name but different contents
#16
MengLcool
closed
10 months ago
2
Is CCBench evaluation metrics accuracy?
#15
zhimin-z
closed
11 months ago
1
The benchmark website is always broken
#14
simplelifetime
closed
1 year ago
0
请问为何MMBench (CN)和CCBench下没有闭源leaderboards啊？
#13
zhimin-z
closed
10 months ago
1
Problem about Numbers of MMBench
#12
1649759610
closed
10 months ago
2
Update README.md
#11
kennymckormick
closed
1 year ago
0
What is the difference between `MMBench test`, `MMBench dev`, `MMBench test (CN)`, `MMBench dev (CN)`, `CCBench dev`?
#10
zhimin-z
closed
5 months ago
3
测评很慢，测了一晚上都没出结果...
#9
SihengLi99
closed
11 months ago
2
The Circular Evaluation Strategy && LLM-based Choice Extractors
#8
yyy809643573
closed
11 months ago
1
[Doc] Update README.md
#7
kennymckormick
closed
11 months ago
0
评测集版本问题
#6
buptlihang
closed
11 months ago
1
[Doc] Add qualitative examples
#5
kennymckormick
closed
1 year ago
0
Confused by online results
#4
FeipengMa6
closed
1 year ago
0
[NewRelease] Update and Provide a new CN version
#3
kennymckormick
closed
1 year ago
0
Do you have any plan to support few-shot evaluation?
#2
wjfwzzc
closed
11 months ago
1
[Feature]: Update README
#1
YuanLiuuuuuu
closed
1 year ago
0