issues
search
open-compass
/
VLMEvalKit
Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.34k
stars
188
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
support MiniMonkey model
#457
white2018
closed
2 months ago
0
mme-realworld-score
#456
yfzhang114
closed
2 months ago
0
Input length of input_ids is 0, but max_length is set to -2009.
#455
wangli68
closed
2 days ago
1
评测时PermissionError: [Errno 13] Permission denied
#454
40459447
closed
1 month ago
1
测试程序经常中断
#453
HZWHH
closed
2 months ago
3
mme-real-world options
#452
yfzhang114
closed
2 months ago
3
[Model] add qwen2vl api and fix prompt
#451
kq-chen
closed
2 months ago
0
slime
#450
yfzhang114
closed
2 months ago
2
MME-RealWorld Not Supported.
#449
Haochen-Wang409
closed
2 months ago
2
qwen2-vl-7B
#448
yfzhang114
closed
2 months ago
1
[Feature] Support custom_prompt for API models
#447
kennymckormick
closed
2 months ago
0
Support TextOCR, DocVQA in GodBench - initial
#446
WuHaohui1231
closed
2 months ago
0
[Benchmark] CRPE
#445
ttguoguo3
closed
2 months ago
0
Custom prompt for API?
#444
geweihgg
closed
2 months ago
1
Update eos_token for HF converted xgen-mm
#443
azshue
closed
2 months ago
0
About Tablevqabench score
#442
mary-0830
closed
1 month ago
1
[Doc] Add Contributor 2409
#441
kennymckormick
closed
2 months ago
0
[Support] update llava-onevision with video generation support
#440
FangXinyu-0913
closed
2 months ago
1
The performance of Cambrian-1-8B.
#439
Haochen-Wang409
closed
2 months ago
2
Deploy local LLM as judge llm on VLLM tools,but it didn't use it to evaluate
#438
BrenchCC
closed
2 months ago
1
[Benchmark] Support MathVerse
#437
CaraJ7
closed
1 month ago
0
cannot use gpt-4v.
#436
yansuoyuli
closed
2 months ago
1
cannot use Gemini
#435
yansuoyuli
closed
2 months ago
3
[Benchmark] mmniah
#434
ttguoguo3
opened
2 months ago
0
mmniah
#433
ttguoguo3
closed
2 months ago
0
[Fix] Align LLAVA-OneVision Model Loading with Official Implementation
#432
Mor-Li
closed
2 months ago
1
[Dataset] Add GQA TestDev Balanced Split to Dataset
#431
Mor-Li
closed
2 months ago
0
[Benchmark] Supported HR-Bench
#430
DreamMr
closed
2 months ago
0
[Model] RBDash Added
#429
anzhao920
closed
2 months ago
17
[Minor] Fix suffix for LLaVABench in tools.py
#428
SYuan03
closed
2 months ago
1
[Model] add support for PLLaVA Series
#427
FangXinyu-0913
closed
2 months ago
0
convert base64 images -> disk to memory
#426
lerogo
closed
2 months ago
0
[Fix] Add packages to `requirements.txt` to Resolve Import Errors in `VLMEvalKit`
#425
Mor-Li
closed
2 months ago
0
OpenVLM Leaderboard分类问题
#424
bowcr
closed
2 months ago
0
[Model] qwen2vl Added
#423
kq-chen
closed
2 months ago
2
[Minor] Fix path problem in tools.py && Add log
#422
SYuan03
closed
2 months ago
0
修改结果路径
#421
helloworld01001
closed
2 months ago
0
[Minor] Fix MMAlaya2
#420
kennymckormick
closed
2 months ago
0
openai.InternalServerError: Bad Gateway
#419
serser
closed
2 months ago
2
mme-realworld
#418
yfzhang114
closed
2 months ago
0
The Dataset Names
#417
lixu6-alt
closed
2 months ago
2
[Feature] Update output directory configuration to prevent tracking evaluation results
#416
Mor-Li
closed
2 months ago
0
上传新的benchmark
#415
ttguoguo3
closed
2 months ago
1
[Benchmark] Add A-OKVQA dataset
#414
sun-hailong
closed
2 months ago
0
How to evaluate my own model
#413
lixu6-alt
closed
2 months ago
4
Please provide the dataset file or download script
#412
lerogo
closed
2 months ago
16
cogvlm2-llama3-chat-19B设置device_map="auto"报错
#411
Michel-liu
closed
2 months ago
2
[Model] Xgen MM
#410
amitbcp
closed
2 months ago
0
create new benchmark
#409
yansuoyuli
closed
2 months ago
2
Update tools.py
#408
SYuan03
closed
2 months ago
0
Previous
Next