issues
search
open-compass
/
VLMEvalKit
Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 40+ benchmarks
https://huggingface.co/spaces/opencompass/open_vlm_leaderboard
Apache License 2.0
1.08k
stars
154
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
About Tablevqabench score
#442
mary-0830
opened
3 weeks ago
1
[Doc] Add Contributor 2409
#441
kennymckormick
closed
3 weeks ago
0
[Support] update llava-onevision with video generation support
#440
FangXinyu-0913
closed
3 weeks ago
1
The performance of Cambrian-1-8B.
#439
Haochen-Wang409
closed
3 weeks ago
2
Deploy local LLM as judge llm on VLLM tools,but it didn't use it to evaluate
#438
BrenchCC
closed
3 weeks ago
1
[Benchmark] Support MathVerse
#437
CaraJ7
closed
4 days ago
0
cannot use gpt-4v.
#436
yansuoyuli
closed
3 weeks ago
1
cannot use Gemini
#435
yansuoyuli
closed
2 weeks ago
3
[Benchmark] mmniah
#434
ttguoguo3
opened
3 weeks ago
0
mmniah
#433
ttguoguo3
closed
3 weeks ago
0
[Fix] Align LLAVA-OneVision Model Loading with Official Implementation
#432
Mor-Li
closed
3 weeks ago
1
[Dataset] Add GQA TestDev Balanced Split to Dataset
#431
Mor-Li
closed
3 weeks ago
0
[Benchmark] Supported HR-Bench
#430
DreamMr
closed
2 weeks ago
0
[Model] RBDash Added
#429
anzhao920
closed
3 weeks ago
17
[Minor] Fix suffix for LLaVABench in tools.py
#428
SYuan03
closed
2 weeks ago
1
[Model] add support for PLLaVA Series
#427
FangXinyu-0913
closed
4 weeks ago
0
convert base64 images -> disk to memory
#426
lerogo
closed
4 weeks ago
0
[Fix] Add packages to `requirements.txt` to Resolve Import Errors in `VLMEvalKit`
#425
Mor-Li
closed
4 weeks ago
0
OpenVLM Leaderboard分类问题
#424
bowcr
closed
4 weeks ago
0
[Model] qwen2vl Added
#423
kq-chen
closed
2 weeks ago
2
[Minor] Fix path problem in tools.py && Add log
#422
SYuan03
closed
4 weeks ago
0
修改结果路径
#421
helloworld01001
closed
4 weeks ago
0
[Minor] Fix MMAlaya2
#420
kennymckormick
closed
4 weeks ago
0
openai.InternalServerError: Bad Gateway
#419
serser
closed
4 weeks ago
2
mme-realworld
#418
yfzhang114
closed
3 weeks ago
0
The Dataset Names
#417
lixu6-alt
closed
3 weeks ago
2
[Feature] Update output directory configuration to prevent tracking evaluation results
#416
Mor-Li
closed
1 month ago
0
上传新的benchmark
#415
ttguoguo3
closed
3 weeks ago
1
[Benchmark] Add A-OKVQA dataset
#414
sun-hailong
closed
1 month ago
0
How to evaluate my own model
#413
lixu6-alt
closed
3 weeks ago
4
Please provide the dataset file or download script
#412
lerogo
closed
4 weeks ago
15
cogvlm2-llama3-chat-19B设置device_map="auto"报错
#411
Michel-liu
closed
1 month ago
2
[Model] Xgen MM
#410
amitbcp
closed
3 weeks ago
0
create new benchmark
#409
yansuoyuli
closed
3 weeks ago
2
Update tools.py
#408
SYuan03
closed
1 month ago
0
loosen dependencies
#407
naoto0804
closed
1 month ago
1
ChatAPI - ERROR - HTTPSConnectionPool(host='api.openai.com', port=443): Max retries exceeded with url: /v1/chat/completions (Caused by ProxyError('Unable to connect to proxy', NewConnectionError('<urllib3.connection.HTTPSConnection object at 0x7f481233f640>: Failed to establish a new connection: [Errno 111] Connection refused')))
#406
yansuoyuli
opened
1 month ago
3
There is no answer field in DocVQA_TEST
#405
palewithout
closed
1 month ago
1
Cannot Reproduce Results of LLaVA-1.5 on MMBench_DEV_CN
#404
ppalantir
closed
1 week ago
4
[Model] mPLUG-Owl3 Added
#403
SYuan03
closed
2 weeks ago
1
配置数据集的vlmeval/utils/dataset_config.py文件不存在
#402
scl-01
closed
1 month ago
4
[Benchmark] support TableVQABench
#401
hkunzhe
closed
3 weeks ago
6
Local dev
#400
zhaop-l
closed
1 month ago
0
MMAlaya2 Added
#399
bingwork
closed
1 month ago
0
CMMMU数据集支持
#398
DietDietDiet
opened
1 month ago
3
[Updated] Updated readme for OmChat
#397
mary-0830
closed
1 month ago
0
[Model] Phi3.5 Added
#396
amitbcp
closed
1 month ago
0
[Model] Support Parrot model
#395
sun-hailong
closed
1 month ago
0
[Model] Add Support for OmChat Model
#394
mary-0830
closed
1 month ago
3
Fix mathvista Idefics2
#393
HugoLaurencon
closed
1 month ago
9
Previous
Next