OpenGVLab / MMT-Bench

ICML'2024 | MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGI
81 stars 2 forks source link

How to get all 30K data #7

Open 336655asd opened 2 months ago

336655asd commented 2 months ago

Thanks for your great job! I downloaded the dataset from your huggingface hub, but the data size is 3K not 30K. I noticed that the split is "VAL" in MMT-Bench_VAL.tsv. So where can I get the full dataset, or do you have any plans to release all the data?

KainingYing commented 2 months ago

Thanks for your attention~

We will upload the full set (30K) in these two days. For the full set, we will host the evaluation on EvalAI. Stay tuned!