search

MMMU-Benchmark / MMMU

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
https://mmmu-benchmark.github.io/
Apache License 2.0
327 stars 21 forks source link

No (supported) data files found in /MMMU/MMMU #20

Closed Xiaolong-RRL closed 6 months ago

Xiaolong-RRL commented 6 months ago

Hi, I am try to load your dataset with the provided command:

from datasets import load_dataset
sub_dataset = load_dataset("/data/datasets/MMMU", "Accounting")

However, one error reports as:

Exception has occurred: DataFilesNotFoundError
No (supported) data files found in /MMMU/MMMU
  File "/data/project/bunny/test_eval_mmmu.py", line 4, in <module>
    sub_dataset = load_dataset("/MMMU/MMMU", "Accounting")
datasets.exceptions.DataFilesNotFoundError: No (supported) data files found in /MMMU/MMMU

Can u check it?

drogozhang commented 6 months ago

@NipElement

NipElement commented 6 months ago

Hi, you can load dataset by:

from datasets import load_dataset
sub_dataset = load_dataset('MMMU/MMMU', 'Accounting')

or you can load specified split with:

from datasets import load_dataset
sub_dataset_val = load_dataset('MMMU/MMMU', 'Accounting', split='validation')

If still have problem, please update your datasets pkg😆

Xiaolong-RRL commented 6 months ago

Thanks, it works!