search

MMMU-Benchmark / MMMU

This repo contains evaluation code for the paper "MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI"
https://mmmu-benchmark.github.io/
Apache License 2.0
327 stars 21 forks source link

How to convert images and prompt to the HF parquet? #25

Closed Gumpest closed 3 months ago

Gumpest commented 3 months ago

Could you please provide the conversion script?

drogozhang commented 3 months ago

This is the file I followed to upload local files to huggingface https://github.com/sayakpaul/instruct-pix2pix-dataset Not sure how heavily @NipElement edited for MMMU case. Could you answer this question? @NipElement

NipElement commented 3 months ago

You can use the .push_to_hub() function to upload a dataset to HF. It will automatically convert it into a parquet file (remember to update your datasets version).