lxa9867 / r2bench

[ECCV 2024] R2-Bench: Benchmarking the Robustness of Referring Perception Models under Perturbations
10 stars 0 forks source link

Release benchmark on Hugging Face #1

Open NielsRogge opened 4 weeks ago

NielsRogge commented 4 weeks ago

Hello @lxa9867 🤗

I'm Niels and I work on computer vision at Hugging Face. I see your paper is accepted as ECCV Poster, congratulations! I will index it here https://huggingface.co/papers/2403.04924 at paper pages. The paper page lets people discuss about your paper and lets them find artifacts about it (your dataset for instance) you can also claim the paper as yours which will show up on your public profile at HF.

Would you like to host the datasets on https://huggingface.co/datasets? I see you're using Google Drive for it. Hosting on Hugging Face will give you more visibility, and will also allow people to do:

from datasets import load_dataset

dataset = load_dataset("your-hf-org/r2-bench")

If you're down, leaving a guide here: https://huggingface.co/docs/datasets/image_dataset. We also support Webdataset, useful for video datasets: https://huggingface.co/docs/datasets/en/loading#webdataset.

Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.

After uploaded, we can also link the datasets to the paper page (read here) so people can discover your work.

What do you think?

lxa9867 commented 3 weeks ago

Hi Niels,

Thanks for reaching out. It is a good idea! We will do that after the iclr ddl. Thanks.