Release data on Hugging Face

[NielsRogge]

Hi @Wusiwei0410,

Niels here from the open-source team at Hugging Face. I discovered your work through the daily papers on Hugging Face: https://huggingface.co/papers/2410.13639. The paper page lets people discuss about your paper and lets them find artifacts about it (your data for instance) you can also claim the paper as yours which will show up on your public profile at HF.

It'd be great to make the data available on the 🤗 hub, we can add tags so that people find them when filtering https://huggingface.co/datasets, so that people can do:

from datasets import load_dataset

dataset = load_dataset("your-hf-username-or-organization/your-dataset")

See here for a guide: https://huggingface.co/docs/datasets/loading#json.

There's then also the dataset viewer which allows people to see the first few rows in the browser: https://huggingface.co/docs/hub/en/datasets-viewer.

This would make the dataset easier accessible, and also discoverable. We can then also link the dataset to the paper page.

Let me know if you're interested/need any help!

Kind regards,

Niels

[Wusiwei0410]

Hi @NielsRogge ,

Thank you so much for your attention to our work and for the valuable suggestions you've provided.

I have already claimed the paper on Hugging Face.

As for uploading the dataset to Hugging Face Datasets, I will organize the data and upload it to Hugging Face soon. I'll also include instructions in this repo on how to load the data, and I'll notify you once we upload it on HF.

Best regards, Siwei