Release dataset on Hugging Face

[NielsRogge]

Hello @NizarIslah 🤗

I'm Niels and work as ML engineer at Hugging Face. I discovered your work as it got featured in AK's daily papers: https://huggingface.co/papers/2411.05830. The paper page lets people discuss about your paper and lets them find artifacts about it (your dataset for instance) you can also claim the paper as yours which will show up on your public profile at HF.

Would you like to host the datasets on https://huggingface.co/datasets? I see you're using Github for it. Hosting on Hugging Face will give you more visibility, and will also allow people to do:

from datasets import load_dataset

dataset = load_dataset("your-hf-org/your-dataset")

If you're down, leaving a guide here: https://huggingface.co/docs/datasets/loading#csv.

Besides that, there's the dataset viewer which allows people to quickly explore the first few rows of the data in the browser.

After uploaded, we can also link the datasets to the paper page (read here) so people can discover your work.

What do you think?

Kind regards,

Niels

[digantamisra98]

@NielsRogge Yes we will consider adding this as a HF dataset for better support eventually after we have ironed out the eval pipeline. Thanks for the suggestion.