Niels here from the open-source team at Hugging Face. It's great to see you're releasing models + data on HF, I discovered your work through the paper page: https://huggingface.co/papers/2406.07057 (feel free to claim the paper so that it appears at your HF account!).
However there are a couple of things which could improve the discoverability of leaderboard + dataset, which I've listed below.
Gated access to dataset
Would you be interested in making your dataset available on the hub?
This way, people could load the dataset in 2 lines of code, like so (assuming they got access through the manual approval and are logged in with their HF account):
from datasets import load_dataset
dataset = load_dataset("thu-ml/mmtrust-eval")
Hi,
Niels here from the open-source team at Hugging Face. It's great to see you're releasing models + data on HF, I discovered your work through the paper page: https://huggingface.co/papers/2406.07057 (feel free to claim the paper so that it appears at your HF account!).
However there are a couple of things which could improve the discoverability of leaderboard + dataset, which I've listed below.
Gated access to dataset
Would you be interested in making your dataset available on the hub?
We support gated access which requires people to fill in their contact information (similar to how models like LLaMa-3 are gated): https://huggingface.co/docs/hub/en/datasets-gated
This way, people could load the dataset in 2 lines of code, like so (assuming they got access through the manual approval and are logged in with their HF account):
Leaderboard as an app on Spaces
Secondly, if you're interested, the leaderboard could be hosted on Spaces using Streamlit/Gradio/Docker app. See here for more info: https://huggingface.co/docs/hub/en/spaces-overview
Let me know if you need any help regarding this!
Cheers,
Niels ML Engineer @ HF 🤗