asappresearch / slue-toolkit

A toolkit for Spoken Language Understanding Evaluation (SLUE) benchmark. Refer paper https://arxiv.org/abs/2111.10367 for more details. Official website: https://asappresearch.github.io/slue-toolkit/
https://asappresearch.github.io/slue-toolkit/
MIT License
59 stars 15 forks source link

How long does it take to get back test scores? I have submitted my test predictions for 3 days and haven't got back. #42

Open Emmyphung opened 6 months ago

Emmyphung commented 6 months ago

Hi, I'm writing a paper for Interspeech 2024 and want to use SLUE datasets for benchmarking. How long does it take to get back test scores? I have submitted my test predictions for 3 days and haven't got back. I'm aiming to get back all results by Wed Feb 28 - who should I reach out to?

sshon-asapp commented 6 months ago

Hi.

All slue dataset test set labels were released in huggingface dataset.

https://huggingface.co/datasets/asapp/slue https://huggingface.co/datasets/asapp/slue-phase-2

Sorry for not mentioned in this repository. I will update readme. Thank you.

Emmyphung commented 6 months ago

Thank you so much! this is very helpful!