search

asappresearch / slue-toolkit

A toolkit for Spoken Language Understanding Evaluation (SLUE) benchmark. Refer paper https://arxiv.org/abs/2111.10367 for more details. Official website: https://asappresearch.github.io/slue-toolkit/
https://asappresearch.github.io/slue-toolkit/
MIT License
62 stars 16 forks source link

Dataset Indexing Issue #37

Open ming024 opened 1 year ago

ming024 commented 1 year ago

In the data collator of AddLabelDataset

https://github.com/asappresearch/slue-toolkit/blob/ea0939b0c9da80f19dda35af26e117834fb20ec6/slue_toolkit/fairseq_addon/data/add_label_dataset.py#L28-L33

If self.dataset.collater sort the collated data, target and collated will become mismatched.