asappresearch / slue-toolkit

A toolkit for Spoken Language Understanding Evaluation (SLUE) benchmark. Refer paper https://arxiv.org/abs/2111.10367 for more details. Official website: https://asappresearch.github.io/slue-toolkit/
https://asappresearch.github.io/slue-toolkit/
MIT License
62 stars 16 forks source link

Fix pipeline eval #8

Closed ankitapasad closed 2 years ago

ankitapasad commented 2 years ago

Space separating "'s" in the entity phrases in the ASR output before evaluating it for NER. This is in accordance with the slue voxpopuli NER data processing, which might not necessarily be followed by the LM used for ASR decoding.

And minor bug fixes.