SpeechColab / Leaderboard

SpeechIO Leaderboard: a large, robust, comprehensive, benchmarking platform for Automatic Speech Recognition.
434 stars 61 forks source link

why GIGASPEECH dev & test doesn't match the report ? #77

Open dahu1 opened 11 months ago

dahu1 commented 11 months ago

我在gigaspeech 上看到k2_gigaspeech模型的效果是10.40 / 10.51 ,如图所示:

image

而且我看k2 gigaspeech的测试结果 也是这个,如图所示:

image

但是为什么在Leaderboard上的结果对不上呢?如图所示: image

dophist commented 9 months ago

Because this leaderboard applies far more advanced text normalizations than an academic baseline recipe.