search

hyperaudio / stt-benchmarking

a place to discuss and create an independent speech-to-text benchmarking tool
5 stars 1 forks source link

R1 - Return WER #2

Open maboa opened 5 years ago

maboa commented 5 years ago

This tests for words only, compared to the reference transcript, using the formula in https://en.wikipedia.org/wiki/Word_error_rate.

EyalLavi commented 5 years ago

This library for WER may be useful: http://www1.icsi.berkeley.edu/Speech/docs/sctk-1.2/sclite.htm

bwang482 commented 5 years ago

A short paper published in INTERSPEECH this year: https://www.isca-speech.org/archive/Interspeech_2018/pdfs/3003.pdf https://github.com/Franck-Dernoncourt/ASR_benchmark

Compared a bunch of online APIs for 5 datasets. Speechmatics seems to perform pretty good in comparison.