search

TeaPoly / CTC-OptimizedLoss

Computes the MWER (minimum WER) Loss with CTC beam search. Knowledge distillation for CTC loss.
57 stars 10 forks source link

MWER - Pytorch #3

Closed zw76859420 closed 1 year ago

zw76859420 commented 1 year ago

Thank you very much for share the code. Is there a pytorch version of mwer loss?

TeaPoly commented 1 year ago

CE Minimum Word Error Rate Training loss (MWER) based on negative sampling strategy (from ): https://gist.github.com/TeaPoly/234429e6c2d74d10fcb4987bc541d528

CTC based MWER based on PyTorch by @Mddct (I have not verified it): https://github.com/Mddct/losses

zw76859420 commented 1 year ago

Thank you very much

TeaPoly commented 1 year ago

Thank you very much for share the code. Is there a pytorch version of mwer loss?

You can try K2 based MWERLoss. https://github.com/TeaPoly/CTC-OptimizedLoss/blob/main/torch/mwer_loss.py