search

sooftware / conformer

[Unofficial] PyTorch implementation of "Conformer: Convolution-augmented Transformer for Speech Recognition" (INTERSPEECH 2020)
Apache License 2.0
958 stars 175 forks source link

Example of how to train conformer #26

Closed CSLujunyu closed 3 years ago

CSLujunyu commented 3 years ago

Hello, thanks for sharing this nice project. Could you provide some example on how to train conformer model with rnnt loss?

sooftware commented 3 years ago

Sooner or later, a library will be unveiled to train multiple models, including the conformer transducer. I intend to release it as early as this week. I'll leave a comment here after I reveal it.

mjurkus commented 3 years ago

Will this solve this issue I had here https://github.com/sooftware/KoSpeech/issues/119 ?

sooftware commented 3 years ago

@mjurkus I think you should -1 at target_lengths like target_lengths -= 1

sooftware commented 3 years ago

I'm now implementing the code with pytorch lightning, practically completing it and fixing it while looking for bugs. I think it would be a good reference for you.

mjurkus commented 3 years ago

Amazing! I also used Pytorch Lightning. Everything worked except that part. I'll look into your suggestion regarding target_lengths

sooftware commented 3 years ago

@mjurkus @CSLujunyu I release new library openspeech. This repo contains conformed training.