search

wenet-e2e / wenet

Production First and Production Ready End-to-End Speech Recognition Toolkit
https://wenet-e2e.github.io/wenet/
Apache License 2.0
4.08k stars 1.07k forks source link

[transformer] refactor mqa repeat #2497

Closed Mddct closed 5 months ago

Mddct commented 5 months ago

1 消除重复代码 2 mqa的时候 head==1， 利用广播，不需要repeat， mga采用repeat