support squeezeformer model causal convolution and new versition Multi-head Attention

thu-spmi / CAT

A CRF-based ASR Toolkit

Apache License 2.0

325 stars 74 forks source link

support squeezeformer model causal convolution and new versition Multi-head Attention #87

Open NLPvv opened 5 months ago

NLPvv commented 5 months ago

support squeezeformer model link succeed to CAT
squeezeformer: squeezeformer implementation, please refer paper

NLPvv commented 3 months ago

support Causal Convolution
support New versition Multi-head Attention

RTF Comparison:

exp	RTF (FP32)	RTF (ORT C++ FP32)	RTF (ORT C++ INT8)
atten-ori	0.078	0.049	0.043
atten-new	0.062	0.033	0.019

OU-Zhijian commented 3 months ago

see above.

OU-Zhijian commented 3 months ago

需要把 squeezeformer 引入后的实验结果，报告一下

MultiHeadedSelfAttentionModule 修改需要更多的说明，

RTF Comparison: exp RTF (FP32) RTF (ORT C++ FP32) RTF (ORT C++ INT8) atten-ori 0.078 0.049 0.043 atten-new 0.062 0.033 0.019 这张表，需要贴到readme.md，并补充实验条件。否则不知道，什么条件下的实验。