Streaming summary mixing

SamsungLabs / SummaryMixing

This repository implements SummaryMixing, a simpler, faster and much cheaper replacement to self-attention for automatic speech recognition (see: https://arxiv.org/abs/2307.07421). The code is ready to be used with the SpeechBrain toolkit).

Other

86 stars 8 forks source link

Streaming summary mixing #10

Open TParcollet opened 2 months ago

TParcollet commented 2 months ago

This PR adds the summarymixing for streaming conformer. I think this PR should be merged before the SSL one #9.

Once both PR have been merged, we should create a clean branch on the internal repo.

To do:

[x] Test streaming models
[x] Test old models (check backward compatibility isn't broken).
[x] Clean the code.