Speech generation using Mamba

state-spaces / mamba

Mamba SSM architecture

Apache License 2.0

11.55k stars 946 forks source link

Speech generation using Mamba #264

Open coding-sharks opened 3 months ago

coding-sharks commented 3 months ago

I am interested in “How to use mamba to generate audio”. One of amazing things is the long sequence attention, i wanna know whether mamba can be used in TTS, so that it does not need the Vocoder. Maybe it will create a more "End-to-End" TTS?

eschmidbauer commented 1 month ago

a related experiment can be found here