search

shivammehta25 / Matcha-TTS

[ICASSP 2024] 🍵 Matcha-TTS: A fast TTS architecture with conditional flow matching
https://shivammehta25.github.io/Matcha-TTS/
MIT License
751 stars 98 forks source link

Conformer and Time Embeddings #58

Closed Subuday closed 9 months ago

Subuday commented 9 months ago

Why when Conformer is used, time embeddings are not incorporated?

shivammehta25 commented 9 months ago

Hello!

The conformer there was only experimental and was not used in the experiments or the paper. I only left it there to give an example in case somebody wants to switch it with something else (ex. Conformer, Mamba, RWKV etc. or whatever comes in the future)

I think you can modify how the timestep is added to the hidden states manually if you want to fix it.

Regards, Shivam

Subuday commented 9 months ago

Thanks.