NVIDIA / NeMo

A scalable generative AI framework built for researchers and developers working on Large Language Models, Multimodal, and Speech AI (Automatic Speech Recognition and Text-to-Speech)
https://docs.nvidia.com/nemo-framework/user-guide/latest/overview.html
Apache License 2.0
10.79k stars 2.26k forks source link

Can we add emotions to the produced audio? #9498

Open shivgit07 opened 1 week ago

shivgit07 commented 1 week ago

Hello,

I was just trying some combinations of Mel-Spectogram-Generators and Vocoders to produce different audio samples.

I was thinking if it was possible to make the produced audio sound more naturally by adding some kind of emotional embeddings in the Mel spectogram generator models. Or any other suitable approach to do this.

I am new to TTS so not sure if such thing is possible.

I would be highly grateful if somebody could help me out.

Thanks.