search

facebookresearch / seamless_communication

Foundational Models for State-of-the-Art Speech and Text Translation
Other
10.91k stars 1.06k forks source link

no audio generation from unity.cpp? #242

Open cocktailpeanut opened 11 months ago

cocktailpeanut commented 11 months ago

I assumed unity.cpp would be on feature parity with the original engine, but looks like it only generates the translated text, and not the audio.

Is this something that will be made available in the future? Or should we be just using a 3rd party tts system to feed the translation in and get the audio?

gwenzek commented 10 months ago

Thanks for your interest. ATM, unity.cpp only supports the text decoder. Our goal is to implement the full model, but speech generation is a bit more complicated than text generation.