search

mfranzon / dubbing-ai

Project for dubbing a video in many languages and with many different voices with the power of the AI
MIT License
20 stars 7 forks source link

Adding support for tortoise-tts to clone voices #7

Open shubham8550 opened 1 year ago

shubham8550 commented 1 year ago

https://github.com/neonbjb/tortoise-tts this tts support voice cloning I wonder if it's possible to modify this repo to use this tts ?

if anyone able to do this it will be great

--- Thanks in advance to whoever add this

mfranzon commented 1 year ago

Thanks for the suggestion :)

shubham8550 commented 1 year ago

emlo so any plans for this feature ?

ZhongQiyu commented 2 months ago

May I wonder if this only supports the fine-tuning procedures based on English corpus?

mfranzon commented 2 months ago

@shubham8550 this is a personal project, I really don't know if I'll have the time to add that feature @ZhongQiyu I think that the text-to-speech and the speech-to-text tools have the possibility to use different languages

shubham8550 commented 2 months ago

its okay, but just in case anyone attempts to add this i have some suggestions

dont use tortoise TTS its old now and not that good

instead new stuff like https://huggingface.co/myshell-ai/OpenVoice

or

https://huggingface.co/metavoiceio/metavoice-1B-v0.1

will be more suitable

again this feature is not small theres lots of things needs to be considered for it to work properly

mfranzon commented 2 months ago

Thank you very much for the additional information @shubham8550