search

ThioJoe / Auto-Synced-Translated-Dubs

Automatically translates the text of a video based on a subtitle file, and then uses AI voice services to create a new dubbed & translated audio track where the speech is synced using the subtitle's timings.
GNU General Public License v3.0
1.56k stars 156 forks source link

Clone Voice? #76

Open toux92 opened 1 year ago

toux92 commented 1 year ago

I've to admit this programm is absolutely gold. I also discovered an AI website that, in addition to dubbing the audio, also clones the original voice in order to maintain tones and even pronunciation defects (i don't know if I can leave the link here). What about add this feature too?

Barnacules commented 1 year ago

Wait, @ThioJoe made this?! No way... 😉 /jk

Alokkumar8 commented 1 year ago

I've to admit this programm is absolutely gold. I also discovered an AI website that, in addition to dubbing the audio, also clones the original voice in order to maintain tones and even pronunciation defects (i don't know if I can leave the link here). What about add this feature too?

can you give me the link? i want to see it

ThioJoe commented 9 months ago

Now that ElevenLabs has this functionality I'll make an effort to add support for their API. Microsoft also recently added a preview feature called "Personal Voice" that should work too. Though that seems to be in limited access for now.