ThioJoe / Auto-Synced-Translated-Dubs

Automatically translates the text of a video based on a subtitle file, and also uses AI voice to dub the video, and synced using the subtitle's timings
GNU General Public License v3.0
1.53k stars 152 forks source link

Adding local workflow and TTS to software #73

Open gitihobo opened 11 months ago

gitihobo commented 11 months ago

I want to have the option to do this fully locally aside from potential LLM translators in the future. We could implement whisper or https://alphacephei.com/vosk/models and maybe balabolka with microsoft voices or other local alternatives. We could potentially implement it into https://github.com/SubtitleEdit/subtitleedit and maybe use RVC AI for voice conversion.

RafaelGodoyEbert commented 8 months ago

there could be an option to implement edge-tts for those who cannot afford an Azure API

gitihobo commented 8 months ago

Can you use edge tts commercially without issue for example in a YouTube video?