Automatically translates the text of a video based on a subtitle file, and also uses AI voice to dub the video, and synced using the subtitle's timings
I want to have the option to do this fully locally aside from potential LLM translators in the future. We could implement whisper or https://alphacephei.com/vosk/models and maybe balabolka with microsoft voices or other local alternatives. We could potentially implement it into https://github.com/SubtitleEdit/subtitleedit and maybe use RVC AI for voice conversion.
I want to have the option to do this fully locally aside from potential LLM translators in the future. We could implement whisper or https://alphacephei.com/vosk/models and maybe balabolka with microsoft voices or other local alternatives. We could potentially implement it into https://github.com/SubtitleEdit/subtitleedit and maybe use RVC AI for voice conversion.