Open tuxtof opened 2 weeks ago
Hey!
Thanks for the feature request. It looks like a useful feature.
We can use jkawamoto/ctranslate2-rs to utilize huggingface.co/facebook/m2m100_418M and translate offline from any language to any language. However, the model size will be 1-2GB, which will make Vibe much heavier. Maybe I can add it as an optional feature to enable through settings or options, and then it will download the model if the user is interested.
how the actual translate to english is working ? yes provide them as an optional feature with downloadable model is perfectly acceptable
how the actual translate to english is working ?
Whisper model have built in feature to translate from any language INTO English.
yes provide them as an optional feature with downloadable model is perfectly acceptable
Meanwhile I created the app Lingo for translate offline in any language. you can try it along with vibe, it works pretty fast. 1 hour transcription translated in 2 minutes. https://github.com/thewh1teagle/lingo
On windows, currently it has small bug when you exit you have to exit the app from task manager too (ctrl + shift + esc)
Whisper model have built in feature to translate from any language INTO English.
Hi, it’s true, but you can get transcription from whisper in any language, not only English. For this you need to use
params.set_translate(false);
params.set_language(Some("language"));
Quality isn’t perfect, but better than nothing.
Whisper model have built in feature to translate from any language INTO English.
Hi, it’s true, but you can get transcription from whisper in any language, not only English. For this you need to use
params.set_translate(false); params.set_language(Some("language"));
Quality isn’t perfect, but better than nothing.
Thanks! it means that vibe already supports that, when translate
is not turned on, we can select the language that we want the final transcript to be in, and it will transcribe into it no matter what is the audio language.
However when tried it on medium model with English audio into Hebrew - the result is not good / usable at all.
Describe the feature
today we can actually transcribe any language and translate it in english
would be wonderful to be able to do the reverse, transcribe from english and translate in any language