search

Macoron / whisper.unity

Running speech to text model (whisper.cpp) in Unity3d on your local machine.
MIT License
387 stars 82 forks source link

Question: Adding second translation language #90

Open Didaktik-digital opened 1 month ago

Didaktik-digital commented 1 month ago

Hi there Macoron,

what a wonderful asset - thank you so much for providing it freely! I really tried o figoure out how to add a second translation language - but so far I have failed.

So, I was hoping you could help me out on how to add "translateToFrench" method to the Microphone example.

Best whises /Thomas

Macoron commented 1 month ago

Unfortunately, whisper was trained only for English translation. However, you still kinda can translate speech from other languages to French. In WhisperManager set Language field from "auto" to "fr". Now whisper will try to output text in French.

It's not ideal, quality would be relatively low. You would also need a bigger model: small, medium or large.

image

There are also unofficial French only models, like this. No idea if they would work better or worse for French translation.