search

art-from-the-machine / Mantella

Mantella is a Skyrim and Fallout 4 mod which allows you to naturally speak to NPCs using Whisper (speech-to-text), LLMs (text generation), and xVASynth / XTTS (text-to-speech).
https://art-from-the-machine.github.io/Mantella/
GNU General Public License v3.0
164 stars 41 forks source link

Option to display subtitles in another language #239

Open art-from-the-machine opened 4 months ago

art-from-the-machine commented 4 months ago

Some players have have Skyrim set to English but with subtitles in another language. An option should be added to config.ini to also display Mantella subtitles in another language. This variable's sentence would need to be translated (I'm not sure what the best method is) before being passed to the game:

https://github.com/art-from-the-machine/Mantella/blob/d9973e3fb0d1fc6979f7b5bc6f8db64bee82f988/src/output_manager.py#L169C13-L169C92

DaymareOn commented 2 months ago

As a french speaker, I sometimes tried to speak in french with the llm. I just switched my sentences from english to french and the llm followed! The results were surprisingly good! Way better than bad translations, or foreign speakers trying to speak french. Just some hallucinations of some words, let's say once every 10 or 20 lines.