Sebane1 / RoleplayingVoiceDalamud

Spoken in game voices, enhanced mod management, Twitch integration, and more!
MIT License
13 stars 4 forks source link

Found a dialogue that had extra voice #20

Open thinkslynk opened 1 month ago

thinkslynk commented 1 month ago

I'm on Burst of Inspiration and during one of the voiceovers, the voice over had extra dialogue in another language. I assume this just has to do with how translations work or something. But I was thinking this could also be detected with a script. For each dialogue file, do voice to text and compare it to the text that was meant to be voiced; put some reasonable accuracy metric on it to ignore any noise in the process (voice to text miss hearing a word.) Anything that doesn't meet that threshold would need manual review.

Sebane1 commented 1 month ago

You can use Quality Assurance mode to report these lines and force a regeneration. Sometimes the AI hallucinates extra words (no idea why it happens every few hundred lines), and they need to be recreated again. Humans reporting lines via the plugins in game system is currently the most accurate correction mechanism.