search

mrwonko / TheseusJA

How much of Jedi Academy can I replace before it stops being Jedi Academy? Let's find out!
GNU General Public License v2.0
4 stars 2 forks source link

Voice chat effects / speech synthesis #21

Open mrwonko opened 2 years ago

mrwonko commented 2 years ago
mrwonko commented 1 year ago

Voice filters are good for player use, but for NPC dialogue fully synthesised speech would make "fanfic" easier. Simulate each species' vocal system, then derive the parameters from microphone input.

Usable for realtime-chat. Protects player privacy, serves as compression & enables cross-species modulation & voice imitation. Also good for streamers & machinima (#23).

Doubles as simple input for lip sync. Thus needs to be integrated with the simulation (#19). The inverse integration enables localized damage to result in reduced speech capability.

In droids, the simulation is represented very clearly with chips, cables etc. For easier modding onboarding curve. And localized damage, for those classic distorted speech effects of damaged droids.

mrwonko commented 1 year ago

With voice synthesis, we're not far from text-to-speech. That would be useful for steamer chat Interactions (#23). Compile to WebAssembly and provide a web preview/editor/submission form. Proxy to protect server IP address.