search

webaverse / app

Web metaverse client
https://app.webaverse.com
MIT License
339 stars 207 forks source link

Banjo-Kazooie voice experiments #1363

Closed avaer closed 1 year ago

avaer commented 3 years ago

I made this with FL Studio, from AI Somnium Files data rip.

It's a different, faster realtime technique than online synthesis (it's basically free and infinite in speed), but would require speech bubbles in world and I don't know if that's a good idea. However this works great with visemes and expressivity, and IMO gives a good sense of a character.

It would be like a sub, but in a language nobody understands, like The Sims or Banjo.

https://cdn.discordapp.com/attachments/498315766509338636/863351166372020264/bk.mp3

avaer commented 3 years ago

Related, doing it via API: https://github.com/webaverse/app/issues/1362

avaer commented 3 years ago

I think the trailer should not be this, which somewhat limits its usefulness.

Vianvolaeus commented 3 years ago

Seems like it could work in some sense for the BR, since they communicate via pose and video screen (effectively could be visemes) but no distinct speech. Could work like an R2D2 that actually makes some sense to the player, rather than just the protagonists.

avaer commented 3 years ago

Yeah BR might be the best use.