search

phyce / rl-natural-speech

Text to speech with high quality voices plugin for runelite
BSD 2-Clause "Simplified" License
9 stars 2 forks source link

Crowd-source NPC voice selection for NPC #1

Open TheLouisHong opened 4 months ago

TheLouisHong commented 4 months ago

hi @phyce, I checked our your new rl-natural-speech plugin, super duper cool!

I'm excited to talk about the development of the plugin. I'd love to DM on Discord @honglouis

Right now, the voices are pseudo-random, so NPC don't exaclty

sound how they look. I'm absolutely sure you are aware. public static int calculateVoiceIndex(String name) { int hashCode = name.hashCode(); return Math.abs(hashCode) % config.MAX_VOICES; }

What are your thoughts on this? Off the top of my head, maybe we can implement a crowdsource feature where users "shift-rightclick" to assign an NPC with a voice.

Super cool, great job!

https://github.com/phyce/rl-natural-speech/assets/1916460/b3194f4c-78f1-424d-b81d-9372209fa161

phyce commented 4 months ago

Hey @TheLouisHong, glad you like my project! Yes, I am aware of this. Unfortunately the voices do not come with any additional metadata so I was considering categorising the voices into male/female/neutral to make it somewhat more immersive. I like your idea though, I can see that being an option in the plugin. I've got many ideas for the plugin, including an option to allow running multiple engine instances to busy areas to reduce load off a single engine process (at the cost o double memory usage though), and this would also open up the option to load multiple voice models at a time. https://huggingface.co/rhasspy/piper-voices Pretty sure some of the models contain big amounts of voices (some higher quality), so it would be cool to increase the voice option pool. If you would like to get involved I'd be happy to collaborate on new features for this plugin.

SirFancyBacon commented 1 month ago

I see the right click option was added; does this mean the crowd sourcing was as well?

TheLouisHong commented 1 month ago

Hi @SirFancyBacon,

No, crowd-sourcing has not been added yet. All voices changes are local to your profile.

TheLouisHong commented 1 month ago

@SirFancyBacon We envision a future where all the quest and NPC voices are expertly designed and crafted. We're hard at work!

The next update will have Gary Gilbert's voice, btw!

SirFancyBacon commented 1 month ago

Thats awesome! If there is a place i can submit for these handcrafted NPCs; let me know! :)

phyce commented 1 month ago

I am currently working on a tool that will help us do this easier. Feel free to join our Discord, I will be announcing it there when it's ready.