search

HRNPH / AIwaifu

Open-Waifu open-sourced finetunable customizable simpable AI waifu inspired by neuro-sama
GNU General Public License v2.0
402 stars 31 forks source link

Emotion Analysis Of Conversantion/Waifu algorithm idea? #17

Open HRNPH opened 1 year ago

HRNPH commented 1 year ago

for now, I'm thinking of training sentiment classification on multiple classes we will then use the top Log(probability) on each neuron as a combination of emotions ['Joy', 'Mad'] the model that I currently use for prototyping contains a little emotion but due to the complex emotion that can be expressed in the real conversation such as Tsundere(actually happy but speaking as if they're mad: BLUSHING I hate you! (Maybe recognizable if you took a whole conversation as features) this issue was opened for the suggestion of a better Conversation -> Emotion algorithm

andri-jpg commented 1 year ago

I think sentiment classification is quite good because it also doesn't take too much memory, the challenge might be to label the data set with more classes like shy, tsundere and many other expressions.

HRNPH commented 1 year ago

yeah, I think maybe I need to make some datasets myself for fine-tuning some Sentiment Classification but for now, I'll focus on solid development of base TTS/Voice Conversion Model there's still documentation & training scripts to be released