There has been persistent problems with having the chatbot use the correct format of [emotion] message. An idea shared with me was to instead utilize emojis. These fail gracefully, and there should already be a lot of training data utilizing emojis. We can search for specific types, and trigger expression changes, or for some emojis - trigger animations. This should hopefully allow a non-finetuned model to be able to trigger any of the gestures and expressions already exposed by the emoji system, will need to import the animations to make this fully work.
There has been persistent problems with having the chatbot use the correct format of
[emotion] message. An idea shared with me was to instead utilize emojis. These fail gracefully, and there should already be a lot of training data utilizing emojis. We can search for specific types, and trigger expression changes, or for some emojis - trigger animations. This should hopefully allow a non-finetuned model to be able to trigger any of the gestures and expressions already exposed by the emoji system, will need to import the animations to make this fully work.A much larger amount of expressions can be grabbed correctly (see https://emojipedia.org/smileys )
Some I think interesting from https://emojipedia.org/people :
This is a pretty large change but I think it should provide a much better route.
We also should save some space in prompt context.