search

PygmalionAI / gradio-ui

Prototype UI for chatting with the Pygmalion models.
GNU Affero General Public License v3.0
227 stars 67 forks source link

Consider allowing rating of messages #23

Open Mister-G-Lu opened 1 year ago

Mister-G-Lu commented 1 year ago

I think one of the things that make other bots like Character AI good is the ability to further train the bot better and better -- rating messages as good or bad could hint at what kind of messages to use and what messages aren't correct, especially with more complex or subtle characters/personalities.

ArkyMosuke commented 1 year ago

Would be nice if the model supports it.

0x000011b commented 1 year ago

I'm not sure how (if?) this would work locally on an already-trained model, but I do have plans to allow users to submit message ratings to be used as fine-tune data for new model versions, just like OpenAI did for ChatGPT.

That involves actually having servers to host the service that will receive the ratings and a database to store the data in though, so while it is in my wish list, it'll be a while before I have all of that set up for the public.