matrixgpt / matrix-chatgpt-bot

Talk to ChatGPT via any Matrix client!
GNU Affero General Public License v3.0
235 stars 63 forks source link

Add user-customizable temperature command? #164

Open max298 opened 1 year ago

max298 commented 1 year ago

With #162 being merged I am thinking a end-user controlled temperature could be a fun feature. I am thinking of adding a command like !temperature <num> <prompt> which would then overwrite the (default) temperature for this message so the users can control whether they want a "creative" or "conservative" output.

Another idea is to run multiple bots which have different pre configured temperatures, this would even work right now out of the box without having to do any code changes. But I also don't think this would be as much fun for the users.

Before I'd consider adding such a feature I'd like to year some other opinions, so feel free to leave a comment and tell me what you think!

kinduff commented 1 year ago

I like this, definitely something worth adding. My opinion is that they should be tied to room and context configurations.

For example, I create a room and add the bot, I can set the temperature and it will be global to all threads within that room. I can change the temperature globally. You can also set the temperature in the threads. So only that thread is going to be affected. This works for both context modes.

I can code this, but please provide pointers if you can, I will appreciate it.

bertybuttface commented 1 year ago

I've always thought about settings as:

default <-- global <-- room <-- thread

If thread setting isn't set use room setting, if that is not set use global setting, if that is not set then use default setting. This lets us make runtime settings changes at any level.