search

sagemathinc / cocalc

CoCalc: Collaborative Calculation in the Cloud
https://CoCalc.com
Other
1.16k stars 216 forks source link

make it easy/natural/discoverable how to change the default LLM #7553

Open williamstein opened 4 months ago

williamstein commented 4 months ago
  1. I open up chat and try out chatting with a non-default LLM and it works. Yeah! E.g., I just tried GPT-4 Omni.
  2. Now I want that to be my default. There's nothing at all that guides me to doing that. There's no way to do that from chat.
image

Suggestion: in the label for each model, make it so that there is a checkbox on the left and if you click there, then it becomes the default model. It is easy to implement a label with a clickable button in it, e.g., that's how the toolbar works:

image
williamstein commented 4 months ago

WORKAROUND: There is a way to set the default model in account settings. https://cocalc.com/settings

Also, once you change your default model in account settings, it seems like for already open chats you have to close them or refresh your browser before the change is visible. So basically if you have a running chat session, there's no way to change the default model without closing and opening the chat session.