bionic-gpt / bionic-gpt

BionicGPT is an on-premise replacement for ChatGPT, offering the advantages of Generative AI while maintaining strict data confidentiality
https://bionic-gpt.com
Other
1.93k stars 180 forks source link

When you select a model from the new drop down on the top left of screen, the UI always runs the first model in the model list. If you create an Assistant with a specified model it will correctly run the model as selected when building an Assistant. #656

Open tbendien opened 3 hours ago

tbendien commented 3 hours ago
          When you select a model from the new drop down on the top left of screen, the UI always runs the first model in the model list. If you create an Assistant with a specified model it will correctly run the model as selected when building an Assistant.

In the example shown, I selected Mixtral to run and it picked up Llama 8b instant. I tried running new chat and opening new pages but it always does the same thing.

image

Originally posted by @tbendien in https://github.com/bionic-gpt/bionic-gpt/issues/635#issuecomment-2417877835

tbendien commented 3 hours ago

This is becoming a more significant issue as we are doing many customer upgrades and they cannot select models from the dropdown and chat with them.

Building an Assistant and selecting a model works fine, so we are just telling customers to use or create Assistants so they can choose different models.

Some customers have over 15 models in use, so the dropdown feature for general chat is important.