Support more than one llm

virtUOS / kiwi

A simple and configurable portal to proxy to llms.

https://virtuos.github.io/kiwi/

GNU Affero General Public License v3.0

2 stars 3 forks source link

Open tibroc opened 9 months ago

tibroc commented 9 months ago

We would want the option to configure the llms used. E.g. we might want to use ollama or something else instead of ChatGPT.

This could look like this:

A config file on the server that specifies llm options and their APIs, Tokens, etc.
A menu option for the user where they can choose which model to use in the session/assistant/…