patnorris / DecentralizedAIonIC

DeVinci is the browser-based AI chatbot app served from the Internet Computer. You can chat with the AI model loaded into your browser so your chats remain fully on your device. If you choose to log in, you can also store your chats on the Internet Computer and reload them later.
https://devinci.onicai.com/
Apache License 2.0
17 stars 14 forks source link

Feature/inference parameters #53

Closed patnorris closed 1 month ago

patnorris commented 2 months ago

Adds new, advanced settings which affect inference behavior: system prompt passed to LLM temperature (how creative LLM is allowed to be) max tokens of LLM's response