search

cztomsik / ava

All-in-one desktop app for running LLMs locally.
https://avapls.com
Other
419 stars 15 forks source link

Add UI for sampling options #4

Closed cztomsik closed 9 months ago

cztomsik commented 11 months ago

The /api/generate endpoint already supports these options:

image

But we need to add some GUI for this (at least to chat & playground screens but likely also for quicktools), in a user-friendly way. Many users don't know what these mean, so it should be power-user feature. Or it should have "advanced" checkbox, or something like that.

Another question is if these settings should be saved (localStorage or per-chat) or not.

cztomsik commented 9 months ago

I've refactored sampling modal into a sidebar, fixed some bugs and added this sidebar to a chat window. These values are not saved currently, this will be done during upcoming changes in the /chat/ API