psugihara / FreeChat

llama.cpp based AI chat app for macOS
https://www.freechat.run
MIT License
402 stars 34 forks source link

Saved intelligence configurations #43

Open psugihara opened 6 months ago

psugihara commented 6 months ago

Dialing in your perfect settings is annoying and I don't want to have to do the same ones twice.

I want something like Terminal's theme picker (pictured below) but for different configurations of the Intelligence settings.

Screenshot 2023-12-21 at 10 25 42 AM Screenshot 2023-12-21 at 10 27 42 AM
EvolvingSoftware commented 4 days ago

Is this the same as this idea from the readme? "Personas - save system prompt / model settings for later and change personas when you create a new conversation"

I was thinking something like the ability to perhaps create a folder structure for the Chats & use the folder to be able to craft a unique system prompt for each chat created in that folder (or first message automatically submitted for models that don't support a system prompt like: https://huggingface.co/bartowski/gemma-2-27b-it-GGUF)

psugihara commented 4 days ago

Is this the same as this idea from the readme? "Personas - save system prompt / model settings for later and change personas when you create a new conversation"

Yeah this is an idea for how personas could be setup, saved, and selected.

Folder structure sounds like an interesting way to organize the chats, is that the idea? For my use-cases I think a simple tagged list is more immediate (though I really want search!). It looks like Notes has some optional folder functionality using NavigationSplitView that we could draw inspiration from.

Screenshot 2024-07-02 at 7 31 12 AM

Feels like there are a bunch of cool ways you could use/organize the different configurations and chats (and we should keep talking about them!) but probably the prerequisite is having something like the above to set them up.