AllYourBot / hostedgpt

An open version of ChatGPT you can host anywhere or run locally.
MIT License
269 stars 111 forks source link

Figure out how to auto-truncate message history so you don’t have to keep starting new conversations #404

Open krschacht opened 4 weeks ago

krschacht commented 4 weeks ago

And I have also wanted a bit more smarts around controlling the conversation's history. One of my main considerations is that i don't like the accumulation of so many conversations. I routinely restart a conversation just b/c I want to reset the context. That feels a bit heavy handed to me. I think that if I come back to a conversation thread the next day and start talking, it should default to having some kind of visual section break. Meaning, just because I'm in the same conversation thread, don't assume that all the prior messages are relevant to what I'm about to ask. I routinely ask completely unrelated questions within the same thread.

To think of it another way: I have a single long texting thread with friends. We switch to a new topic and we don't start a new thread. We just figure it out. It's annoying that I have to manage so many new threads with my AI, why can't I keep one long conversation thread and it just auto-decides when the prior context is relevant or not — but it visually indicates that somehow so I can control it explicitly in the few cases that it gets wrong. And maybe some shortcuts like Cmd + Enter rather than just Enter could be another convenient way to explicitly start a new topic within the same conversation.

That's been my vague thinking so far but I haven't fully settled on a vision for how to implement that.