chrisglein / artificial-chat

2 stars 1 forks source link

Add a section for remembered context/terms that are applied to all sessions #131

Open chrisglein opened 1 year ago

chrisglein commented 1 year ago

The idea here is that you define some terms up front (imagine you're writing a book or designing a role playing adventure) and then you can refer to them succinctly in the normal chat without having start with a huge preamble very single time. Potentially this all isn't even given to the LLM because it's long and token limits exist, but there is a pre-pass to find the used terms and then the prompt is edited to pass these through. Not sure if that's worth the effort, as if there are no token limits then why bother.