search

Pathos14489 / Pantella

GNU General Public License v3.0
4 stars 1 forks source link

Wishlist: Put the "scenario" into the Context Buffer automatically #8

Open jonathonbarton opened 8 months ago

jonathonbarton commented 8 months ago

This would remove the need to have it in the Prompt. It also would (potentially) reduce erroneous Context when the User forgets to update the Context for a long time. adjusts invisible halo

I think it also gets closer to the use of "Scenario" in other chat software like SIllyTavern and Voxta, etc.

I'm thinking about the 'X and Y are having a conversation in {location} stuff, specifically...

Pathos14489 commented 8 months ago

You're gonna have to be more specific about what this is you're after because I don't quite follow. I think you're saying to have a scenario variable that gets posted as a system message every now and again in long contexts? Or something that follows at the end of the context? The latter has a number of issues that stem from latency because it breaks the generation cache earlier than normal, so it'll lead to slower conversations. Putting a new system message in the context every now and again might work but it might start to waste tokens leading to more summarizations than necessary and introduce bad repetition habits we want to avoid. So unless there's something I'm misunderstanding this doesn't seem ideal. Or did you mean a default scenario that overwrites the user defined context that can be changed in game? I'd be hesitant to overwrite anything an end user writes without warning and especially the ability to deny it, and I think a popup every now and again asking if you want to clear the context is gonna be annoying personally. So I don't personally want that as a feature.