theubie / complex_memory

A KoboldAI-like memory extension for oobabooga's text-generation-webui
GNU Affero General Public License v3.0
107 stars 14 forks source link

enable complex_memory in text generation mode? #16

Open nixudos opened 1 year ago

nixudos commented 1 year ago

Hi, This plugin is eactly what I have been looking for to generate stories. But unfortunately it does not seem to kick in when I use it in text generation mode? I set Verbose to TRUE, but do not see any of my memories getting added to the text generation in the cmd prompt. Does it only work with Chat window, or am I doing something wrong?

theubie commented 1 year ago

Currently it only affects the context for chat. I'll look into seeing if I can add text generation mode. I haven't been using the text-generation-webui interface recently (been working on a project that uses the API), so I haven't kept up with it other than to fix issues with chat.

nixudos commented 1 year ago

Thank you for the reply! It would be awesome if it can be implemented to text generation as well. The option to keep keep a synopsis in memory, would be a huge help for generation longer stories! They tend to drift somewhat after hitting the max token limit.