Hello, can you add optional dynamic memory?

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

https://github.com/lostruins/koboldcpp

GNU Affero General Public License v3.0

4.66k stars 334 forks source link

Hello, can you add optional dynamic memory? #699

Open win10ogod opened 6 months ago

win10ogod commented 6 months ago

Hello, can you add optional dynamic memory? Record the input and output in a json file, and use the RAG method to store the memory in the koboldcpp backend.

LostRuins commented 5 months ago

You can try the "World Info" feature, though it needs to be manually setup for now.