feat: Assistants have Persistent Memory

janhq / jan

Jan is an open source alternative to ChatGPT that runs 100% offline on your computer. Multiple engine support (llama.cpp, TensorRT-LLM)

https://jan.ai/

GNU Affero General Public License v3.0

23.38k stars 1.36k forks source link

feat: Assistants have Persistent Memory #344

Closed hiro-v closed 10 months ago

hiro-v commented 1 year ago

Problem

Now Jan bot do not know what me as the user talked with the bot before

Success Criteria

It remembers and can answer me correctly

Additional context Add any other context or screenshots about the feature request here.

0xSage commented 1 year ago

@vuonghoainam can you elaborate on the recommended solution? Are you referring to giving bots "long term" memory, i.e. through indexing historical convo data somewhere, rather than just the context window?

0xSage commented 1 year ago

I get it now. We want assistants to retain previous conversation threads. Neat!

This lends itself to our file-based approach where:

/assistants
    /homework-helper
        /threads                # conversation that needs to be remembered
/threads                        # 1 time conversations that can be forgotten