llm-tools / embedJs

A NodeJS RAG framework to easily work with LLMs and embeddings
https://llm-tools.mintlify.app/get-started/introduction
Apache License 2.0
334 stars 40 forks source link

Short and long term memory #72

Open converseKarl opened 5 months ago

converseKarl commented 5 months ago

Are there elements of this baked into the library or are there plans to implement more of this at session level via rag and long term memory too with say mongo db.

There seems to be API Param hooks but nothing is document unless it is self managed but it would need to be user session based anyway.

Tbis is more a question. At moment i add my own history {{history} injection but token use is a bit more expensive.

Thoughts? Or advice from community.