adding same document multiple times should reject that in search level

mem0ai / mem0

The Memory layer for your AI apps

https://mem0.ai

Apache License 2.0

21.6k stars 1.97k forks source link

Open munjalmukul opened 3 weeks ago

munjalmukul commented 3 weeks ago

How Its Working Currently Right now If I am adding same document twice its first searching memories and then updating, adding or deleting memory.

How It Should be There should be a layer at embedding search level so it reject the duplicate document to save llm cost.

There are times when duplicate documents are uploaded by user so I dont want to send that document to llm so cost can be saved.

NavyaAlapati13 commented 2 weeks ago

@Dev-Khant I am working on this enhancement, can you assign me this this issue? Looking forward to share the PR soon.

Dev-Khant commented 2 weeks ago

Sure @NavyaAlapati13, Thanks for working on it.