search

mem0ai / mem0

The Memory layer for your AI apps
https://mem0.ai
Apache License 2.0
22.9k stars 2.11k forks source link

adding same document multiple times should reject that in search level #1733

Open munjalmukul opened 3 months ago

munjalmukul commented 3 months ago

🚀 The feature

How Its Working Currently Right now If I am adding same document twice its first searching memories and then updating, adding or deleting memory.

How It Should be There should be a layer at embedding search level so it reject the duplicate document to save llm cost.

Motivation, pitch

There are times when duplicate documents are uploaded by user so I dont want to send that document to llm so cost can be saved.

NavyaAlapati13 commented 2 months ago

@Dev-Khant I am working on this enhancement, can you assign me this this issue? Looking forward to share the PR soon.

Dev-Khant commented 2 months ago

Sure @NavyaAlapati13, Thanks for working on it.