AmenRa / retriv

A Python Search Engine for Humans 🥸
MIT License
174 stars 20 forks source link

Does Advanced Retrieve support semantic searching? #25

Open AdamJSoftware opened 1 year ago

AdamJSoftware commented 1 year ago

Does Advanced Retrieve support semantic searching? If not are there future plans for it?

AmenRa commented 1 year ago

Hi, it does not.

The issue with filtering and semantic search is that it is not straightforward to exclude documents before searching using the technologies employed by retriv. There are vector databases that allow that right off the bat. Unfortunately, they require to be installed and loaded independently, which I want to avoid to keep everything user-friendly.

Directly filtering the search results instead of applying a filter beforehand is not a great solution for obvious reasons, i.e., you could end up filtering all of them and still not retrieve what you need.

I want to solve this issue in the future, but I have no time to work on it right now.