openai / chatgpt-retrieval-plugin

The ChatGPT Retrieval Plugin lets you easily find personal or work documents by asking questions in natural language.
MIT License
21.01k stars 3.68k forks source link

Why not use vector search lib instead of service #72

Open salamer opened 1 year ago

salamer commented 1 year ago

Hi, I found it's a very interesting repo, it recommends some vector search services, I wonder why not use some vector search libraries instead of services, personal scene retrieval candidate set is small, and all these libraries support serialization as Objects are stored on disk. These libs occupy less memory and are more suitable for personal scenarios. in general, library is more comvienient in most scenarios, and the service is more scalable when the scenarios became heavy.

Libraries I recommend:

and for more library: awesome vector search

filip-halt commented 1 year ago

Qdrant isn't a vector search library, its a service aswell.

These libraries aren't designed to offer the best CRUD functionalities, so using databases makes sense. In addition to this, filtering and other operations would need to be implemented.