zilliztech / GPTCache

Semantic cache for LLMs. Fully integrated with LangChain and llama_index.
https://gptcache.readthedocs.io
MIT License
7.2k stars 499 forks source link

[Feature]: qdrant as a vector store #132

Closed regstuff closed 1 year ago

regstuff commented 1 year ago

Is your feature request related to a problem? Please describe.

Hi. Glad someone finally made this. Been on my mind for a long time. Any chance of supporting qdrant as a vector store? Qdrant also allows filtering by metadata which can be helpful if you only want to retrieve cache from within a certain date range for example. Qdrant can also store the llm response as metadata which eliminates the sqlite requirement. The new qdrant local mode means you dont have to setup a server via docker. Just install from pip and you are ready to go.

Describe the solution you'd like.

No response

Describe an alternate solution.

No response

Anything else? (Additional Context)

No response

SimFG commented 1 year ago

qdrant is on the list, please stay tuned.

xiaofan-luan commented 1 year ago

we actually has a pr for this. If you want to implement the local mode version on yourself that would be highly welcomed

dagthomas commented 1 year ago

Any update on this?

xiaofan-luan commented 1 year ago

anyone interesting could take on the pr and work on this

parthvnp commented 1 year ago

Happy to start working on this!

xiaofan-luan commented 1 year ago

Happy to start working on this!

Please take it and open an issue~ Anyone would like to work on any vector store is warmly welcomed~

Torhamilton commented 1 year ago

@parthvnp any update on qdrant?

parthvnp commented 1 year ago

@Torhamilton It will be ready by this Saturday!

Torhamilton commented 1 year ago

@parthvnp looking forward to your pr

DumoeDss commented 1 year ago

@parthvnp Hey~ how about the project update?

parthvnp commented 1 year ago

@DumoeDss @Torhamilton Sorry for the delay. I have created a PR

SimFG commented 1 year ago

@parthvnp Thanks your contribution!!! The next GPTCache version will support the qdrant vector database. @DumoeDss @Torhamilton @dagthomas