search

whyhow-ai / rule-based-retrieval

The Rule-based Retrieval package is a Python package that enables you to create and manage Retrieval Augmented Generation (RAG) applications with advanced filtering capabilities. It seamlessly integrates with OpenAI for text generation and Pinecone or Milvus for efficient vector database management.
MIT License
222 stars 24 forks source link

Vectorstores other than Pinecone #1

Open JovanNj opened 8 months ago

JovanNj commented 8 months ago

Hi,

Thank you very much for open-sourcing your package, it looks really useful! We wanted to try your package, but we wanted to know you if there is a possibility of using it on some other vectorstores? Particularity, we would like to use it with Weaviate.

Best, Jovan Njegic

tomsmoker commented 8 months ago

Hey Jovan! We used Pinecone for this demo but this can be easily extended to any other vectorstore provider. This looks like:

  1. Confirm the metadata language and format for the vectorstore
  2. Add the Weaviate upsert logic into the section that has the current Pinecone logic

The code is written in a modular way to make this simple enough; just take a Weaviate Langchain example and add it similar to the Pinecone work. I encourage you to try this in a fork, and I'm happy to help out with integration however I can.