raid-guild / gaianet-rag-api-pipeline

0 stars 0 forks source link

1.8 Explore Output Connector #13

Closed earth2travis closed 3 weeks ago

earth2travis commented 1 month ago

Research options for implementing an output connector to export the generated knowledge base to Qdrant. The goal is to identify the best practices and available tools for efficiently transferring data to Qdrant's vector database. This exploration lays the groundwork for developing a robust and effective output connector, ensuring that the knowledge base is accurately and securely stored in Qdrant.

santteegt commented 4 weeks ago

Docs on how to write a custom Python output connector in Pathway

We'll use qdrant-client python library for interacting with qdrant db