search

microsoft / autogen

A programming framework for agentic AI 🤖
https://microsoft.github.io/autogen/
Creative Commons Attribution 4.0 International
34.3k stars 4.96k forks source link

How to add a new vector database? #725

Closed hsm207 closed 1 month ago

hsm207 commented 12 months ago

I would like to contribute a weaviate integration and would like advise on how to build this integration.

It seems the current way to do it according to PR #161 is to subclass RetrieveUserProxyAgent and implement the retrieve_docs and query_vector_db methods. However, there's also a recent PR (#619 ) that proposes a new retriever API.

Which approach is going to be supported in release >= 0.2?

thinkall commented 12 months ago

Thank you @hsm207 , if you'd like to use your integration in a short time, say one or two days, I suggest you follow #161. If you can wait till next week, then maybe it's better to wait or start based on #619.

Let me know if you need more info. Thanks.

hsm207 commented 12 months ago

@thinkall thanks for the clarification. I'll wait until #619 is merged.

garethchengibm commented 11 months ago

@thinkall Could you kindly provide an estimate of when this might be merged? Thank you

thinkall commented 11 months ago

@thinkall Could you kindly provide an estimate of when this might be merged? Thank you

Hi @garethchengibm , I'm oof this week, will try finish reviewing and merge the PR next week. Thanks.

thinkall commented 5 months ago

Hi @hsm207, are you still interested in contributing weaviate integration? We've a new abstraction of vectordb.

hsm207 commented 5 months ago

@thinkall yes, i'm interested in contributing a weaviate integration. Where can I find the docs to understand what I need to implement and are there already implementations that use the new abstraction that I can use as reference?

thinkall commented 5 months ago

Thank you very much @hsm207 . You can find the new abstraction and implementation of chromadb and pgvectordb here: https://github.com/microsoft/autogen/tree/main/autogen/agentchat/contrib/vectordb and the notebook example: https://github.com/microsoft/autogen/blob/main/notebook/agentchat_pgvector_RetrieveChat.ipynb

Feel free to ping me here or in Discord if you've any other questions.

swadharma-me commented 4 months ago

Any update on if this is implemented ? thanks a ton

hsm207 commented 4 months ago

@swadharma-me I haven't started on this yet. I'll probably have some down time around Q4 to contribute so open to someone else contributing if they have the capacity sooner.

rysweet commented 1 month ago

some examples of this in 0.2 and 0.4. closing this issues as stale.