search

bosun-ai / swiftide

Fast, streaming indexing and query library for AI (RAG) applications, written in Rust
https://swiftide.rs
MIT License
227 stars 17 forks source link

Postgres Storage #158

Open timonv opened 3 months ago

timonv commented 3 months ago

Postgres with PGVector is popular for good reasons and it makes sense to support it. There are two parts to the integration, implementing Persist and implementing (various) search strategies.

Before implementation; since Postgres is not schemaless, I'm especially interested in a setup that alligns with other forms of storage and how we deal with additional fields (ie metadata).

shamb0 commented 15 hours ago

Hello @timonv , I am interested to work on this, Could you please assign it to me.

timonv commented 15 hours ago

Hi @shamb0, thanks for your interest, ofcourse! I'd suggest to split up the PRs in (at least) two, indexing and querying seperately. What are your thoughts on schema management?

shamb0 commented 15 hours ago

Thanks @timonv, Sounds Good. I will make two PR's. :-)