search

bosun-ai / swiftide

Fast, streaming indexing and query library for AI (RAG) applications, written in Rust
https://swiftide.rs
MIT License
239 stars 18 forks source link

Kafka loader #155

Open timonv opened 3 months ago

timonv commented 3 months ago

Is your feature request related to a problem? Please describe. Production setups generally use a streaming loader, and have ETL in separate pipelines. By implementing kafka loaders and persist, pipelines can be connected distributedly.

Describe the solution you'd like A kafka loader and a kafka storage.

shamb0 commented 2 days ago

Hi @timonv, I am interested to work on this PR. could you please assign this to me.

tinco commented 2 days ago

Thanks for working on this @shamb0 !

shamb0 commented 2 days ago

Thanks for working on this @shamb0 !

Thankyou @tinco