feat(indexing)!: Removed duplication of batch_size. Pipeline owns the default ba…

bosun-ai / swiftide

Fast, streaming indexing and query library for AI (RAG) applications, written in Rust

https://swiftide.rs

MIT License

213 stars 12 forks source link

feat(indexing)!: Removed duplication of batch_size. Pipeline owns the default ba… #336

Closed devsprint closed 1 week ago

devsprint commented 1 week ago

Fixes #233

BREAKING CHANGE: The batch size of batch transformers when indexing is now configured on the batch transformer. If no batch size or default is configured, a configurable default is used from the pipeline. The default batch size is 256.

timonv commented 1 week ago

fyi #334 relates but it shouldn't interfere