jina-ai / serve

☁️ Build multimodal AI applications with cloud-native stack
https://jina.ai/serve
Apache License 2.0
21.14k stars 2.22k forks source link

Release Note 3.27.0 #6180

Closed JoanFM closed 4 months ago

JoanFM commented 4 months ago

Release Note

This release contains 1 new feature.

🆕 Features

Add flush-all parameter to dynamic batching configuration (#6179)

You can pass flush_all=True``to thedynamic_batchingconfiguration which will allow to pass all the dynamically batched documents at once to the Executor. This makespreferred_batch_size` parameter a parameter that triggers the flushing but that can be bypassed.

🤟 Contributors

We would like to thank all contributors to this release: