When using dynamic batching (either with the @dynamic_batching decorator on an Executor endpoint or by setting the uses_dynamic_batching parameter on a Deployment, timeouts were not being properly taken into account because the timer might not be triggered until a previous batch finished. This has been fixed.
🤟 Contributors
We would like to thank all contributors to this release:
Release Note
This release contains 1 bug fix.
🐞 Bug Fixes
Fix timeout issue with dynamic batching (#6071)
When using dynamic batching (either with the
@dynamic_batchingdecorator on anExecutorendpoint or by setting theuses_dynamic_batchingparameter on aDeployment, timeouts were not being properly taken into account because the timer might not be triggered until a previous batch finished. This has been fixed.🤟 Contributors
We would like to thank all contributors to this release: