This pull request introduces a new feature that allows users to customize the batch size within their workflows, significantly enhancing flexibility in data processing. With this update, users can set the batch size, which determines the amount of data transmitted between operators in the workflow.
Streaming Mode: When the batch size is set to 1, the workflow transitions into a streaming process. In this mode, data is processed sequentially, one unit at a time, ensuring real-time processing and display without accumulation or blockage between operators.
Batch Processing: Users can also choose larger batch sizes to process data in batches, optimizing efficiency for larger volumes of data.
This feature has been demonstrated in video below.
Introduction
This pull request introduces a new feature that allows users to customize the batch size within their workflows, significantly enhancing flexibility in data processing. With this update, users can set the batch size, which determines the amount of data transmitted between operators in the workflow.
Streaming Mode: When the batch size is set to 1, the workflow transitions into a streaming process. In this mode, data is processed sequentially, one unit at a time, ensuring real-time processing and display without accumulation or blockage between operators.
Batch Processing: Users can also choose larger batch sizes to process data in batches, optimizing efficiency for larger volumes of data.
This feature has been demonstrated in video below.
https://youtu.be/sU7dw6PQ3BU