Is this a new feature, an improvement, or a change to existing functionality?
New Feature
How would you describe the priority of this feature request
Medium
Please provide a clear description of problem this feature solves
Currently we slice/chunk incoming MessageMeta messages by arbitrary numbers of rows. However there are use-cases where it may be more beneficial to slice/chunk messages according to a category field in a dataframe.
This could lead to potential improved cache performance for downstream stages in a pipeline.
Describe your ideal solution
A stage that groups by an arbitrary dataframe column.
Additional context
No response
Code of Conduct
[X] I agree to follow this project's Code of Conduct
[X] I have searched the open feature requests and have found no duplicates for this feature request
Is this a new feature, an improvement, or a change to existing functionality?
New Feature
How would you describe the priority of this feature request
Medium
Please provide a clear description of problem this feature solves
Currently we slice/chunk incoming
MessageMeta
messages by arbitrary numbers of rows. However there are use-cases where it may be more beneficial to slice/chunk messages according to a category field in a dataframe.This could lead to potential improved cache performance for downstream stages in a pipeline.
Describe your ideal solution
A stage that groups by an arbitrary dataframe column.
Additional context
No response
Code of Conduct