nv-morpheus / Morpheus

Morpheus SDK
Apache License 2.0
310 stars 119 forks source link

[FEA]: Add a group by stage #1709

Closed dagardner-nv closed 4 days ago

dagardner-nv commented 1 month ago

Is this a new feature, an improvement, or a change to existing functionality?

New Feature

How would you describe the priority of this feature request

Medium

Please provide a clear description of problem this feature solves

Currently we slice/chunk incoming MessageMeta messages by arbitrary numbers of rows. However there are use-cases where it may be more beneficial to slice/chunk messages according to a category field in a dataframe.

This could lead to potential improved cache performance for downstream stages in a pipeline.

Describe your ideal solution

A stage that groups by an arbitrary dataframe column.

Additional context

No response

Code of Conduct