Streaming executor does not preserve order by default. There is a global flag for preserving order.
However, the decision to preserve order should be done at the operator level, not globally. Currently, if any of the operators are a zip or sort operation, ordering is preserved globally. But for cases like map -> map -> sort, the first 2 maps don't need to preserve order.
The following operators should have order preservation:
Description
Streaming executor does not preserve order by default. There is a global flag for preserving order.
However, the decision to preserve order should be done at the operator level, not globally. Currently, if any of the operators are a zip or sort operation, ordering is preserved globally. But for cases like map -> map -> sort, the first 2 maps don't need to preserve order.
The following operators should have order preservation:
Use case
No response