apache / datafusion

Apache DataFusion SQL Query Engine
https://datafusion.apache.org/
Apache License 2.0
5.93k stars 1.12k forks source link

[substrait] add support for Substrait Relation emit kind #12347

Open vbarua opened 2 weeks ago

vbarua commented 2 weeks ago

Is your feature request related to a problem or challenge?

Substrait relations have the concept of an emit kind, which can either be:

Currently, DataFusion ignores the emit_kind field entirely, which can impact the correctness of Substrait plan execution.

For more details see https://substrait.io/relations/basics/#emit-output-ordering

Describe the solution you'd like

DataFusion should handle both Direct and Emit emit kinds.

Describe alternatives you've considered

No response

Additional context

No response

vbarua commented 2 weeks ago

take