voltrondata / spark-substrait-gateway

Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
Apache License 2.0
16 stars 9 forks source link

feat: fix the behavior of with_column #2

Closed EpsilonPrime closed 8 months ago

EpsilonPrime commented 8 months ago

With this PR the with_column tests in DataFusion now pass (ordering properly happens and the tests don't make extra calls to the server unnecessarily). The DuckDB version has an apparent internal error that needs to be investigated however.