voltrondata / spark-substrait-gateway

Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
Apache License 2.0
15 stars 8 forks source link

feat: implement row_number window function #82

Closed EpsilonPrime closed 2 weeks ago

EpsilonPrime commented 2 weeks ago

Also added a stub for AnalyzePlan's is_streaming check (we always return False) to make pyspark's testing utils happy.

EpsilonPrime commented 2 weeks ago

The row_number test is failing here but not on my local box. Any idea what dependencies might be different that Datafusion uses?

richtia commented 2 weeks ago

The row_number test is failing here but not on my local box. Any idea what dependencies might be different that Datafusion uses?

hmm....i'm not aware of any. this also passes when i try running locally on my mac