voltrondata / spark-substrait-gateway

Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
Apache License 2.0
16 stars 9 forks source link

feat: implement row_number window function #82

Closed EpsilonPrime closed 3 months ago

EpsilonPrime commented 3 months ago

Also added a stub for AnalyzePlan's is_streaming check (we always return False) to make pyspark's testing utils happy.

EpsilonPrime commented 3 months ago

The row_number test is failing here but not on my local box. Any idea what dependencies might be different that Datafusion uses?

richtia commented 3 months ago

The row_number test is failing here but not on my local box. Any idea what dependencies might be different that Datafusion uses?

hmm....i'm not aware of any. this also passes when i try running locally on my mac