voltrondata / spark-substrait-gateway

Implements a gateway that speaks the SparkConnect protocol and drives a backend using Substrait (over ADBC Flight SQL).
Apache License 2.0
15 stars 8 forks source link

feat: start the process of moving the backends into their own module #44

Closed EpsilonPrime closed 2 months ago

EpsilonPrime commented 2 months ago

Also splits the execute function into adjust_plan and _execute_plan to separate the plan normalization step from the actual plan execution.

This starts the work requested in #42.