apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.39k stars 181 forks source link

Add `execute_logical_plan` method to Ballista context #971

Closed andygrove closed 4 months ago

andygrove commented 5 months ago

Is your feature request related to a problem or challenge? Please describe what you are trying to do. Once https://github.com/apache/arrow-ballista/pull/970 is merged, we have a functional Python client again, but it only supports SQL and not the DataFrame API.

If we add an execute_logical_plan method to the Ballista context then users can use the DataFusion Python API to build logical plans and then execute them via the Ballista context.

Describe the solution you'd like

Describe alternatives you've considered

Additional context