apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.46k stars 185 forks source link

Remove output_partitioning for task definition #776

Closed yahoNanJing closed 1 year ago

yahoNanJing commented 1 year ago

Which issue does this PR close?

Closes #775.

Rationale for this change

Since the output_partitioning has already been encoded in the ExecutionPlan, there's no need to include inside the TaskDefinition.

What changes are included in this PR?

Are there any user-facing changes?

yahoNanJing commented 1 year ago

Hi @thinkharderdev and @andygrove, could you help review this PR?