apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator
https://datafusion.apache.org/comet
Apache License 2.0
823 stars 163 forks source link

chore: Revert "chore: Reserve memory for native shuffle writer per partition (#988)" #1020

Closed viirya closed 1 month ago

viirya commented 1 month ago

This reverts commit e146cfa1676fedcfb3003c2e3f1da1578d6b664b.

Which issue does this PR close?

Closes #.

Rationale for this change

There is an issue https://github.com/apache/datafusion-comet/issues/1019 caused by the patch. Reverting the patch temporarily to unblock other works.

What changes are included in this PR?

How are these changes tested?

mbutrovich commented 1 month ago

TPC-H ran clean for me on this PR. Thanks for the quick help!