chore: Add safety check to CometBuffer

apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator

https://datafusion.apache.org/comet

Apache License 2.0

823 stars 163 forks source link

chore: Add safety check to CometBuffer #1050

Open viirya opened 2 weeks ago

viirya commented 2 weeks ago

Which issue does this PR close?

Closes #1035.

Rationale for this change

What changes are included in this PR?

How are these changes tested?

viirya commented 2 weeks ago

This cannot pass all tests due to an issue (#1059) at Spark side.

viirya commented 2 weeks ago

I'm considering to add a workaround in Comet as waiting for Spark change might take longer time (and for 3.4/3.5 such change might not easily to backport).