search

apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator
https://datafusion.apache.org/comet
Apache License 2.0
823 stars 163 forks source link

[BUG]: SortMergeJoin filtered LeftAnti fails on TPCH Q21 #861

Open comphead opened 3 months ago

comphead commented 3 months ago

[BUG]: SortMergeJoin filtered LeftAnti fails on TPCH Q21. It was a problem with DataFusion SMJ Join TPCH queries which has been fixed. However this particular problem can be related to https://github.com/apache/datafusion/issues/11555

_Originally posted by @comphead in https://github.com/apache/datafusion-comet/pull/553#discussion_r1725752744_

comphead commented 3 months ago

I tried benches in DF with SMJ, it works on main 

 PREFER_HASH_JOIN=false ./benchmarks/bench.sh run tpch
comphead commented 3 days ago

Waiting for DataFusion 44.0.0