apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator
https://datafusion.apache.org/comet
Apache License 2.0
646 stars 119 forks source link

Comet doesn't support Spark BroadcastHashJoinExec if it is null-aware anti-join #457

Open viirya opened 1 month ago

viirya commented 1 month ago

What is the problem the feature request solves?

DataFusion HashJoin LeftAnti doesn't support null-aware anti join.

See https://github.com/apache/datafusion/issues/10583

Describe the potential solution

No response

Additional context

No response

viirya commented 1 month ago

For details about Spark null-aware anti join, see https://issues.apache.org/jira/browse/SPARK-32290.