apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator
https://datafusion.apache.org/comet
Apache License 2.0
614 stars 113 forks source link

Support sort merge join with a join condition #398

Open viirya opened 1 month ago

viirya commented 1 month ago

What is the problem the feature request solves?

Currently SMJ with join condition is not supported by Comet and falls back to Spark. The feature was added into DataFusion but we've not incorporated it yet. We should do it to add the support.

Describe the potential solution

No response

Additional context

No response

comphead commented 2 weeks ago

@viirya can I take it as I spent some time with SMJ?