search

Kyligence / spark

customized spark for KAP use, checkout kyspark branch
Apache License 2.0
4 stars 51 forks source link

[SPARK-39447][SQL] Avoid AssertionError in AdaptiveSparkPlanExec.doExecuteBroadcast #751

Closed lwz9103 closed 2 months ago

lwz9103 commented 5 months ago

Change currentPhysicalPlan to inputPlan when we restore the broadcast exchange for DPP.

The currentPhysicalPlan can be wrapped with broadcast query stage so it is not safe to match it. For example: The broadcast exchange which is added by DPP is running before than the normal broadcast exchange(e.g. introduced by join).

yes bug fix

add test

Closes #36974 from ulysses-you/inputplan.

Authored-by: ulysses-you ulyssesyou18@gmail.com

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

How was this patch tested?

github-actions[bot] commented 2 months ago

We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue manageable. If you'd like to revive this PR, please reopen it and ask a committer to remove the Stale tag!