sparkutils / quality

A Quality Spark DQ Library
https://sparkutils.github.io/quality/
Apache License 2.0
4 stars 2 forks source link

Subquery re-writes - 47509 handling #62

Closed chris-twiner closed 4 months ago

chris-twiner commented 4 months ago

Due to https://issues.apache.org/jira/browse/SPARK-47509 4.0 and #57 14.3 no longer allow the lambda as a join in-place builder from a rule.

If possible re-writes must take place, can only be dev'd against 4.0 snaps.

chris-twiner commented 4 months ago

tested on 14.3, 4.0 etc.