An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Changed DataSkippingPredicate to be interface, and added two new classes which implement this interface, DefaultDataSkippingPredicate (basically old DataSkippingPredicate) and CollatedDataSkippingPredicate.
Changed constructDataSkippingFilter to be collation aware.
How was this patch tested?
Tests added to DataSkippingUtilsSuite and StatsSchemaHelperSuite.
Which Delta project/connector is this regarding?
Description
Changed DataSkippingPredicate to be interface, and added two new classes which implement this interface, DefaultDataSkippingPredicate (basically old DataSkippingPredicate) and CollatedDataSkippingPredicate. Changed constructDataSkippingFilter to be collation aware.
How was this patch tested?
Tests added to
DataSkippingUtilsSuiteandStatsSchemaHelperSuite.Does this PR introduce any user-facing changes?
No.