[KERNEL] Support for CollatedPredicate

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

7.63k stars 1.71k forks source link

[KERNEL] Support for CollatedPredicate #3735

Open ilicmarkodb opened 1 month ago

ilicmarkodb commented 1 month ago

Which Delta project/connector is this regarding?

[ ] Spark
[ ] Standalone
[ ] Flink
[X] Kernel
[ ] Other (fill in here)

Description

Added CollatedPredicate, which extends Predicate and it should be used for comparing strings in collated fashion.

How was this patch tested?

Tests added to DefaultExpressionEvaluatorSuite and ImplicitCastExpressionSuite.

Does this PR introduce any user-facing changes?

Yes, it introduce new type of Predicate, CollatedPredicate.