[Protocol RFC] Specify collation versions - Githubissues

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

7.62k stars 1.71k forks source link

[Protocol RFC] Specify collation versions #3741

Open c27kwan opened 1 month ago

c27kwan commented 1 month ago

Which Delta project/connector is this regarding?

[ ] Spark
[ ] Standalone
[ ] Flink
[ ] Kernel
[x] Other (RFC protocol change)

Description

In this PR, we amend the current RFC proposal for the Collations table feature.

We should not have readVersion hints as part of the table, since the choice of collation versions is a decision at the engine level. For e.g. consider a join between two tables with different collation versions.
We also specify the Reader Requirements and Write Requirements more explicitly for the table feature.

How was this patch tested?

N/A

Does this PR introduce any user-facing changes?

'No'