[Delta] Exclude default coordinated commits properties during replace - Githubissues

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

7.62k stars 1.71k forks source link

[Delta] Exclude default coordinated commits properties during replace #3658

Closed yumingxuanguo-db closed 2 months ago

yumingxuanguo-db commented 2 months ago

Exclude default CC properties during REPLACE command. Before, all default properties are merged at some later stage of REPLACE; now, we exclude the CC ones. If an existing commit coordinator is retained, the existing ICT properties are also retained; otherwise, default ICT properties are included.
Added UTs.

Which Delta project/connector is this regarding?

[x] Spark
[ ] Standalone
[ ] Flink
[ ] Kernel
[ ] Other (fill in here)

Description

How was this patch tested?

UTs.

Does this PR introduce any user-facing changes?

No.