delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.22k stars 1.62k forks source link

[Spark] Support show tblproperties and update catalog for clustered table #3271

Closed zedtang closed 1 week ago

zedtang commented 1 week ago

Which Delta project/connector is this regarding?

Description

Support show tblproperties for clustered table, and support updating the clustering column properties in the catalog. Remove table properties from describe detail's output since that's using the properties from metadata.

How was this patch tested?

Add verification for table properties, describe detail, and catalog table in verifyClusteringColumns.

Does this PR introduce any user-facing changes?

No