datastrato / gravitino

World's most powerful data catalog service with providing a high-performance, geo-distributed and federated metadata lake.
https://datastrato.ai/docs/
Apache License 2.0
347 stars 150 forks source link

[#3187] feat(spark-connector): Support SparkSQL extended syntax in Iceberg #3266

Open caican00 opened 1 week ago

caican00 commented 1 week ago

What changes were proposed in this pull request?

Support SparkSQL extended syntax in Iceberg, such as:

addPartitionField
dropPartitionField
replacePartitionField
setWriteDistributionAndOrdering
setIdentifierFields
dropIdentifierFields
createOrReplaceBranch
createOrReplaceTag
dropBranch
dropTag

Why are the changes needed?

Support SparkSQL extended syntax in Iceberg.

Fix: https://github.com/datastrato/gravitino/issues/3187

Does this PR introduce any user-facing change?

No.

How was this patch tested?

New ITs.