delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.22k stars 1.62k forks source link

[Feature Request] Add tests for clustered tables with columns with commas in the name #3265

Closed chirag-s-db closed 1 week ago

chirag-s-db commented 1 week ago

Feature request

Which Delta project/connector is this regarding?

Overview

To ensure proper parsing and handling of clustering column names, we should add test coverage for clustered tables where the clustering columns contain commas in the name.

We can add tests for these columns in ClusteredTableDDLDataSourceV2IdColumnMappingSuite.scala.

Further details

Note that the current test utility verifyClusteringColumnsInDomainMetadata will currently not support column names with commas in them and should be updated to support this case.

Willingness to contribute

The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?