[Spark] Fix wrong entry in COLUMN_MAPPING_METADATA_KEYS

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

7.63k stars 1.71k forks source link

[Spark] Fix wrong entry in COLUMN_MAPPING_METADATA_KEYS #3848

Closed cstavr closed 2 weeks ago

cstavr commented 2 weeks ago

Which Delta project/connector is this regarding?

[X] Spark
[ ] Standalone
[ ] Flink
[ ] Kernel
[ ] Other (fill in here)

Description

Commit d07a7bd50 introduced a bug in COLUMN_MAPPING_METADATA_KEYS: The list should contain PARQUET_FIELD_NESTED_IDS_METADATA_KEY and not PARQUET_MAP_VALUE_FIELD_NAME. This commit fixes this issue.

How was this patch tested?

UTs.

delta-io / delta

[Spark] Fix wrong entry in COLUMN_MAPPING_METADATA_KEYS #3848

Which Delta project/connector is this regarding?

Description

How was this patch tested?

Does this PR introduce any user-facing changes?