delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
6.96k stars 1.58k forks source link

[Kernel][Writes] Add schema validation utils #3003

Closed vkorukanti closed 2 weeks ago

vkorukanti commented 2 weeks ago

Description

(Split from the larger PR #2944)

These are utility to make sure the given schema when creating the table is valid (has no duplicate column names or invalid chars). The code/logic is similar to Delta-Spark/Standalone.

How was this patch tested?

Unittests