An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
Currently the semantics for REPLACE TABLE is unclear, right now it acts like a combination of "emptying existing data" + "create new table". This makes it confusing with INSERT OVERWRITE and .mode('overwrite').option('overwriteSchema', 'true'). We should flesh out their semantics matrix clearly.
Motivation
To provide better user semantics.
Further details
N/A
Willingness to contribute
The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?
[ ] Yes. I can contribute this feature independently.
[x] Yes. I would be willing to contribute this feature with guidance from the Delta Lake community.
[ ] No. I cannot contribute this feature at this time.
Feature request
Overview
Currently the semantics for
REPLACE TABLE
is unclear, right now it acts like a combination of "emptying existing data" + "create new table". This makes it confusing withINSERT OVERWRITE
and.mode('overwrite').option('overwriteSchema', 'true')
. We should flesh out their semantics matrix clearly.Motivation
To provide better user semantics.
Further details
N/A
Willingness to contribute
The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?