delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.46k stars 1.68k forks source link

[Feature Request] Define and clean up the semantics for `REPLACE TABLE` #1847

Open jackierwzhang opened 1 year ago

jackierwzhang commented 1 year ago

Feature request

Overview

Currently the semantics for REPLACE TABLE is unclear, right now it acts like a combination of "emptying existing data" + "create new table". This makes it confusing with INSERT OVERWRITE and .mode('overwrite').option('overwriteSchema', 'true'). We should flesh out their semantics matrix clearly.

Motivation

To provide better user semantics.

Further details

N/A

Willingness to contribute

The Delta Lake Community encourages new feature contributions. Would you or another member of your organization be willing to contribute an implementation of this feature?

kailashp19 commented 1 year ago

Yes. I would be willing to contribute this feature with guidance from the Delta Lake community.