search

hbutani / icebergSQL

Integration of Iceberg table management into Spark SQL
Apache License 2.0
11 stars 4 forks source link

support update、delete、merge sql #3

Open melin opened 5 years ago

melin commented 5 years ago

The big advantage of iceberg is that it supports delete and update, and all operations are performed through sql to make it easy for users to use.

hbutani commented 5 years ago

there is no support for delete, update for datsources v1 in spark 2.x This is coming in Spark 3.0 for datasources v2. For Spark 2.x you can simulate an update/delete by doing an insert overwrite.

melin commented 5 years ago

Refer to this method to extend the sql syntax： https://github.com/delta-io/delta/commit/b9cf201fee07d5748e0a8b53883c6a5902cf836f