splitgraph / seafowl

Analytical database for data-driven Web applications 🪶
https://seafowl.io
Apache License 2.0
388 stars 9 forks source link

Implement conversion of parquet to Delta tables #469

Closed gruuya closed 7 months ago

gruuya commented 7 months ago

Introduce an analogue to https://docs.databricks.com/en/sql/language-manual/delta-convert-to-delta.html

This should make use of https://github.com/delta-io/delta-rs/pull/1686 behind the scenes. It should also work in-place (i.e. for parquet tables stored inside the Seafowl data dir) and optionally for parquet tables stored in other folders/buckets or even object stores.