delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python

https://delta-io.github.io/delta-rs/

Apache License 2.0

1.98k stars 365 forks source link

Support for rest APIs based catalogs to sync metadata with the metastore #2313

Open gauravtanwar03 opened 3 months ago

gauravtanwar03 commented 3 months ago

Description

Currently Glue and Unity catalogs are supported for only fetching table URIs. This can be extended to full fledged functionalities of registering, updating table and table metadata in the metastores using REST APIs similiar to PyIceberg (https://py.iceberg.apache.org/reference/pyiceberg/catalog/)

Use Case

Related Issue(s)

ion-elgreco commented 3 months ago

Unity catalog is not open so that's not possible

gauravtanwar03 commented 2 weeks ago

Can this be looked into now as the unity catalog is open sourced now?

https://github.com/unitycatalog/unitycatalog