databricks / databricks-sdk-py

Databricks SDK for Python (Beta)
https://databricks-sdk-py.readthedocs.io/
Apache License 2.0
346 stars 114 forks source link

[FEATURE] delta_uniform_iceberg property on tables API #746

Open jdavidheiser opened 2 weeks ago

jdavidheiser commented 2 weeks ago

Problem Statement The tables API returns a delta_uniform_iceberg field which includes information like the metadata location. This is extremely important for reading UniForm tables from Iceberg clients.

GET api/2.1/unity-catalog/tables/<catalog-name>.<schame-name>.<table-name>

Proposed Solution Update the TableInfo Dataclass to support all current properties returned by the API.

Additional Context I am surprised that the SDK is not better synchronized with the current state of the API - how long should we expect this lag to be when new features are introduced?

jdavidheiser commented 2 weeks ago

Alternatively, it would be great if every single dataclass had a response field that includes the unmodified response JSON. This would allow us to use that directly when a new feature has not been implemented yet.