dbt-labs / spark-utils

Utility functions for dbt projects running on Spark
https://hub.getdbt.com/fishtown-analytics/spark_utils/latest/
Apache License 2.0
30 stars 15 forks source link

Add table maintenance for iceberg table format #24

Open cccs-jc opened 2 years ago

cccs-jc commented 2 years ago

spark-utils has table maintenance macros for DeltaLake tables.

For example these macros list the tables in a schema and perform vacuum. https://github.com/dbt-labs/spark-utils/blob/b41aab4e63acb205d11bf80e2a7bbe0dd63a3c6f/macros/maintenance_operation.sql

In the same manner, it would be great if spark-utils also had support for Iceberg table maintenance.

https://iceberg.apache.org/docs/latest/spark-procedures/#metadata-management Examples of maintenance could be