Implement spark run-operations

dbt-labs / spark-utils

Utility functions for dbt projects running on Spark

https://hub.getdbt.com/fishtown-analytics/spark_utils/latest/

Apache License 2.0

31 stars 15 forks source link

Implement spark run-operations #2

Closed NielsZeilemaker closed 2 years ago

NielsZeilemaker commented 4 years ago

I've implemented two run-operations which can optimize all delta tables, or compute the column statistics of all tables. Similar to the vacuum operations of redshift.

JCZuurmond commented 3 years ago

@jtcohen6, @NielsZeilemaker : Can this PR be merge? I would like to use this macro.

JCZuurmond commented 2 years ago

@jtcohen6 and @NielsZeilemaker : once more: can we merge this macro in?

jtcohen6 commented 2 years ago

Closing in favor of #18