carbonfact / lea

🏃‍♀️ Minimalist alternative to dbt
Apache License 2.0
202 stars 6 forks source link

Write audit publish pattern #31

Closed MaxHalford closed 6 months ago

MaxHalford commented 6 months ago

This works well for DuckDB.

BigQuery, alas, does not support DDL statements (i.e. rename and delete) in a transaction. So the necessary queries are run concurrently. It's not ideal, but it works quite quickly.