ClickHouse / dbt-clickhouse

The Clickhouse plugin for dbt (data build tool)
Apache License 2.0
253 stars 113 forks source link

don't drop local tables when there is no distributed table #363

Open canbekley opened 1 month ago

canbekley commented 1 month ago

Summary

Current distributed incremental runs will drop local production tables when the distributed tables are missing. This can cause irrevesable data loss.

The proposed fix will only drop and create local tables if they actually don't exist in clickhouse. Distributed tables will be created if they are missing (for any reason).

Checklist

Delete items not relevant to your PR:

canbekley commented 2 weeks ago

@BentsiLeviav I added a changelog for this as well