search

ClickHouse / dbt-clickhouse

The Clickhouse plugin for dbt (data build tool)
Apache License 2.0
255 stars 113 forks source link

dictionaries broken on clusters #325

Closed the4thamigo-uk closed 3 months ago

the4thamigo-uk commented 4 months ago

Describe the bug

Repeatedly building dictionaries on a clustered clickhouse is flakey. The __dbt_backup relations are not removed from all nodes, causing errors such as 

Cache inconsistency detected: in rename, new key ReferenceKey...

Steps to reproduce

  1. create a dictionary model
  2. run dbt build multiple times against a clickhouse cluster with 2+ nodes

Expected behaviour

Should build reliably, but breaks with alternate invocations.