[Do not merge] Re-enable high availability tables

ccao-data / data-architecture

Codebase for CCAO data infrastructure construction and management

https://ccao-data.github.io/data-architecture/

5 stars 3 forks source link

[Do not merge] Re-enable high availability tables #491

Closed jeancochrane closed 3 weeks ago

jeancochrane commented 3 weeks ago

This PR acts as a reversion of https://github.com/ccao-data/data-architecture/pull/490, mostly for the debugging purposes. If we can get to a place where we're very confident in a fix, I'll plan to merge this into the main branch; otherwise, I'll close this once we have a root cause analysis of the failures we're seeing on prod when deploying high availability tables.

jeancochrane commented 3 weeks ago

I wasn't able to reproduce the prod behavior in spite of trying a bunch of changes to the staging configs. My next step is to do an after hours debugging session where I recreate the prod DAG locally using a dbt --log-level debug run --target prod call to see if I can find any clues in the debug logs.