search

ccao-data / data-architecture

Codebase for CCAO data infrastructure construction and management
https://ccao-data.github.io/data-architecture/
5 stars 3 forks source link

Switch the whole DAG back to high availability #488

Closed jeancochrane closed 3 weeks ago

jeancochrane commented 3 weeks ago

This PR reverts the changes in https://github.com/ccao-data/data-architecture/pull/476, effectively reimplementing https://github.com/ccao-data/data-architecture/pull/462 now that we've built confidence in the HA approach in https://github.com/ccao-data/data-architecture/pull/487 and https://github.com/ccao-data/data-architecture/pull/486.

We also bump our dbt thread count to 16 now that our Athena service quota has been increased to 50 concurrent DDL queries.