ccao-data / data-architecture

Codebase for CCAO data infrastructure construction and management
https://ccao-data.github.io/data-architecture/
6 stars 4 forks source link

[Data catalog] Flesh out dev docs on how to build and test with dbt #67

Closed jeancochrane closed 1 year ago

jeancochrane commented 1 year ago

We have some barebones documentation in dbt/README.md, but currently it only explains how to install requirements and run some basic build and test commands. We should also document the scope of the project more broadly and explain how to develop it.

Some topics to cover, off the top of my head:

Compilation Error
  dbt found two schema.yml entries for the same resource named location.vw_pin10_location. Resources and their associated columns may only be described a single time. To fix this, remove one of the resource entries for location.vw_pin10_location in this file:
   - models/location/schema.yml

Depends on the final pieces of infrastructure being complete, namely

55 and https://github.com/ccao-data/service-sqoop-iasworld/issues/1.

jeancochrane commented 1 year ago

Related: https://github.com/ccao-data/data-architecture/issues/108