ccao-data / data-architecture

Codebase for CCAO data infrastructure construction and management
https://ccao-data.github.io/data-architecture/
6 stars 4 forks source link

Define a dbt test to validate CALP models #319

Open jeancochrane opened 7 months ago

jeancochrane commented 7 months ago

Rodrigo has been setting CALP model parameters in the "Neighborhood Parameters" form of iasWorld, and has been configuring these parameters based on a canonical Excel workbook. Since there are ~10k parameters, he's interested in a test that could compare the workbook to the iasWorld state to confirm no transcription errors.

I think the easiest way to do this will be to turn the canonical Excel workbook into a seed and join that to the Neighborhood Parameters table. That latter part might be slightly tricky, since I'm not sure if or how we ingest these parameters into our warehouse yet.

Spun off of #308.