ccao-data / data-architecture

Codebase for CCAO data infrastructure construction and management
https://ccao-data.github.io/data-architecture/
5 stars 3 forks source link

Move townhome complex ID creation to AWS, add to Open Data #271

Open dfsnow opened 6 months ago

dfsnow commented 6 months ago

Within in the residential model, we construct a "complex ID" for townhome properties to ensure that like properties receive like values. This ID might be useful for things besides modeling, and could probably be more easily constructed outside the confines of the model pipeline. Therefore, we should consider moving the constructor scripts into the warehouse loader script or a Glue job.

See https://github.com/ccao-data/model-res-avm/issues/85#issuecomment-1858998764 for reference.

dfsnow commented 1 month ago

@wagnerlmichael Another candidate for a Python/Spark dbt model.