Open damonmcc opened 11 months ago
cc @AmandaDoyle
had issues with missing columns in ZAP data archived from June through July. used version 20230905
and confirmed with the Housing team that the date
and date_type
columns can be used to filter out unwanted records
generated outputs via this PR test run and will share with Housing Team when they choose which Sharepoint folder they'd like it in
built and shared with Housing team for QA on 10/3 via their Sharepoint folder
per closing of https://github.com/NYCPlanning/data-engineering/issues/252, must cherry pick or independently merge to main the fixes from #275
then using those fixes in this branch, must build and share with Housing team
next steps from 11/30
build from 12/12 has issues with some corrections not being applied
build from 12/13 is in QA
corrections based on the 12/13/23 build were give to DE on 1/5/24 and used in build runs here
latest build is in QA
most urgent priority is to fix issues flagged by GIS in aggregation outputs
awaiting new Data Dictionary from GIS. will use it to revise columns in KPDB aggregation tables (with a focus on the NTA and CDTA tables)
Project description
DCP has proposed a set of zoning text amendments called City of Yes for Housing Opportunity (CYHO). The Housing team must develop a new analytical model to do environmental review of CYHO. To do that, they need a version of KPDB where the dates of source data stop at or around 6/30/23.
Requirements
Timing
Notes
New KPDB aggregation table Schema Doc from GIS