NYCPlanning / data-engineering-qaqc

streamlit app for data engineering
https://edm-data-engineering.nycplanningdigital.com
1 stars 0 forks source link

DevDB: job status is complete and complete year should be non null #222

Open td928 opened 2 years ago

td928 commented 2 years ago

It is noticed in the 22Q2 reviewing process that some of the records with status "5. complete" and has associated units still missing their complete_year. This indicates that their COs are not correctly populated which leads to an investigation in DO and found that dob_cofos failed. Since the dob_cofos is manually ingested for every devdb update and is appended with new records, it is good check to implement to make sure that it is successful.