Create New EDDE Download FIles

NYCPlanning / ose-equity-tool-etl

Contains code necessary to process the EDDE data files created by Data Engineering into the format expected by the equity-tool frontend. Managed by Open Source Engineering

2 stars 0 forks source link

Create New EDDE Download FIles #37

Open dhochbaum-dcp opened 6 months ago

dhochbaum-dcp commented 6 months ago

Currently waiting on approval from Winnie.

dhochbaum-dcp commented 5 months ago

Labels to update:

Table 3.09 for evictions, NYC Department of Investigation, 2019-2023 should be updated to 2019-2024
Table 3.11 for income restricted housing - NYC Housing Preservation and Development, 2022 should be updated to 2024
Column header in Table 4.02: Homes with New or Extended Affordability Requirements by AMI Band should be updated to NYC Housing Preservation and Development, 2014-2024
Column header in Table 3.11: NYC Housing Authority, 2022 should be updated to 2023
Column header in Table 3.12 should be updated to NYC Housing Authority, 2023
Table 4.01: Change in Housing Units should be updated to Housing Database, 2023 Q4

dhochbaum-dcp commented 5 months ago

@pratishta these are the label changes.

TylerMatteo commented 5 months ago

@damonmcc @dhochbaum-dcp How can we catch this earlier in future updates? Not saying it's a big deal but I asked on a couple occasions about changes to labels due to the data being for different years and was assured that wasn't the case for the update this year.

One other question - are these changes to the years also reflected in the data itself? For some categories, the year is in the file name (e.g. demographics_1721_borough.csv) and for others the year is part of the column names. Are those column names and files also different?

TylerMatteo commented 5 months ago

One other question - are these changes to the years also reflected in the data itself? For some categories, the year is in the file name (e.g. demographics_1721_borough.csv) and for others the year is part of the column names. Are those column names and files also different?

Never mind, I went through the code for those tables and none of the variable names or files have years, so we should be all good there. One question - in the app for table 4.01, we have "2010 - 2022" in the indicator heading above the table itself. Should we update that to "2010 - 2023"?

TylerMatteo commented 5 months ago

☝ Going to shoot Winnie an email about this. I'll CC folks

dhochbaum-dcp commented 5 months ago

@TylerMatteo @pratishta Damon has pushed updated data to DO, you should be able to grab it and re-run the ETL.

TylerMatteo commented 5 months ago

@pratishta Winnie confirmed that title should be updated to "2010 - 2023"

dhochbaum-dcp commented 5 months ago

Excel downloads are complete. PDF downloads includes files not created by our team. Winnie will provide the community profile summaries next week.

pratishta commented 5 months ago

The new data has been generated from ETL and uploaded on DO