search

NYCPlanning / db-facilities

🏭 🏢 🏬 🏣 🏤 🏥 🏦 🏨 🏪 🏫 🏩
https://nycplanning.github.io/db-facilities
0 stars 0 forks source link

2021 Refactor Progress Tracker #359

Closed SPTKL closed 3 years ago

SPTKL commented 3 years ago

✅ : Yes / complete / done 🚧 : In progress / pipeline PR needs review 🚫 : Roadblock / problem

✅ Group 1 @mgraber

|Name| data library | Python|SQL| |------|------------|-------|----| |dca_operatingbusinesses| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142)| ✅ |✅ | |dcla_culturalinstitutions| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #361 | ✅ #362 | |dcp_colp| ✅ [52](https://github.com/NYCPlanning/db-data-library/pull/52) | ✅ | ✅ #362 | |dcp_pops| ✅ [151](https://github.com/NYCPlanning/db-data-library/pull/151) | ✅ #361 | ✅ #362 | |dcp_sfpsd| ✅ [149](https://github.com/NYCPlanning/db-data-library/pull/149) | ✅ #361 | ✅ #362 |

✅ Group 2 @mgraber

|Name| data library | Python|SQL| |------|------------|-------|----| |dep_wwtc| ✅ [157](https://github.com/NYCPlanning/db-data-library/pull/157) | ✅ #380 | ✅#386 | |dfta_contracts| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) |✅ #380 | ✅#386 | |doe_busroutesgarages| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) |✅ #380 | ✅#386 | |doe_lcgms| ✅ [65](https://github.com/NYCPlanning/db-data-library/pull/65)|✅ #380 | ✅ #386 | | sca_enrollment_capacity (input for doe_lcgms workflow) | ✅ [170](https://github.com/NYCPlanning/db-data-library/pull/170)| ✅ #386 | N/A | |doe_universalprek| ✅ [149](https://github.com/NYCPlanning/db-data-library/pull/149) | ✅ #380| ✅#386 | |dohmh_daycare| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #380 | ✅#386 |

✅ Group 3 @mgraber

|Name| data library | Python|SQL| |------|------------|-------|----| |dot_bridgehouses| ✅ [153](https://github.com/NYCPlanning/db-data-library/pull/153) | ✅ #364 | ✅ #381 | |dot_ferryterminals| ✅ [153](https://github.com/NYCPlanning/db-data-library/pull/153) | ✅ #364 | ✅ #381 | |dot_mannedfacilities| ✅ [153](https://github.com/NYCPlanning/db-data-library/pull/153) | ✅ #364 | ✅ #381 | |dot_pedplazas| ✅ [153](https://github.com/NYCPlanning/db-data-library/pull/153) | ✅ #364 | ✅ #381 | |dot_publicparking| ✅ [153](https://github.com/NYCPlanning/db-data-library/pull/153) | ✅ #364 | ✅ #381 |

✅ Group 4 @mgraber

|Name| data library | Python|SQL| |------|------------|-------|----| |dpr_parksproperties|✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #378 | ✅ #387 | |dsny_mtsgaragemaintenance| ✅ [158](https://github.com/NYCPlanning/db-data-library/pull/158)* | ✅ #372 | ✅ #387 | |dycd_afterschoolprogram| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #378 | ✅ #387 | |fbop_corrections|✅ [156](https://github.com/NYCPlanning/db-data-library/pull/156) | ✅ #378 | ✅ #387 | |fdny_firehouses| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #378 | ✅ #387 | *No longer a single input. Now: dsny_garages, dsny_specialwastedrop, dsny_textiledrop, dsny_leafdrop, dsny_fooddrop, dsny_electronicsdrop

Group 5 @mgraber

Name data library Python SQL
foodbankny_foodbanks ✅ 149 ✅ #379 🚧 #392
hhc_hospitals ✅ 142 ✅ #379 🚧 #392
hra_centers ✅ 158* ✅ #372 🚧 #392
moeo_socialservicesitelocations ✅ 158 ✅ #379
nycdoc_corrections ✅ 149 ✅ #379

*No longer a single input. Now: hra_snapcenters, hra_jobcenters, hra_medicaid

✅ Group 6 @mgraber

|Name| data library | Python|SQL| |------|------------|-------|----| |nycha_communitycenters| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #369 | ✅ #402| |nycha_policeservice| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #369| ✅ #402| |nycourts_courts| ✅ [155](https://github.com/NYCPlanning/db-data-library/pull/155)| ✅ #369 |✅ #402| |nypl_libraries| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ |✅ #402| |nysdec_lands| ✅ [144](https://github.com/NYCPlanning/db-data-library/pull/144) | ✅ #369| ✅ #402|

✅ Group 7 @mgraber

|Name| data library | Python|SQL| |------|------------|-------|----| |nysdec_solidwaste| ✅ NYCPlanning/db-data-library/pull/144 | ✅ #363 | ✅ #382 | |nysdoccs_corrections| ✅ NYCPlanning/db-data-library/pull/149 | ✅ #363 | ✅ #382 | |nysdoh_healthfacilities| ✅ NYCPlanning/db-data-library/pull/144 | ✅ #363 |✅ #382 | |nysdoh_nursinghomes| ✅ NYCPlanning/db-data-library/pull/144 | ✅ #363 |✅ #382 | |nysed_activeinstitutions* | ✅ NYCPlanning/db-data-library/pull/152 | ✅ #363 |✅  #382 | |nysed_nonpublicenrollment* | ✅ NYCPlanning/db-data-library/pull/165 | ✅ #382 | ✅ #382| *Previously, the two nysed datasets were combined into a single dataset in [this script](https://github.com/NYCPlanning/db-facilities/blob/main/facdb_build/sql/nysed_activeinstitutions.sql). Should this happen within a python script in data-library or as a sql script in facdb? @SPTKL

✅ Group 8 @rubenvecg

|Name| data library | Python|SQL| |------|------------|-------|----| |nysoasas_programs| ✅ [144](https://github.com/NYCPlanning/db-data-library/pull/144) |✅#384 |✅#394 | |nysomh_mentalhealth|✅ [154](https://github.com/NYCPlanning/db-data-library/pull/154) |✅#377 |✅#394| |nysopwdd_providers| ✅ [144](https://github.com/NYCPlanning/db-data-library/pull/144) |✅#384 |✅#394| |nysparks_historicplaces| ✅ [144](https://github.com/NYCPlanning/db-data-library/pull/144) | ✅#384|✅#394| |nysparks_parks| ✅ [144](https://github.com/NYCPlanning/db-data-library/pull/144) | ✅#384|✅#391 |

✅ Group 9 @mgraber

|Name| data library | Python|SQL| |------|------------|-------|----| |qpl_libraries| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #375 | ✅ #385 | |sbs_workforce1| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #375 |✅ #385 | |uscourts_courts| ✅ [142](https://github.com/NYCPlanning/db-data-library/pull/142) | ✅ #375 |✅ #385 | |usdot_airports| ✅ [144](https://github.com/NYCPlanning/db-data-library/pull/144) | ✅ #375 |✅ #385 | |usdot_ports| ✅ [144](https://github.com/NYCPlanning/db-data-library/pull/144) | ✅ #375 |✅ #385 | |usnps_parks| ✅ [162](https://github.com/NYCPlanning/db-data-library/pull/162) | ✅ #375 |✅ #385 |
SPTKL commented 3 years ago

@mgraber I'll work on nysed_activeinstitutions and nysed_nonpublicenrollment. The plan is that they will be seperate datasets in data library, and they will have seperate pipelines in pipelines.py and only nysed_activeinstitutions will have a sql script.

we can just do a merge in a select statement instead of having to deal with multiple temporary tables