damonmcc commented 11 months ago

Product Name

cpdb

Build Version

24_preliminary

Status of Update

[x] source data extracted
[x] draft build succeeded
[x] draft build passed QA
[x] data packaged and distributed

fvankrieken commented 9 months ago

All external agency partners contacted about source data

fvankrieken commented 8 months ago

Update source data

Read more about who to reach out to and how to update a specific dataset here

Received from agency partner and manually loaded into data libraries

[x] Capital Commitment Plan: fisa_capitalcommitments
[x] ddc_capitalprojects_infrastructure
[x] ddc_capitalprojects_publicbuildings
[x] dot_projects_bridges
[x] edc_capitalprojects - new data needs to be appended onto existing source dataset
[x] edc_capitalprojects_ferry - new data is often not received and this dataset is not updated with each release because nothing has changed.

Automatically loaded into data libraries

Before initiating a build of cpdb, verify the latest version in DigitalOcean matches the version in NYC OpenData

Projects

[x] cpdb_capital_spending - updated with action
[x] dot_projects_intersections https://data.cityofnewyork.us/Transportation/Street-and-Highway-Capital-Reconstruction-Projects/97nd-ff3i
[x] dot_projects_streets https://data.cityofnewyork.us/Transportation/Street-and-Highway-Capital-Reconstruction-Projects/jvk9-k4re
[x] dpr_capitalprojects https://www.nycgovparks.org/bigapps
[x] dpr_parksproperties https://data.cityofnewyork.us/Recreation/Parks-Properties/enfh-gkve
[x] dcp_cpdb_agencyverified (does not get updated)

Building and lot-level info

[x] dcp_mappluto_wi https://www1.nyc.gov/site/planning/data-maps/open-data/dwn-pluto-mappluto.page
[x] dcp_facilities https://www1.nyc.gov/site/planning/data-maps/open-data/dwn-selfac.page
[x] doitt_buildingfootprints https://data.cityofnewyork.us/Housing-Development/Building-Footprints/nqwf-w8eh

Spatial boundaries

Come from Geosupport update

[x] dcp_stateassemblydistricts https://www1.nyc.gov/assets/planning/download/pdf/data-maps/open-data/nyad_metadata.pdf?ver=21d
[x] dcp_ct2020 https://www1.nyc.gov/site/planning/data-maps/open-data/districts-download-metadata.page
[x] dcp_congressionaldistricts https://www1.nyc.gov/site/planning/data-maps/open-data/districts-download-metadata.page
[x] dcp_cdboundaries https://www1.nyc.gov/site/planning/data-maps/open-data/districts-download-metadata.page
[x] dcp_statesenatedistricts https://www1.nyc.gov/site/planning/data-maps/open-data/districts-download-metadata.page
[x] dcp_municipalcourtdistricts https://www1.nyc.gov/site/planning/data-maps/open-data/districts-download-metadata.page
[x] dcp_school_districts https://www1.nyc.gov/site/planning/data-maps/open-data/districts-download-metadata.page
[x] dcp_councildistricts https://www1.nyc.gov/assets/planning/download/pdf/data-maps/open-data/nycc_metadata.pdf

Other

[x] dcp_trafficanalysiszones - this dataset is almost never updated
[x] nypd_policeprecincts https://data.cityofnewyork.us/Public-Safety/Police-Precincts/78dh-3ptz
[x] fdny_firecompanies https://data.cityofnewyork.us/Public-Safety/Fire-Companies/iiv7-jaj9

damonmcc commented 7 months ago

per GIS comment here, OTI can't distribute this update to Open Data because of the schema changes

DCP will update the Open Data portal pages with the new schema and upload the new data (manually or via API)

fvankrieken commented 7 months ago

@croswell81 @caseysmithpgh @jackrosacker - CPDB 24prelim after a bit of delay is ready to go to bytes. It's published to "24prelim" and "latest" in edm-publishing/db-cpdb/publish

fvankrieken commented 6 months ago

Leaving open while we're working on getting it to open data. It's on bytes

damonmcc commented 6 months ago

re-assigning to myself as I work on distribution to Open Data

croswell81 commented 6 months ago

@damonmcc we have not published 24prelim to BYTES so no rush on uploading to Open Data portal yet. We will let you know when it is uploaded to BYTES first. cc: @caseysmithpgh

damonmcc commented 6 months ago

@caseysmithpgh sent 24prelim to be published on BYTES

croswell81 commented 6 months ago

@damonmcc for clarification, you can skip 23adopt and publish 24prelim to the open data portal

damonmcc commented 5 months ago

automated Open Data publishing is working (PRs in review) and I used 23adopt while testing things out

will push 24prelim asap