Q3 Opendata Automation Parent Issue - Githubissues

NYCPlanning / data-engineering

Primary repository for NYC DCP's Data Engineering team

20 stars 0 forks source link

Q3 Opendata Automation Parent Issue #1043

Open alexrichey opened 1 month ago

alexrichey commented 1 month ago

August 2, 2024 Meeting Agenda

Updates since last

Paused on further automations
@HengJiang0206 has started on generating our own Data Dictionaries, working with Design Fellows sample here
Packaging from Bytes
- Next time, packaging LION will be immediate.
Refactor for metadata v0 -> v1
- Generalizing/Opening up for other agencies.
- Setting up system to migrate yaml, similar to a database
First batch of socrata pages to migrate. (Q: review process?)

TODO these two weeks

June OpenData
Continuing on with next datasets (Q: which ones?)
Continue refactor from v0 to v1
Maps for new LION datasets.

Discussion Notes:

Top Priority for Packaging is:

Update Shapefile Metadata
XLSX data dictionary generation / update.

Next Dataset to Automate

Zoning
DCM