NYCPlanning / data-engineering

Primary repository for NYC DCP's Data Engineering team
20 stars 0 forks source link

Push COLP to Socrata via automations #427

Closed alexrichey closed 7 months ago

damonmcc commented 8 months ago

there seem to be 3 distinct Socrata datasets for COLP (search results here). I stumbled onto this while working on the packaging stage that would come before pushing

edit: I also could've learned this from GIS's Open Data list in Sharepoint here (noting that "Open Data" here refers to Socrate and Bytes)

damonmcc commented 8 months ago

per GIS comment here, COLP 23v2 is awaiting Socrata publishing

could do it manually (by emailing GIS or using the Socrate GUI) if we want to update Socrata asap

alexrichey commented 8 months ago

@damonmcc @croswell81 - Makes sense. We'll test pushing COLP to Socrata via the API either today or tomorrow

croswell81 commented 8 months ago

@alexrichey Let's schedule some time to go over what prerequisites need to be completed and kick it off together. Can be done later this week. @damonmcc

alexrichey commented 8 months ago

Outcome of Experiments to Push COLP:

Next Steps to Investigate: