NYCPlanning / data-engineering

Primary repository for NYC DCP's Data Engineering team
23 stars 0 forks source link

Fixes needed for pushing LION datasets #913

Closed alexrichey closed 5 months ago

alexrichey commented 5 months ago

Allows for overriding metadata attributes at the dataset_file and destination level, and fixes the Github Socrata Publish Action. Reading commit-by-commit is 👍

damonmcc commented 5 months ago

gotcha. on the GH action pain, maybe it's similar to what I did in my branch here? yours will get merged first though so we'll go with whatever fix you end up with

alexrichey commented 5 months ago

gotcha. on the GH action pain, maybe it's similar to what I did in my branch here? yours will get merged first though so we'll go with whatever fix you end up with

Exactly, yeah, just needed your one-liner in the edm packaging connector. Working now.