NYCPlanning / ae-data-flow

Data pipelines to populate Application Engineering databases
1 stars 0 forks source link

split bash script into three and update readme #27

Closed damonmcc closed 3 months ago

damonmcc commented 3 months ago

this and previous PRs resolves #4

This is to make local usage (and soon CI usage) more modular.

We likely don't want to re-download source data csvs every time we run changes to source tests or re-run a sql script like populate_tables.sql.

damonmcc commented 3 months ago

love that idea, envars can be a pain. I'll give that a shot in some follow-up work