deployment-gap-model-education-fund / deployment-gap-model

ETL code for the Deployment Gap Model Education Fund
https://www.deploymentgap.fund/
MIT License
6 stars 2 forks source link

Create a dev BigQuery dataset #282

Closed bendnorman closed 1 year ago

bendnorman commented 1 year ago

This PR creates two new BQ datasets in GCP project dbcp-dev-350818: data_warehouse_dev and data_mart_dev. These new development datasets will allow us to push changes to BQ without breaking downstream services (google sheets and tableau).

Things I'd like to do when I get back from vacation.

I figured this PR can be merged in now and the above issues could be handled in a separate PR.

TrentonBush commented 1 year ago

Nice! Thanks for setting this up. I tested out the changes and they look good to me.

All the post-vacation to-dos sound good too. Is the point of the proposed _prod suffix basically just to make dev/prod more explicit? I guess we should probably do it but I'm looking for an excuse to be lazy.

bendnorman commented 1 year ago

Yeah, the name change would just make things more explicit. We should probably scope out how much work it would be to update all of the BI tools with the new name.