Wraedy/bigquery db connector

move-coop / parsons

A python library of connectors for the progressive community.

https://www.parsonsproject.org/

Other

258 stars 128 forks source link

Wraedy/bigquery db connector #875

Closed willyraedy closed 10 months ago

willyraedy commented 12 months ago

Three main changes:

Extends the BigQuery database connector to mimic more of the functionality of the Redshift connector.
Extends the DB Connector class slightly.
Moves BigQuery into the databases folder.

Main goal is to prepare the TMC network to migrate scripts from Redshift to BigQuery.

willyraedy commented 11 months ago

@shaunagm @Jason94 I'm gonna add some unit tests before I mark this ready to merge but if y'all want to give it a once over should be ready for that

sharinetmc commented 11 months ago

@shaunagm Hiya! Just wondering if you had the time to take a look at this!

willyraedy commented 10 months ago

Appreciate it Jason! I'm a little sick so @IanRFerguson is gonna take a run at making those changes. They mostly seem pretty minor so I suspect he'll be able get through those today or tomorrow

IanRFerguson commented 10 months ago

@Jason94 I used some discretion to move many of the info-level logs to debug ... there's one outstanding comment that I'm talking through with Willy now but then we should be all set for another review