search

healthyregions / oeps

Opioid Environment Policy Scan - data explorer and backend management
https://oeps.healthyregions.org
GNU General Public License v3.0
0 stars 0 forks source link

Create initial test script or notebook to load data into Google BigQuery #1

Closed mradamcox closed 11 months ago

mradamcox commented 1 year ago

Choose one of the CSVs (a simple one) and create an example python script that loads that CSV into Google BigQuery. Don't worry about shapefiles or geometry columns of any kind.

This will require installing the python client for Google BigQuery, so that package must be added to requirements.txt (looks like six as well).

As far as I can tell, based on this documentation, I think this is the approach we will be using:

image

This looks to be a good example to start from: https://cloud.google.com/bigquery/docs/loading-data-cloud-storage-csv#loading_csv_data_into_a_table

mradamcox commented 11 months ago

This is essentially handled now through the creation of the bq_load.py script, so I'm going to close this ticket.