Initial design and implementation of a workflow for loading datasets directly to Google BigQuery. A new script, bq_load.py must be passed a table definition file, from which it will
create a new dataset (if needed) and table from provided schema
load the dataset, shapefile or CSV, from the data source provided in the table definition
This pull request also includes four table definitions for the 2018 shapefiles (states, counties, zip code tabulation areas, and census tracts) that were included in the v1 release of OEPS.
All four tables load into BigQuery, but for one row in the counties shapefile that seems to error (all other counties load properly though).
Initial design and implementation of a workflow for loading datasets directly to Google BigQuery. A new script,
bq_load.pymust be passed a table definition file, from which it willThis pull request also includes four table definitions for the 2018 shapefiles (states, counties, zip code tabulation areas, and census tracts) that were included in the v1 release of OEPS.
All four tables load into BigQuery, but for one row in the counties shapefile that seems to error (all other counties load properly though).
closes #9