ThreeSixtyGiving / datastore

A Data Store application for 360Giving
GNU Affero General Public License v3.0
0 stars 1 forks source link

Develop a Google Colab notebook to ease access to the 360Giving data store #15

Closed robredpath closed 4 years ago

robredpath commented 4 years ago

The objective is to create the skeleton, so that further development and refinement can happen in our normal processes

It should

Bjwebb commented 4 years ago

Support CSV export, with features to support Google BQ import

Do we have some existing code that generates a CSV suitable for BQ?

robredpath commented 4 years ago

Do we have some existing code that generates a CSV suitable for BQ?

See https://opendataservices.plan.io/projects/three-sixty-giving/wiki/Loading_data_into_deployed_GrantNav/17 for how we used to load BQ. I think it's ok for us to do a minimal set of fields right now to ease complexity for this stage.

Bjwebb commented 4 years ago

Here's my finished Colab notebook for review: https://colab.research.google.com/drive/16s3wk4x1vo9yw1UDQwtDouf3UUnJgohR

Bjwebb commented 4 years ago

Something we do in the Kingfisher notebook, but don't have here yet, is a JSON download.

michaelwood commented 4 years ago

Here's my finished Colab notebook for review: https://colab.research.google.com/drive/16s3wk4x1vo9yw1UDQwtDouf3UUnJgohR

Updated to new datastore hostname