edgi-govdata-archiving / ECHO-by-Zip-Code

A Jupyter Notebook-based exploration of emissions permits, compliance, and enforcement designed for localization by zip code
https://colab.research.google.com/github/edgi-govdata-archiving/ECHO-by-Zip-Code/blob/main/echo-by-zip.ipynb
GNU General Public License v3.0
1 stars 2 forks source link

A better way to store the data? #6

Closed Frijol closed 4 years ago

Frijol commented 4 years ago

Currently we're using git-lfs (large file storage) to host the ECHO exporter in a raw CSV (in its own repo) so that CoLab can draw from it.

I'm honestly not sure why it's letting us, it's 1.5x the official permitted free amount of storage.

Right now it's working, but this isn't really a good solution and doesn't scale well to updates (it should update quarterly just for the ECHO Exporter) or potentially adding other data in the future.

(just for completeness, here's the discussion around getting the data in the cloud at all: https://github.com/edgi-govdata-archiving/ECHO-by-Zip-Code/issues/2)

ericnost commented 4 years ago

Switched to SBU database