hackoregon / transportation-systems

Hack Oregon Repository to develop code for the Transportation Theme of CIVIC.
MIT License
5 stars 2 forks source link

Build / distribute TriMet congestion database #20

Closed znmeb closed 6 years ago

znmeb commented 6 years ago

This is in progress in repository https://github.com/hackoregon/transportation-congestion-analysist. The best overview is in https://github.com/hackoregon/transportation-congestion-analysis/blob/master/src/data/README.md.

My initial plan is to distribute both individual table dumps, and a dump of the complete database for the more adventurous / computationally empowered. I recommend exploring the data a month at a time; there are four tables for each month that take up about 10 GB of your PostgreSQL data directory. The whole thing is about 30 GB.

znmeb commented 6 years ago

I'm going to close this for now. I've consolidated the tables - instead of twelve, each with a month of data, there are four tables, each with the whole three-month dataset. The restorable pg_dump is now a directory of about 5.8 GB. I can push that up to Google Drive along with a script to restore it.

In theory, one could mount this backup inside a PostgreSQL container and restore it into the database, but that's a length process.