Handle larger GTFS datasets without memory error

afimb / gtfslib-python

An open source library in python for reading GTFS files and computing various stats and indicators about Public Transport networks

GNU General Public License v3.0

44 stars 6 forks source link

Handle larger GTFS datasets without memory error #46

Closed pailakka closed 7 years ago

pailakka commented 8 years ago

Adaptations to load Finnish national GTFS dataset to database with lower computational resources.

laurentg commented 8 years ago

Note: Travis build failing on Python 3.2 has been "solved" by https://github.com/afimb/gtfslib-python/commit/a7994fe03e465d22719aaef5c1c19e137f5c8f66 (simply dropping python 3.2 support...)

pailakka commented 8 years ago

I haven't really tested the normalization parts and it seems that shape normalization results to MemoryError when importing the whole national dataset after changes made to it. Therefore I reverted the changes and take closer look at it when I have more time and if need to those parts emerges in our process.