OpenTransitTools / gtfsdb

GTFS ORM using SQLAlchemy
Mozilla Public License 2.0
157 stars 45 forks source link

Database ingest times #63

Closed mattcaruso closed 4 months ago

mattcaruso commented 4 months ago

I'm currently building a database from the NJ Transit bus GTFS files. The data is about 200MB uncompressed. It's taking 3+ days to build the database. Is that expected? Or do you think this could be an issue with my Postgres host?

I've searched around the repo's discussions to see if expected processing times is mentioned anywhere and haven't had any luck.

fpurcell commented 4 months ago

That processing time is not what I'd expect, Matt.

On my MacBook, I was able to load NJT's bus gtfs (took under 20 minutes):

fpurcell commented 4 months ago

njt_route.json

fpurcell commented 4 months ago
Screenshot 2024-05-07 at 1 21 24 AM