search

MobilityData / mobility-feed-api

Apache License 2.0
8 stars 3 forks source link

Add zipped and unzipped sizes to the GTFS dataset #650

Open davidgamez opened 1 month ago

davidgamez commented 1 month ago

Describe the problem

We should add the size of the zip and unzipped versions to the dataset's metadata. For producers, this can help them make storage requirement analyses without having to download the file. For internal use, we can make better decisions regarding storage needs and tune the data pipeline to use bigger VMs for bigger feeds.

Proposed solution

Add zipped and unzipped sizes to the GTFS dataset table.

Alternatives you've considered

No response

Additional context

No response

emmambd commented 1 month ago

@davidgamez is this worth including as part of the "unfetchable" milestone?

davidgamez commented 1 month ago

@davidgamez is this worth including as part of the "unfetchable" milestone?

Yes, it can be part of the unfetchable milestone. On a different topic, I haven't thought about how to have this information rendered in the UI.

emmambd commented 1 month ago

TransitFeeds had it associated with each individual dataset, which I think makes the most sense: https://transitfeeds.com/p/128-business-council/763