search

sc3 / cookcountyjail

A Django app that tracks the population of Cook County Jail over time and summarizes trends.
http://cookcountyjail.recoveredfactory.net/api/1.0/?format=json
Other
31 stars 23 forks source link

Make the raw API serve zipped data #453

Open bepetersn opened 10 years ago

bepetersn commented 10 years ago

As it is currently, we take up a lot of space (~4 MB) each day with unzipped copies of the results of a scrape. We were considering making it zipped data before @nwinklareth left, if I am recalling correctly. Or am I wrong?

nwinklareth commented 10 years ago

Storing 10 years of snapshots will take up 65% or so of the remaining 31G of free disk space, so it is not that pressing of a concern.

Upon reflection I think that the snapshots should be moved to Amazon S3 drive, this would minimize the storage and delivery cost for that data.

Norbert

On Sat, Jul 5, 2014 at 1:52 PM, Brian Everett Peterson < notifications@github.com> wrote:

As it is currently, we take up a lot of space (~4 MB) each day with unzipped copies of the results of a scrape. We were considering making it zipped data before Norbert left, I just remembered.

— Reply to this email directly or view it on GitHub https://github.com/sc3/cookcountyjail/issues/453.

Regards

Norbert

Norbert Winklareth

bepetersn commented 10 years ago

Hey, that's a good idea. Because money required for hosting IS a concern where space is not so much, as you point out. Should I make that a future issue?