seykron / ogov-data

Argentina's Congress Datasets in JSON format
GNU General Public License v2.0
1 stars 1 forks source link

Commit uncompressed bills #1

Open martinszy opened 10 years ago

martinszy commented 10 years ago

This is a request to commit the bills in uncompressed state to this repository. This will allow a wonderfull new feature: using git to discover the changes between each run of the importer. This, in turn, solves PART of the problem of delta updates, in the sense that when I update my database, I only have to update the files updated in the latest commit. In the current setup (with the compressed bills file) I have to run a series of commands to detect modified bills.

seykron commented 10 years ago

What do you think if we create a JSON delta file on each update? For instance:

delta-2014-06-15.json

I think it is better than uploading 500MB of files to github, the repo will be very heavy.