codeforIATI / iati-ideas

💡 Ideas for new codeforIATI projects and blogs
https://ideas.codeforiati.org
0 stars 0 forks source link

A single downloadable zip of all IATI data, updated daily. #1

Closed andylolz closed 5 years ago

andylolz commented 5 years ago

Rationale

For analysis, it’s sometimes useful to be able to access IATI data as a single dataset. If you’re downloading from source, this can take a long time, because you have to figure out the CKAN API and then make lots and lots of HTTP requests. Downloading a single ZIP file is much easier.

Proposal

Run a nightly download of all IATI data, zip it up and make it available at a predictable URL (so it can be downloaded programmatically).

andylolz commented 5 years ago

This one exists! It’s here: https://andylolz.github.io/iati-data-dump/