search

openaustralia / australian_local_councillors_images

Stores a copy of Australian local councillor images from Popolo on S3. Runs on morph.io
https://morph.io/openaustralia/australian_local_councillors_images
0 stars 0 forks source link

Move storage to the archive.org #1

Open equivalentideas opened 8 years ago

equivalentideas commented 8 years ago

These images are an important digital record of who our elected representatives are. The internet archive feels like the right place to store these because of their commitments to open access and very long term storage.

henare commented 8 years ago

It's easy to switch this to the Internet Archive as fog supports it, yay!

The question is how do we want to organise the items? Currently we've got all the files in the same item. It looks like Archive.org recommends that every file has its own item. That would mean we could store different sizes for each photo in the same item.

henare commented 8 years ago

Trying to come up with a predictable URL, i.e. item name, for these is proving hard. Since they form part of the URL, Archive.org doesn't allow / in the name so we can't just use the Popolo ID as we're currently doing for S3.

We could just replace / with - but then how would that work with UUIDs if we move to that like EveryPolitician?

henare commented 8 years ago

Another consideration is that Archive.org requires metadata (not if uploaded via the API?). It also seems like the right thing to do but as @equivalentideas said we can always add this later.

equivalentideas commented 8 years ago

We could just replace / with - but then how would that work with UUIDs if we move to that like EveryPolitician?

@henare That seems like the dumb thing to do. Couldn't we still predictably generated them using the persons name and their authority?

henare commented 8 years ago

Couldn't we still predictably generated them using the persons name and their authority?

The UUIDs that EP use contain - so how do you know a real - from one that's supposed to be a /? :frowning: