rji-futures-lab / mo-covid-vaccine-data

A pipeline for collecting and archiving data describing Covid-19 vaccinations in Missouri.
MIT License
0 stars 0 forks source link

Serve public list of archived files #6

Open gordonje opened 3 years ago

gordonje commented 3 years ago

To make it easier for reporters and editors to find, reference and download the data files we are archiving, let's create a simple web page that lists each of the .csv files we've archived, along with a download link.

It might also be helpful to list each version of each csv file so that folks can rewind to previous versions of the data.

A couple of routes we discussed:

Either approach would prob work as part of a continuous deployment process so that we can update the page whenever we push code to the main branch.

gordonje commented 3 years ago

To get all of the files in the S3 bucket, call .list_objects_v2() with the bucket name.

To get all of the versions of each file, call .list_object_versions() with the bucket name and key.