search

tomwhite / covid-19-uk-data

Coronavirus (COVID-19) UK Historical Data
http://tom-e-white.com/covid-19-uk-data/
The Unlicense
162 stars 79 forks source link

Feature/Makefile Automation #7

Closed desholmes closed 4 years ago

desholmes commented 4 years ago

Overview

Introduce make commands to automate the process of gathering the daily UK data. Updated README.md.

Changes

  1. Introduced Makefile to automate the England daily tasks
  2. Updated tools/extract_totals.py to append data to ./data/covid-19-totals-uk.csv if the downloaded temp HTML file contains today's date
  3. Updated .gitignore to exclude vscode and temp HTML files
  4. Updated README.md with usage instructions for the make commands

Steps to test

  1. Check out this branch
  2. Make commands: Follow the instructions in the Make commands section of README.md
  3. extract_totals.py: Updated usage instructions in Manually running scripts to include a second arg for ./data/covid-19-totals-uk.csv
desholmes commented 4 years ago

@tomwhite Added a Makefile to semi-automate the England tasks.

tomwhite commented 4 years ago

@desholmes this is amazing! I will give it a run through tomorrow. Many thanks.

tomwhite commented 4 years ago

+1. I've run some light testing on this and it looks great. Especially glad you found a stable URL for the CSV on ArcGIS.

It would be nice if we could use Make in such a way that it doesn't repeatedly download a file (e.g. make england-totals-download will always re-download even if the file is there locally), but that can be improved later.