tomwhite / covid-19-uk-data

Coronavirus (COVID-19) UK Historical Data
http://tom-e-white.com/covid-19-uk-data/
The Unlicense
162 stars 79 forks source link

Crawl data from new PHE dashboard #38

Closed tomwhite closed 4 years ago

tomwhite commented 4 years ago

The new PHE dashboard at https://coronavirus.data.gov.uk/ has data for

Plus historical data for all of these.

There are CSV links, but the page is dynamically generated HTML. So it might be easier to pull data from the underlying JSON feed, see https://github.com/PublicHealthEngland/coronavirus-dashboard/blob/master/src/hooks/useLoadData.js.

Also discussed here: https://twitter.com/DavidBeavan/status/1250454570070933504

slowe commented 4 years ago

@tomwhite I've commented on their Github repo and sent an email to the feedback email. I will also point this out to some lovely NHS Digital folks who shall hopefully be in the #OpenDataSavesLives Zoom call at 11am. I think having fixed URLs is an important thing. I will push to get whoever is currently publishing the new JSON to mirror the latest version at a fixed URL. URLs are fundamental building blocks of the web. Nobody can currently link to the "latest" version of the data.

tomwhite commented 4 years ago

@slowe totally agree. Thanks for raising this with the appropriate people!