search

simonw / covid-19-datasette

Deploys a Datasette instance of COVID-19 data from Johns Hopkins CSSE and the New York Times
https://covid-19.datasettes.com/
61 stars 6 forks source link

Johns Hopkins daily CSV headers changed, breaking my database build script #4

Closed simonw closed 4 years ago

simonw commented 4 years ago

Everything is broken right now! It looks like they changed some column headers.

Originally posted by @simonw in https://github.com/simonw/covid-19-datasette/issues/3#issuecomment-603360233

simonw commented 4 years ago

https://github.com/simonw/covid-19-datasette/actions broke 16 hours ago:

Actions_·_simonw_covid-19-datasette
simonw commented 4 years ago

https://github.com/simonw/covid-19-datasette/runs/529183505?check_suite_focus=true

Fixed_minor_HTML_bug_·_simonw_covid-19-datasette_783e1af
simonw commented 4 years ago

My code: https://github.com/simonw/covid-19-datasette/blob/783e1afe4f9cc9e54d40ddd68fe693d0aba0f688/build_database.py#L20-L35

https://github.com/CSSEGISandData/COVID-19/commit/e748b6d8a55e4a88371af56b129ababe1712522d is where they changed the headers - but only for the most recent CSV file - lots of comments complaining about it on that commit.

simonw commented 4 years ago

Lots of bug reports about this, including https://github.com/CSSEGISandData/COVID-19/issues/1436 and https://github.com/CSSEGISandData/COVID-19/issues/1405 and https://github.com/CSSEGISandData/COVID-19/issues/1385

simonw commented 4 years ago

Old headers:

New headers:

simonw commented 4 years ago

Fixed: https://covid-19.datasettes.com/covid/daily_reports