covidatlas / li

Next-generation serverless crawler for COVID-19 data
Apache License 2.0
57 stars 33 forks source link

Fix Mercury News parser for large counties #371

Closed 1ec5 closed 4 years ago

1ec5 commented 4 years ago

The Mercury News spreadsheet is hand-entered; sometimes it comes with digit grouping characters, which ended up truncating the numbers in the scraper. This change removes the grouping characters, restoring the full numbers. Unfortunately, this spreadsheet only tracks current numbers, and change tracking doesn’t seem to be enabled. A number of incorrect days will need to be removed or replaced by hand by looking at county dashboards. This will result in inconsistencies, because the Mercury News was tracking only the latest reported figures, not adjusting the numbers as the counties have been retroactively updating old numbers.

Fixes #370.

/ref https://github.com/covidatlas/li/issues/363#issuecomment-668190268

jzohrab commented 4 years ago

Thanks @1ec5 !