search

openZH / covid_19

COVID19 case numbers of Cantons of Switzerland and Principality of Liechtenstein (FL). The data is updated at best once a day (times of collection and update may vary). Start with the README.
https://www.zh.ch/de/gesundheit/coronavirus/zahlen-fakten-covid-19.zhweb-noredirect.zhweb-cache.html?keywords=covid19&keyword=covid19#/
Creative Commons Attribution 4.0 International
424 stars 176 forks source link

introduce correction_status.csv to skip manual data corrections #1832

Closed maekke closed 3 years ago

maekke commented 3 years ago

@metaodi @jb3-2 what do you think about this change?

metaodi commented 3 years ago

@maekke I'd rather have a clean time series than having another file to ignore some entries. But I don't have strong feelings about this issue, so if you are okay with it, Iet's do it.

maekke commented 3 years ago

@metaodi in principle I am agreeing that the time series should be fixed... But NW (and I guess this applies to BS too) states explicit "-2 Fälle aufgrund Systembereinigung". I just dislike the current situation, that the CSV Validation prints an error every hour...

metaodi commented 3 years ago

I totally understand that. In the past I used to remove the obvious wrong values (that were too high and therefore trigger the error) and ignore the values of these days in the scraper (search for "TODO" in the code base and you will find many of those cases). That way at least all the "hacks" are in the same place instead of a new CSV.

jb3-2 commented 3 years ago

I agree with both of you :-)

Yes, BS also had some "Systembereinigungen", thus the time series is clean as it is.

@maekke Thanks for your solution, let's do it!