vukosim
commented
2 years ago @krokkie can we close this now?
Open vukosim opened 2 years ago
vukosim
commented
2 years ago @krokkie can we close this now?
krokkie
commented
2 years ago This underlying data was broken, the scrapers worked fine. As pointed out by others, an improvement would be to add the published "new cases" numbers. I wanted to add this when I had a gap.
On Thu, Dec 2, 2021 at 3:17 PM Vukosi @.***> wrote:
@krokkie https://github.com/krokkie can we close this now?
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/dsfsi/covid19za/issues/921#issuecomment-984618953, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADM6OFQTQA6IXZJZRSG2NXTUO5WVNANCNFSM5IYK6TKQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.
-- Groete Gerhard Bijker
@krokkie We are having a scraper issue again. Got this from Hugh Murrell
NICD web-scraper is broken.
A few days ago, The NICD changed the presentation format on its COVID dashboard and as a result faulty data is getting scraped for your South African provincial Covid count dataset on github.
Quite a few web apps make use of your dataset. Please can you ask someone to take a look at the problem
The break occurs between 22-11-2021 and 23-11-2021 in this dataset
https://raw.githubusercontent.com/dsfsi/covid19za/master/data/covid19za_provincial_cumulative_timeline_confirmed.csv
and that is when the NICD format changed.