Automated scraper running stable now

dsfsi / covid19za

Coronavirus COVID-19 (2019-nCoV) Data Repository and Dashboard for South Africa

https://dsfsi.github.io/covid19za-dash/

MIT License

255 stars 200 forks source link

Automated scraper running stable now #903

Closed krokkie closed 3 years ago

krokkie commented 3 years ago

Find in this request two R-scripts, that runs the automated web scraping from both nicd and sacoronavirus.co.za - using github actions.
It does make use of OCR technology, which does fail from time to time, and might need manual updating.
I'm not 100% if we want to apply the revisions in the nicd daily releases - they have not been applied in the past, but I guess this might be an improvement.

vukosim commented 3 years ago

@krokkie See workflow failure.

krokkie commented 3 years ago

@vukosim - I think it's a different workflow failure - the scrapers were running fine last night? Or have I missed something?

vukosim commented 3 years ago

Ahh I see think its old.

Thanks.