search

daenuprobst / covid19-cases-switzerland

Data from BAG Tweets made useful.
284 stars 74 forks source link

Web crawlers to extract data automatically #47

Open AlexBobAlex opened 4 years ago

AlexBobAlex commented 4 years ago

Hello again !

I wonder how you enrich your dataset currently, do you do it by hand ? Would it help to set up small web crawlers that try to automatically fetch data in the listed websites and format it as desired ?

I could work on that if it's of any interest to you.

zdavatz commented 4 years ago

We are scraping with python right here, works great: latest numbers:

https://www.functor.xyz/covid_19/scrapers/outputs/latest.txt

code is here: https://github.com/zdavatz/covid_19/tree/master/scrapers

AlexBobAlex commented 4 years ago

All right, thanks @zdavatz ! Nice job I will see if I can help on your project

zdavatz commented 4 years ago

All right, thanks @zdavatz ! Nice job I will see if I can help on your project

The main project is here: https://github.com/openZH/covid_19/ above is just a fork.