search

NickSadjoli / Week4_GlobalForecast_COVID19

A collaboration repository containing the code for The Kaggle Competition of Week 2 Global forecasting of COVID-19 (https://www.kaggle.com/c/covid19-global-forecasting-week-2)
2 stars 0 forks source link

Web Scrapper Implementation #1

Open NickSadjoli opened 4 years ago

NickSadjoli commented 4 years ago

Implement a web scrapper similar to this. Other types of tools that can be used for data scrapping is also welcome

josephinemonica commented 4 years ago

Can include data from here https://www.worldometers.info/population/countries-in-asia-by-population/ for some data that might be relevant for features like, number of population per country, median age

josephinemonica commented 4 years ago

Temperature data: https://datahelpdesk.worldbank.org/knowledgebase/articles/902061-climate-data-api sample of request of monthly temperature: http://climatedataapi.worldbank.org/climateweb/rest/v1/country/mavg/tas/2020/2039/ALB.csv have to look into what the scenario means..

NickSadjoli commented 4 years ago

Noted and will update scraper tools to be able to get data from all these sources. Thanks a lot for these sources @josephinemonica !

NickSadjoli commented 4 years ago

Hi @josephinemonica. I've gotten the scraper tools to be able to completely pull from the Worldometer coronavirus pages (i.e. also including the countries with dedicated coronavirus pages), as well as the Worldometer Population and the WorldBank climate data.

I've merged these first versions of the tool with the master branch, so feel free to pull them to your branch and try them out with the models. I'll also start to help you work on the actual models as well from now on I believe.

If there are any additional data sources you believe might be necessary, put them in this issue page here, and I'll see what I can do.