search

covidatlas / li

Next-generation serverless crawler for COVID-19 data
Apache License 2.0
57 stars 33 forks source link

List of known data sources #421

Closed jzohrab closed 4 years ago

jzohrab commented 4 years ago

Original issue https://github.com/covidatlas/coronadatascraper/issues/810, transferred here on Tuesday Apr 14, 2020 at 18:43 GMT

Below are the list of sources (outside of the US) that we are currently aware of. If you know a source that is not on this list, please file an issue, and we will update this document!

Status definition:

✅ Source is actively scraped by this project 🏗️ Someone is working on a scraper for this source 🐛 Source is buggy, needs fixing

Aggregate sources

ArcGIS maintains a list of all dashboards by country: https://www.arcgis.com/apps/opsdashboard/index.html#/a9419e61cb6f4521a15baf78be309b35

Contains data for a number of Latin American countries: https://github.com/DataScienceResearchPeru/covid-19_latinoamerica

Africa

Status ISO Code Name URL Notes
TN Tunisia Ministry of Health https://services6.arcgis.com/BiTAc9ApDDtL9okN/arcgis/rest/services/Statistiques_par_gouvernorat_(nouvelle_donn%C3%A9e)/FeatureServer/0/query
✅ ZA COVID 19 Data for South Africa https://github.com/dsfsi/covid19za

Asia/Pacific

Status ISO Code Name URL Notes
AF Afghanistan COVID-19 Stats by Province https://docs.google.com/spreadsheets/d/1F-AMEDtqK78EA6LYME2oOsWQsgJi4CT3V_G4Uo-47Rg/edit#gid=2026243039 Need to verify source
✅ AU-ACT ACT Government Health https://www.health.act.gov.au/about-our-health-system/novel-coronavirus-covid-19
✅ AU WA Health https://ww2.health.wa.gov.au/Articles/A_E/Coronavirus/COVID19-statistics
✅ AU-NSW NSW Government Health https://www.health.nsw.gov.au/_layouts/feed.aspx?xsl=1&web=/news&page=4ac47e14-04a9-4016-b501-65a23280e841&wp=baabf81e-a904-44f1-8d59-5f6d56519965&pageurl=/news/Pages/rss-nsw-health.aspx
✅ AU-NT Northern Territory Government https://coronavirus.nt.gov.au/
✅ AU-QLD QLD Government Health https://www.health.qld.gov.au/news-events/doh-media-releases
✅ AU-SA SA Health https://www.sahealth.sa.gov.au/wps/wcm/connect/public+content/sa+health+internet/health+topics/health+topics+a+-+z/covid+2019/latest+updates/confirmed+and+suspected+cases+of+covid-19+in+south+australia
✅ AU-VIC Victoria State Government Health and Human Services https://www.dhhs.vic.gov.au/media-hub-coronavirus-disease-covid-19
✅ AU Australian Government Department of Health https://www.health.gov.au/news/health-alerts/novel-coronavirus-2019-ncov-health-alert/coronavirus-covid-19-current-situation-and-case-numbers
✅ ID Ministry of Health Republic of Indonesia https://www.kemkes.go.id
✅ IN https://www.mohfw.gov.in/
✅ KR Ministry of Health and Welfare http://ncov.mohw.go.kr/en/bdBoardList.do?brdId=16&brdGubun=162&dataGubun=&ncvContSeq=&contSeq=&board_id=
✅ NZ New Zealand Government Ministry of Health https://www.health.govt.nz/our-work/diseases-and-conditions/covid-19-novel-coronavirus/covid-19-current-situation/covid-19-current-cases
✅ RU Rospotrebnadzor https://yandex.ru/maps/api/covid?csrfToken=
✅ SA https://datasource.kapsarc.org/explore/dataset/saudi-arabia-coronavirus-disease-covid-19-situation/download/?format=csv&disjunctive.daily_cumulative=true&disjunctive.region=true&refine.daily_cumulative=Daily&timezone=America/Los_Angeles&lang=en&csv_separator=%2C
✅ TH Department of Disease Control Thailand https://ddc.moph.go.th/viralpneumonia/eng/index.php

Europe

Status ISO Code Name URL Notes
✅ AT Austrian Ministry of Health https://info.gesundheitsministerium.at
✅ AT COVID-19/SARS-COV-2 Cases in EU https://github.com/covid19-eu-zh/covid19-eu-data
✅ BE Sciensano https://epistat.wiv-isp.be/covid/
✅ CH covid19-cases-switzerland https://github.com/daenuprobst/covid19-cases-switzerland/
🐛 CY Official website for Cyprus Open Data https://www.data.gov.cy/sites/default/files/CY%20Covid19%20Daily%20Statistics_6.csv
✅ CZ Ministry of Health of the Czech Republic https://onemocneni-aktualne.mzcr.cz/
✅ DE Dr. Jan-Philip Gehrcke https://raw.githubusercontent.com/jgehrcke/covid-19-germany-gae/master/data.csv
✅ EE Estonia Health and Welfare Information Systems Center https://opendata.digilugu.ee/opendata_covid19_test_results.csv
✅ ES Antonio Delgado https://github.com/datadista/datasets/tree/master/COVID%2019
FI THL https://media-koronatilanne.hub.arcgis.com/datasets/bae4e3d772534e58998a9e4ff5c0bf7e_0/data?geometry=-37.220%2C58.184%2C87.936%2C71.082&orderBy=sairaanhoitopiiri&showData=true Reports health district data
✅ FR Santé publique France https://www.data.gouv.fr/fr/organizations/sante-publique-france/datasets-resources.csv
✅ GB GOV.UK https://coronavirus.data.gov.uk/
🐛 GB-SCT https://www.gov.scot/coronavirus-covid-19/
HR Koronavirus.hr https://www.koronavirus.hr/ Reports each region in individual pages
🏗️ #660 HU Koronamonitor https://docs.google.com/spreadsheets/d/1e4VEZL1xvsALoOIq9V2SQuICeQrT5MtWfBm32ad7i8Q/edit#gid=311133316
✅ IE Ireland Open Data Portal http://opendata-geohive.hub.arcgis.com/datasets/d9be85b30d7748b5b7c09450b8aede63_0.csv?outSR={"latestWkid":3857,"wkid":102100}
✅ IT pcm-dpc/COVID-19 https://raw.githubusercontent.com/pcm-dpc/COVID-19/master/dati-regioni/dpc-covid19-ita-regioni.csv
IS Ministry of Health of Iceland https://www.covid.is/data All the actual data is here: https://e.infogram.com/e3205e42-19b3-4e3a-a452-84192884450d?src=embed
✅ LT Ministry of Health of the Republic of Lithuania https://services.arcgis.com/XdDVrnFqA9CT3JgB/arcgis/rest/services/covid_locations/FeatureServer/0/query
✅ LV Latvia Management of the Center for Disease Prevention and Control https://services7.arcgis.com/g8j6ESLxQjUogx9p/arcgis/rest/services/Latvia_covid_novadi/FeatureServer/0/query
✅ NL CoronaWatchNL https://github.com/J535D165/CoronaWatchNL
NO vg.no https://www.vg.no/spesial/2020/corona/ Has a hidden API which could be scraped, news organization
✅ PL covid19-eu-zh https://github.com/covid19-eu-zh/covid19-eu-data
✅ PL Ministry of Health of the Republic of Poland https://www.gov.pl/web/koronawirus/wykaz-zarazen-koronawirusem-sars-cov-2
PR dssg-pt/covid19pt-data https://github.com/dssg-pt/covid19pt-data Could be low quality
RO geo-spatial.org https://covid19.geo-spatial.org/despre Provides an API
RS Serbia Open Data https://covid19.data.gov.rs/?locale=en
✅ SE Public Health Agency of Sweden https://services5.arcgis.com/fsYDFeRKu1hELJJs/arcgis/rest/services/FOHM_Covid_19_FME_1/FeatureServer/1/query
✅ SI COVID-19 Sledilnik https://raw.githubusercontent.com/slo-covid-19/data/master/csv/stats.csv
✅ UA National Security and Defense Council of Ukraine https://api-covid19.rnbo.gov.ua/data?to= // append YYYY-MM-DD

North/South America

Status ISO Code Name URL Notes
✅ BR Secretaria de Vigilância em Saúde do Ministério da Saúde https://covid.saude.gov.br/
✅ CA Public Health Agency of Canada https://health-infobase.canada.ca/src/data/covidLive/covid19.csv
CA https://resources-covid19canada.hub.arcgis.com/app/82e586188b7049e1896b771cd4875815 Provides data at the health district level
🏗️ #788 CA-NS Government of Nova Scotia https://novascotia.ca/coronavirus/data/COVID-19-data.csv
GT Ministry of Health of Guatemala https://www.mspas.gob.gt/index.php/noticias/coronavirus-2019-ncov
✅ PR Gobierno de Puerto Rico Departamento de Salud http://www.salud.gov.pr/Pages/coronavirus.aspx
SV Ministry of Health of El Salvador https://covid19.gob.sv/
✅ VI United States Virgin Islands Department of Health https://doh.vi.gov/covid19usvi
jzohrab commented 4 years ago

(Transferred comment)

See also #671. I'm going to see if I can implement something along those lines.