search

sergei-mironov / COVID-19_plus_Russia

COVID-19 data from JHU CSSE, updated with details on Russian regions.
22 stars 6 forks source link

readme

COVID-19 Data Repository by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University

Goals

  1. Provide COVID19 dataset containing detailed information on Russia.
  2. Maintain CSSE compatibility
  3. Provide some higher level APIs for accessing the data.
  4. Close the project after a more systematic approch is developed

Disclamer: the author doesn't have relationships with any government or commercial organisations. The data provided here are collected from unreliable sources and may be not accurate. Use it at your own risk.

Отказ от ответственности: автор не имеет отношения к государственным или коммерческим организациям. Данные, приведенные здесь, собраны из ненадежных источников и могут быть неточными. Используйте их на свой страх и риск.

Contents

Directory structure

Visualization

Daily cases in Russian regions, Top-10

English version of the plot

Daily cases in Russian regions, positions 11-21

English version of the plot

Confirmed cases in Russian regions, Top-10

English version of the plot

Confirmed cases in Russian regions, positions 11-21

English version of the plot

Data sources

Primary sources

Related repos

Update procedure

Originally, author filled the data on Moscow and Saint Petersburg manually, based on Rospotrebnadzor and NovelCoronaVirusChannel data. Starting from March, 25 we follow the below procedure:

  1. Fetch hourly data from Yandex COVID map
    • Fetching is done by running monitor function of the fetcher script
    • The data is saved into pending folder, stamped with UTC time.
  2. Fetch daily upstream updates by using regular git fetch manually.
  3. If update is available,
    1. Rebase repository to upstream/master branch using git rebase
    2. For every csse_covid_19_data/csse_covid_19_daily_reports file which doesn't have russian details, do the following:
      1. Determine the update time of 'Russia' record found in the world data. The time is supposed to be UTC. The update time is often near 23:30 (supposedly UTC time).
      2. Find the russian details dump in pending folder which has the closest UTC timestamp.
      3. Update world information file by inserting russian details manually.
      4. Review the format compatibility (CSV fields order, date format, etc.).
      5. Run the checker script.
      6. Update RU timeline by calling ru_timeline_dump() of access.py.
      7. Update plots by running plot script.
      8. Commit the changes to this repository, forcebly push (due to rebase) here.

Roadmap

Log

11.06.2020

02.06.2020

03.05.2020

30.04.2020

28.04.2020

25.04.2020

24.04.2020

21.04.2020

17.04.2020

14.04.2020

13.04.2020

12.04.2020

08.04.2020

01.04.2020

30.03.2020

25.03.2020

23.03.2020

Upstream format change: now

21.03.2020

We augmented CSV files from csse_covid_19_daily_reports folder by adding lines like:

Original README.md starts here

2019 Novel Coronavirus COVID-19 (2019-nCoV) Data Repository by Johns Hopkins CSSE

This is the data repository for the 2019 Novel Coronavirus Visual Dashboard operated by the Johns Hopkins University Center for Systems Science and Engineering (JHU CSSE). Also, Supported by ESRI Living Atlas Team and the Johns Hopkins University Applied Physics Lab (JHU APL).

Visual Dashboard (desktop): https://www.arcgis.com/apps/opsdashboard/index.html#/bda7594740fd40299423467b48e9ecf6

Visual Dashboard (mobile): http://www.arcgis.com/apps/opsdashboard/index.html#/85320e2ea5424dfaaa75ae62e5c06e61

Please cite our Lancet Article for any use of this data in a publication: An interactive web-based dashboard to track COVID-19 in real time

Provided by Johns Hopkins University Center for Systems Science and Engineering (JHU CSSE): https://systems.jhu.edu/

DONATE to the CSSE dashboard team: https://engineering.jhu.edu/covid-19/support-the-csse-covid-19-dashboard-team/

DATA SOURCES: This list includes a complete list of all sources ever used in the data set, since January 21, 2010. Some sources listed here (e.g., WHO, ECDC, US CDC, BNO News) are not currently relied upon as a source of data.

Embed our dashboard into your webpage:

<style>.embed-container {position: relative; padding-bottom: 80%; height: 0; max-width: 100%;} .embed-container iframe, .embed-container object, .embed-container iframe{position: absolute; top: 0; left: 0; width: 100%; height: 100%;} small{position: absolute; z-index: 40; bottom: 0; margin-bottom: -15px;}</style><div class="embed-container"><iframe width="500" height="400" frameborder="0" scrolling="no" marginheight="0" marginwidth="0" title="COVID-19" src="https://www.arcgis.com/apps/opsdashboard/index.html#/bda7594740fd40299423467b48e9ecf6"></iframe></div>

Acknowledgements: We are grateful to the following organizations for supporting our Center’s COVID-19 mapping and modeling efforts: Financial Support: Johns Hopkins University, National Science Foundation (NSF), Bloomberg Philanthropies, Stavros Niarchos Foundation; Resource support: AWS, Slack, Github; Technical support: Johns Hopkins Applied Physics Lab (APL), Esri Living Atlas team

Additional Information about the Visual Dashboard: https://systems.jhu.edu/research/public-health/ncov/

Contact Us:

Terms of Use:

  1. This data set is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) by the Johns Hopkins University on behalf of its Center for Systems Science in Engineering. Copyright Johns Hopkins University 2020.

  2. Attribute the data as the "COVID-19 Data Repository by the Center for Systems Science and Engineering (CSSE) at Johns Hopkins University" or "JHU CSSE COVID-19 Data" for short, and the url: https://github.com/CSSEGISandData/COVID-19.

  3. For publications that use the data, please cite the following publication: "Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Inf Dis. 20(5):533-534. doi: 10.1016/S1473-3099(20)30120-1"