BlankerL / DXY-COVID-19-Data

2019新型冠状病毒疫情时间序列数据仓库 | COVID-19/2019-nCoV Infection Time Series Data Warehouse
https://lab.isaaclin.cn/nCoV/
MIT License
2.15k stars 708 forks source link

数据仓库恢复更新 | Recovery of Data Warehouse #97

Closed BlankerL closed 3 years ago

BlankerL commented 3 years ago

首先,非常感谢大家对本项目的支持。

自2020年7月29日起,数据仓库的部分文件由于容量超过GitHub支持的单个文件最大100MB的限制,导致更新无法向项目内推送,由于本人个人原因,没有足够的时间来处理本项目的数据更新问题,导致数据仓库停止更新2个月左右。

对此,我感到十分抱歉,但疫情数据的数据爬虫仍然在持续录入新数据集,因此数据集内的数据并没有缺失。

目前,我已经重新恢复数据仓库的更新,受限于git仓库的单文件容量限制,我重新写了部分函数,未来更新将会放在Releases当中(单个文件最大可支持2GB),Release可以通过项目右侧的面板或上方的链接进入。

目前的更新规则是:每天0点,项目会准时获取数据库内的数据,并且将数据上传至以年.月.日命名的tag下,每天更新均已全量数据保存,方便大家回溯任意日期的数据。

如需通过程序自动化访问/下载数据,可以通过GitHub Repository API,或按下述方式进行:

希望本次的更新能够帮助更多有需要的人。


First of all, thank you very much for your support of this project.

Since July 29, 2020, some of the files in the data warehouse have been unable to push to the project due to their size exceeding the 100MB limit for a single file supported by GitHub. Furthermore, due to my own personal reasons, I have not had enough time to deal with the data update issue for this project, resulting in the data warehouse stopping updates for about 2 months.

I am very sorry about this. However, the data crawler is working all the time, so there is no missing data within the dataset.

I have now resumed updating the data repository, and due to the single file size limit of the git repository, I have rewritten some of the functions, and future updates will be placed in Releases, in which the maximum size of a single file can be 2GB. Releases can be accessed via the panel on the right side of the project or the link above.

The current update rule is that on every day at 0:00, the project fetches the data in the database, and uploads the data to the warehouse in yyyy.mm.dd tag format. Therefore, you will be able to get the data of any target dates as you wish.

To access/download the data through your program, you can have a try of GitHub Repository API, or use the following method:

I hope this update can help more people who need it.