search

datameet / covid19

Novel Corona Virus - COVID-19 India Datasets by DataMeet. Sunsetted on 2022-10-21. Will not update anymore.
https://projects.datameet.org/covid19/
Other
121 stars 113 forks source link

No Testing Data for 12-08-20 #19

Closed DnanaDev closed 4 years ago

DnanaDev commented 4 years ago

@thejeshgn I'm running a cron job for a project that fetches the testing data from icmr_testing_status.json at 05:00 every morning.

The job failed yesterday due to missing data for the day. Just wanted to know whether this was a one-off error or do I need to add some data validation to the script.

Appreciate the resource you guys have put together.

Update : Error was in the script.

thejeshgn commented 4 years ago

What kind validation do you do. We can incorporate some.

DnanaDev commented 4 years ago

Since I parse the JSON to CSV, I perform validation using https://github.com/alimanfoo/csvvalidator and this approach - https://www.kaggle.com/rtatman/dashboarding-with-notebooks-day-5

DnanaDev commented 4 years ago

The testing data for 12-08-20 is missing. Has there been a change in the update time/schedule or frequency ?

thejeshgn commented 4 years ago

Unless there is an issue. It should happen before 10AM