search

adhambadr / corona-api

https://corona.blloc.com
10 stars 2 forks source link

Invalid confirmed, recovered, and deaths returned for last entry of historic USA data #5

Open HandOverFist opened 4 years ago

HandOverFist commented 4 years ago

This is a great REST API. I really appreciate the work done here. Thank you.

I just received following values for the REST request: https://corona.blloc.com/historic?country=USA

The last entry is incorrect. It should have been roughly confirmed: 43800, recovered: 0, deaths: 533. Here are the last few lines returned. I have attached the entire response for research. I noticed the same issue a couple of nights ago, but it seemed to resolve itself as I was testing it.

{"date":"2020-03-19T00:00:00.000Z","confirmed":13610,"recovered":0,"deaths":200},{"date":"2020-03-20T00:00:00.000Z","confirmed":19020,"recovered":0,"deaths":244},{"date":"2020-03-21T00:00:00.000Z","confirmed":25401,"recovered":0,"deaths":306},{"date":"2020-03-22T00:00:00.000Z","confirmed":33170,"recovered":0,"deaths":415},{"date":"2020-03-23T00:00:00.000Z","confirmed":33177,"recovered":178,"deaths":415}]}

historic_USA_2020-03-24.txt

HandOverFist commented 4 years ago

This issue originates with the original data source. For some reason it has incorrect data for 2020-03-23 and is missing 2020-03-24 entirely, which was skewing the result on my web site.

I finally implemented a new interface that did a one time conversion of the historic stats which allowed me to fix 2020-03-23 and 2020-03-24 by hand. After that I get the current stats every 15 minutes and add any new stats to my historic stats, but only if the "confirmed" or "death" numbers have increased. This also has an advantage in that I do not need the historic stats again, which were getting larger every day.

So I am good for now. Thanks again for your development work.

adhambadr commented 4 years ago

hey yeah i see data discrepancies all over, France was also a topic for a while which i also had to do by hand. The data sources all over the world are inconsistent, the scrapers of morgenpost get it wrong sometime but then are corrected later. Would be great if you push your corrections as a PR so everyone can get them

adhambadr commented 4 years ago

in general would be great if people could integrate other data sources and cross reference them.