CSSEGISandData / COVID-19

Novel Coronavirus (COVID-19) Cases, provided by JHU CSSE
https://systems.jhu.edu/research/public-health/ncov/
29.13k stars 18.43k forks source link

All data inconsistency between 21/01 - 20/03 in timeseries (Country basis) #1336

Open ulklc opened 4 years ago

ulklc commented 4 years ago

Finally i decided to write script for detect inconsistency between timeseries data. Here is list:

Andorra recovered data 2020/03/12 = 1 /// 2020/03/13 = 0 Austria recovered data 2020/03/16 = 6 /// 2020/03/17 = 1 Azerbaijan confirmed data 2020/03/15 = 23 /// 2020/03/16 = 15 Belgium recovered data 2020/03/19 = 31 /// 2020/03/20 = 1 Bahrain confirmed data 2020/03/12 = 195 /// 2020/03/13 = 189 Saint Barthélemy confirmed data 2020/03/08 = 3 /// 2020/03/09 = 1 Egypt recovered data 2020/03/14 = 27 /// 2020/03/15 = 21 Iceland death data 2020/03/15 = 5 /// 2020/03/16 = 0 Iceland recovered data 2020/03/15 = 8 /// 2020/03/16 = 0 Iceland death data 2020/03/19 = 1 /// 2020/03/20 = 0 Italy recovered data 2020/02/23 = 2 /// 2020/02/24 = 1 Japan confirmed data 2020/01/22 = 2 /// 2020/01/23 = 1 Japan confirmed data 2020/02/06 = 45 /// 2020/02/07 = 25 Japan confirmed data 2020/03/15 = 839 /// 2020/03/16 = 825 South Korea recovered data 2020/03/07 = 135 /// 2020/03/08 = 118 Lebanon confirmed data 2020/03/15 = 110 /// 2020/03/16 = 99 Montenegro confirmed data 2020/03/17 = 2 /// 2020/03/18 = 1 Philippines death data 2020/03/18 = 19 /// 2020/03/19 = 17 Poland recovered data 2020/03/18 = 13 /// 2020/03/19 = 1 United States recovered data 2020/03/17 = 17 /// 2020/03/18 = 0 Diamond Princess recovered data 2020/02/22 = 1 /// 2020/02/23 = 0 Diamond Princess confirmed data 2020/03/05 = 706 /// 2020/03/06 = 696

Also i'll try to collect with myself, your data structure not reliable. Everyday we're facing duplicates, structural changes etc.

ulklc commented 4 years ago

Additionaly, these are duplicated after automation push

Cape Verde Timor-Leste Guadeloupe Reunion French Guiana Mayotte Greenland Guam Puerto Rico Republic of the Congo The Bahamas The Gambia

bevanward commented 4 years ago

I have 175 cases where the counts have gone backwards - Japan on 2020-01-23 for Confirmed with difference to prev day of -1 at 1 Japan on 2020-02-07 for Confirmed with difference to prev day of -20 at 25 Japan on 2020-03-16 for Confirmed with difference to prev day of -14 at 825 Australia> Queensland on 2020-01-31 for Confirmed with difference to prev day of -1 at 2 Australia> Queensland on 2020-02-02 for Confirmed with difference to prev day of -1 at 2 Australia> From Diamond Princess on 2020-02-29 for Confirmed with difference to prev day of -8 at 0 Lebanon on 2020-03-16 for Confirmed with difference to prev day of -11 at 99 Bahrain on 2020-03-13 for Confirmed with difference to prev day of -6 at 189 Azerbaijan on 2020-03-16 for Confirmed with difference to prev day of -8 at 15 Australia> Northern Territory on 2020-03-06 for Confirmed with difference to prev day of -1 at 0 US> Washington on 2020-03-18 for Confirmed with difference to prev day of -62 at 1014 US> Grand Princess on 2020-03-16 for Confirmed with difference to prev day of -1 at 20 US> Nevada on 2020-03-18 for Confirmed with difference to prev day of -1 at 55 US> Utah on 2020-03-20 for Confirmed with difference to prev day of -2 at 78 Cruise Ship> Diamond Princess on 2020-03-06 for Confirmed with difference to prev day of -10 at 696 China> Guizhou on 2020-03-18 for Confirmed with difference to prev day of -1 at 146 France> Saint Barthelemy on 2020-03-09 for Confirmed with difference to prev day of -2 at 1 US> Bennington County, VT on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Carver County, MN on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Charlotte County, FL on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Cherokee County, GA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Collin County, TX on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Jefferson County, KY on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Jefferson Parish, LA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Shasta County, CA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Spartanburg County, SC on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Harrison County, KY on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Johnson County, IA on 2020-03-10 for Confirmed with difference to prev day of -3 at 0 US> Berkshire County, MA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Davidson County, TN on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Douglas County, OR on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Fresno County, CA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Harford County, MD on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Hendricks County, IN on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Hudson County, NJ on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Johnson County, KS on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Kittitas County, WA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Manatee County, FL on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Marion County, OR on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Okaloosa County, FL on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Polk County, GA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Riverside County, CA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Shelby County, TN on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> St. Louis County, MO on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Suffolk County, NY on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Ulster County, NY on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Volusia County, FL on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Fairfax County, VA on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Rockingham County, NH on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Washington, D.C. on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Montgomery County, PA on 2020-03-10 for Confirmed with difference to prev day of -5 at 0 US> Alameda County, CA on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Broward County, FL on 2020-03-10 for Confirmed with difference to prev day of -3 at 0 US> Lee County, FL on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Pinal County, AZ on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Rockland County, NY on 2020-03-10 for Confirmed with difference to prev day of -4 at 0 US> Saratoga County, NY on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Charleston County, SC on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Clark County, WA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Cobb County, GA on 2020-03-10 for Confirmed with difference to prev day of -3 at 0 US> Davis County, UT on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> El Paso County, CO on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Honolulu County, HI on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Jackson County, OR on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Jefferson County, WA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Kershaw County, SC on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Klamath County, OR on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Madera County, CA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Pierce County, WA on 2020-03-10 for Confirmed with difference to prev day of -4 at 0 US> Tulsa County, OK on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Douglas County, CO on 2020-03-10 for Confirmed with difference to prev day of -3 at 0 US> Providence County, RI on 2020-03-10 for Confirmed with difference to prev day of -3 at 0 US> Chatham County, NC on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Delaware County, PA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Douglas County, NE on 2020-03-10 for Confirmed with difference to prev day of -3 at 0 US> Fayette County, KY on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Marion County, IN on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Middlesex County, MA on 2020-03-10 for Confirmed with difference to prev day of -7 at 0 US> Nassau County, NY on 2020-03-10 for Confirmed with difference to prev day of -17 at 0 US> Ramsey County, MN on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Washoe County, NV on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Wayne County, PA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Yolo County, CA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Santa Clara County, CA on 2020-03-10 for Confirmed with difference to prev day of -38 at 0 US> Clark County, NV on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Fort Bend County, TX on 2020-03-10 for Confirmed with difference to prev day of -6 at 0 US> Grant County, WA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Santa Rosa County, FL on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Williamson County, TN on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> New York County, NY on 2020-03-10 for Confirmed with difference to prev day of -19 at 0 US> Montgomery County, MD on 2020-03-10 for Confirmed with difference to prev day of -4 at 0 US> Suffolk County, MA on 2020-03-10 for Confirmed with difference to prev day of -8 at 0 US> Denver County, CO on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Summit County, CO on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Bergen County, NJ on 2020-03-10 for Confirmed with difference to prev day of -4 at 0 US> Harris County, TX on 2020-03-10 for Confirmed with difference to prev day of -6 at 0 US> San Francisco County, CA on 2020-03-10 for Confirmed with difference to prev day of -9 at 0 US> Contra Costa County, CA on 2020-03-10 for Confirmed with difference to prev day of -9 at 0 US> Orange County, CA on 2020-03-10 for Confirmed with difference to prev day of -4 at 0 US> Norfolk County, MA on 2020-03-10 for Confirmed with difference to prev day of -6 at 0 US> Maricopa County, AZ on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Wake County, NC on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Westchester County, NY on 2020-03-10 for Confirmed with difference to prev day of -98 at 0 US> Grafton County, NH on 2020-03-10 for Confirmed with difference to prev day of -3 at 0 US> Hillsborough, FL on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Placer County, CA on 2020-03-10 for Confirmed with difference to prev day of -7 at 0 US> San Mateo, CA on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Sonoma County, CA on 2020-03-10 for Confirmed with difference to prev day of -3 at 0 US> Umatilla, OR on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Fulton County, GA on 2020-03-10 for Confirmed with difference to prev day of -5 at 0 US> Washington County, OR on 2020-03-10 for Confirmed with difference to prev day of -8 at 0 US> Snohomish County, WA on 2020-03-10 for Confirmed with difference to prev day of -31 at 0 US> Humboldt County, CA on 2020-03-10 for Confirmed with difference to prev day of -1 at 0 US> Sacramento County, CA on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> San Diego County, CA on 2020-03-10 for Confirmed with difference to prev day of -3 at 0 US> San Benito, CA on 2020-03-10 for Confirmed with difference to prev day of -2 at 0 US> Los Angeles, CA on 2020-03-10 for Confirmed with difference to prev day of -14 at 0 US> King County, WA on 2020-03-10 for Confirmed with difference to prev day of -83 at 0 US> Cook County, IL on 2020-03-10 for Confirmed with difference to prev day of -7 at 0 France> French Guiana on 2020-03-23 for Confirmed with difference to prev day of -18 at 0 France> Mayotte on 2020-03-23 for Confirmed with difference to prev day of -11 at 0 France> Guadeloupe on 2020-03-23 for Confirmed with difference to prev day of -56 at 0 France> Reunion on 2020-03-23 for Confirmed with difference to prev day of -47 at 0 Montenegro on 2020-03-18 for Confirmed with difference to prev day of -1 at 1 Cape Verde on 2020-03-23 for Confirmed with difference to prev day of -1 at 0 East Timor on 2020-03-23 for Confirmed with difference to prev day of -1 at 0 Philippines on 2020-03-19 for Deaths with difference to prev day of -2 at 17 India on 2020-03-21 for Deaths with difference to prev day of -1 at 4 Iceland on 2020-03-16 for Deaths with difference to prev day of -5 at 0 Iceland on 2020-03-20 for Deaths with difference to prev day of -1 at 0 US> Oregon on 2020-03-22 for Deaths with difference to prev day of -1 at 4 Russia on 2020-03-22 for Deaths with difference to prev day of -1 at 0 US> Lee County, FL on 2020-03-10 for Deaths with difference to prev day of -1 at 0 US> Grant County, WA on 2020-03-10 for Deaths with difference to prev day of -1 at 0 US> Santa Rosa County, FL on 2020-03-10 for Deaths with difference to prev day of -1 at 0 US> Placer County, CA on 2020-03-10 for Deaths with difference to prev day of -1 at 0 US> Snohomish County, WA on 2020-03-10 for Deaths with difference to prev day of -1 at 0 US> King County, WA on 2020-03-10 for Deaths with difference to prev day of -17 at 0 Kazakhstan on 2020-03-21 for Deaths with difference to prev day of -3 at 0 Sri Lanka on 2020-03-21 for Recovered with difference to prev day of -2 at 1 Italy on 2020-02-24 for Recovered with difference to prev day of -1 at 1 Belgium on 2020-03-20 for Recovered with difference to prev day of -30 at 1 Egypt on 2020-03-15 for Recovered with difference to prev day of -6 at 21 Austria on 2020-03-17 for Recovered with difference to prev day of -5 at 1 Pakistan on 2020-03-22 for Recovered with difference to prev day of -8 at 5 Iceland on 2020-03-16 for Recovered with difference to prev day of -8 at 0 Azerbaijan on 2020-03-22 for Recovered with difference to prev day of -1 at 10 Andorra on 2020-03-13 for Recovered with difference to prev day of -1 at 0 Poland on 2020-03-19 for Recovered with difference to prev day of -12 at 1 US> Washington on 2020-03-18 for Recovered with difference to prev day of -1 at 0 US> California on 2020-03-18 for Recovered with difference to prev day of -6 at 0 US> Massachusetts on 2020-03-18 for Recovered with difference to prev day of -1 at 0 US> New Jersey on 2020-03-18 for Recovered with difference to prev day of -1 at 0 US> Illinois on 2020-03-18 for Recovered with difference to prev day of -2 at 0 US> Maryland on 2020-03-18 for Recovered with difference to prev day of -3 at 0 US> Arizona on 2020-03-18 for Recovered with difference to prev day of -1 at 0 US> Kentucky on 2020-03-18 for Recovered with difference to prev day of -1 at 0 US> Wisconsin on 2020-03-18 for Recovered with difference to prev day of -1 at 0 Korea, South on 2020-03-08 for Recovered with difference to prev day of -17 at 118 Cruise Ship> Diamond Princess on 2020-02-23 for Recovered with difference to prev day of -1 at 0 China> Heilongjiang on 2020-02-11 for Recovered with difference to prev day of -2 at 28 China> Heilongjiang on 2020-03-23 for Recovered with difference to prev day of -1 at 465 China> Guangxi on 2020-02-12 for Recovered with difference to prev day of -1 at 32 China> Hainan on 2020-02-15 for Recovered with difference to prev day of -4 at 39 China> Guizhou on 2020-02-06 for Recovered with difference to prev day of -3 at 6 China> Shanxi on 2020-02-03 for Recovered with difference to prev day of -1 at 2 China> Hong Kong on 2020-02-21 for Recovered with difference to prev day of -1 at 5 China> Ningxia on 2020-02-09 for Recovered with difference to prev day of -2 at 13 US> Santa Clara County, CA on 2020-03-10 for Recovered with difference to prev day of -1 at 0 US> Suffolk County, MA on 2020-03-10 for Recovered with difference to prev day of -1 at 0 US> Maricopa County, AZ on 2020-03-10 for Recovered with difference to prev day of -1 at 0 US> San Diego County, CA on 2020-03-10 for Recovered with difference to prev day of -1 at 0 US> King County, WA on 2020-03-10 for Recovered with difference to prev day of -1 at 0 US> Cook County, IL on 2020-03-10 for Recovered with difference to prev day of -2 at 0 France> French Guiana on 2020-03-23 for Recovered with difference to prev day of -6 at 0

ulklc commented 4 years ago

Actually i checked country basis data, but i believe there is to many inconsistency in state basis :/