18F / crime-data-explorer

Moved to https://github.com/fbi-cde
73 stars 20 forks source link

Potentially bad data in Police Employee Data - Oregon, 2011 #306

Open nrjones8 opened 6 years ago

nrjones8 commented 6 years ago

The "Police Employee Data" from the Downloads and Docs page gives officer counts and officer / 1000 people rates for each state over a number of years. These numbers generally increase over time (as police forces have grown since the 1970s), but I came across one year of data that looks wrong. In Oregon, the dataset contains:

Those data for Oregon in 2011 seem to be wrong - it would seem odd that Oregon added ~16,000 officers one year and then let go a similar number the following year.

jpwentz commented 6 years ago

CIUS Details:

State | Total lawenforcementemployees | Totalofficers | Totalcivilians | Number of agencies | 2011estimated population

OREGON 10,057 5,502 610 1,721 2,224 213 3,837,283
jpwentz commented 6 years ago

Total should be 6112 for 2011 based upon CIUS

jpwentz commented 6 years ago

Total based upon CIUS for 2012 should be 6057 total--- so it appears we need more information to how to determine this information.

jpwentz commented 6 years ago

https://ucr.fbi.gov/crime-in-the-u.s/2012/crime-in-the-u.s.-2012/tables/77tabledatadecpdf/table_77_full_time_law_enforcement_employess_by_state_2012.xls

harrisj commented 6 years ago

I will look into this one shortly

jpwentz commented 6 years ago

We have tracked down the issue -- the data from UCR was incorrect for the following rows that were ingested with the ddocname - 2011_OR0240800, 2011_OR0240500 , 2011_OR0240300

Those rows are incorrect data hence making the total offs. IE OR0240500 has 9000 female officers.

jpwentz commented 6 years ago

I updated the rows in the database with this issue -- I will start to determine what other updates I need to run then work with @harrisj to generate the new file.