search

Data4Democracy / usa-dashboard

A dashboard of key metrics for the USA
69 stars 27 forks source link

Scrape crime data #1

Open seanjtaylor opened 7 years ago

seanjtaylor commented 7 years ago

We need the data to have the following fields:

We can work down the list of MSAs by population: https://en.wikipedia.org/wiki/List_of_Metropolitan_Statistical_Areas

New York: http://www.nyc.gov/html/nypd/html/analysis_and_planning/historical_nyc_crime_data.shtml

Los Angeles: No clear source.

Chicago: https://data.cityofchicago.org/Public-Safety/Crimes-2001-to-present/ijzp-q8t2/data

seanjtaylor commented 7 years ago

Louisville, KY - https://data.louisvilleky.gov/dataset/crime-data

bstarling commented 7 years ago

Sources look like files/one-time downloads with a data cleaning exercise vs web scraping. Is that accurate?

nix-bohon commented 7 years ago

Here is the data available from Little Rock, AR: https://data.littlerock.org/Public-Safety/COMPSTAT-Year-To-Date-as-2016/53ac-n7q5/data https://data.littlerock.org/Public-Safety/COMPSTAT-2015/ysqk-d7nm

jasdumas commented 7 years ago

Hartford, CT (MSA 47 in the list): https://data.hartford.gov/Public-Safety/Police-Incidents-01012005-to-Current/889t-nwfu In a previous dashboarding project I pulled this crime data and formatted its fields that match the above requirements! The code is available here: https://github.com/jasdumas/hartford-police

Totally up for helping out anyone else who needs it!

alexmansourati commented 7 years ago

Chicago has an API for their crime data! https://data.cityofchicago.org/Public-Safety/Crimes-2001-to-present/ijzp-q8t2/data