search

invinst / chicago-police-data

a collection of public data re: CPD officers involved in police encounters
https://invisible.institute/police-data
157 stars 60 forks source link

Complete 6/3/16 Complaint and Document Indices #14

Closed banoonoo2 closed 8 years ago

banoonoo2 commented 8 years ago

Here are the complete, ready-to-analyze Complaint and (PDF) Document indices for the June 3 portal.ipra.org doc drop. These were CSVs, but I can only upload them as XLSX. Please add them to the folder of ready-to-analyze files.

2016-06-03-complaint-index.xlsx 2016-06-03-document-index.xlsx

alexsoble commented 8 years ago

Wow @banoonoo2! Question: Where did the indices come from? Did you make these spreadsheets by hand?

jayqi commented 8 years ago

I noticed that the IPRA portal shows 102 entries now. I think one record was added sometime today. One of the other people at Chi Hack Night noticed there were two new SoundCloud audio tracks added 4 hours ago.

rajivsinclair commented 8 years ago

@alexsoble will you merge this PR once it’s ready?

alexsoble commented 8 years ago

@rajivsinclair I don't think @banoonoo2 is asking me to merge, just add those two files she posted into the repo. The commits on this PR don't really have anything to do with those files.

@banoonoo2 I would love to chat sometime via Slack or Google Hangout if you have a minute this week or next! I want to thank you for all the work you're doing, talk about workflow, and answer any questions you have.

alexsoble commented 8 years ago

@jayqi HMMMMMM. Maybe some auto-scraping of the IPRA portal to look for changes would be a good idea?!?!

banoonoo2 commented 8 years ago

@alexsoble Yes, hand-crafted artisanal spreadsheets by me! Yes, I'm available anytime today, anytime tomorrow, and Friday afternoon to chat.

@jayqi Yes, comparing the complaint index above to the IPRA portal, I see they added complaint 1080018, which happened 4/7/16 and was reported to IPRA 4/8/16, and that complaint has 2 SoundCloud audio files and 9 PDF documents. Here are updated indices: 2016-06-03-complaint-index.xlsx 2016-06-03-document-index.xlsx

I'm working on getting (1) all the audio and the handful of downloadable video files uploaded to Archive.org, (2) finishing indices for those, and (3) zipping everything up and offering it as a bulk download via WeTransfer, Dropbox, or maybe Google Drive.

Auto-scraping would be great! In the "scraping" issue thread, @freddymartinez9 said he's working on an IPRA scraper: https://github.com/freddymartinez9

alexsoble commented 8 years ago

@banoonoo2: great, let's schedule on Slack! Just sent you a DM.

@freddymartinez9: Excellent!

On Wed, Jun 8, 2016 at 5:41 PM banoonoo2 notifications@github.com wrote:

@alexsoble https://github.com/alexsoble Yes, hand-crafted artisanal spreadsheets by me! Yes, I'm available anytime today, anytime tomorrow, and Friday afternoon to chat.

@jayqi https://github.com/jayqi Yes, comparing the complaint index above to the IPRA portal, I see they added complaint 1080018, which happened 4/7/16 and was reported to IPRA 4/8/16, and that complaint has 2 SoundCloud audio files and 9 PDF documents. Here are updated indices: 2016-06-03-complaint-index.xlsx https://github.com/invinst/shootings-data/files/305809/2016-06-03-complaint-index.xlsx 2016-06-03-document-index.xlsx https://github.com/invinst/shootings-data/files/305810/2016-06-03-document-index.xlsx

I'm working on getting (1) all the audio and the handful of downloadable video files uploaded to Archive.org, (2) finishing indices for those, and (3) zipping everything up and offering it as a bulk download via WeTransfer, Dropbox, or maybe Google Drive.

Auto-scraping would be great! In the "scraping" issue thread, @freddymartinez9 https://github.com/freddymartinez9 said he's working on an IPRA scraper: https://github.com/freddymartinez9

— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/invinst/shootings-data/pull/14#issuecomment-224752866, or mute the thread https://github.com/notifications/unsubscribe/ADD5HWK6ULo8RiEan00bVVAj8mu3PByBks5qJ0UqgaJpZM4Iwb1Y .