openoakland / OakCrime-Decommissioned

Code supporting citizen analysis of crime in Oakland, CA
22 stars 16 forks source link

Harvest (v2): regular harvest of patrol logs; revised crime classification; capture data update log #94

Closed rbelew closed 4 years ago

rbelew commented 4 years ago

1 Integrate daily harvesting of patrol log PDFs: Grab and cache any PDFs added to OPD's Box account since lastCheck date into media/PLHarvest. Parse the PDFs and store results into DailyParse objects. "Regularize" data fields from these forms and attempt to merge against existing OakCrime objects harvested via Socrata.

2 Implement new process of crime classification; cf http://rikiwiki.electronicartifacts.com/opd-crime-statistics/oakcc for details

3 Capture details of data updates (via Socrata and patrol logs) in OCUpdate.