CivicTechAtlanta / georgia-courtbot

Helping people remember to attend court to help break the cycle of fines and jail time
4 stars 5 forks source link

Build Dekalb County scraper #1

Closed bbrewington closed 2 years ago

bbrewington commented 2 years ago

data/dekalb_scraper.py

Dekalb County Judicial Information System (a.k.a. Odyssey) --> Search Hearings

Fields needed:

  - Case Number
  - Hearing Date
  - Hearing Time
  - Courtroom
  - (last updated date? <-- when the scraper ran)
SearchHearings_Fields
bbrewington commented 2 years ago

Here's some notes on manually grabbing all case info by judicial officer:

  1. Go to above link & select a judicial officer. Pick date range. Click Submit
  2. In dropdown at bottom (after next page loads) change to 200 items per page
  3. In developer tools (i.e. right click --> Inspect --> Network), find the "Read" item...it should be an xhr type
  4. Right click --> Copy --> Copy Response, then save copied text to JSON

Grabbed some on Sunday afternoon and pulled full month of February for all judicial officers...put in Google Drive here: https://drive.google.com/drive/folders/17XyfrFMergUqcR1fySFzOdixp7BpspQa?usp=sharing

Screen Shot 2022-01-13 at 11 09 26 PM