search

open-austin / indigent-defense-stats

A web scraper for collecting and processing public case records from sites using Tyler Technology's Odyssey court records database software.
MIT License
16 stars 6 forks source link

Code clean-up: create functions and error handling #93

Open nicolassaw opened 2 months ago

nicolassaw commented 2 months ago

Problem The code currently does not have very many functions that can provide more modularity and clarity to the code. It also has some error handling but not a bunch. It tends to fail and shut down, but if dealing with large jobs (multiple modules for multiple counties), the code should be written to keep going. These seemed like intertwined tasks so I put them in the same ticket.

Goal Update the different submodules of the program to use functions. Implement error handling so that the code will continue the larger orchestration regardless of where it hits the error.

Modules Completed

nicolassaw commented 3 weeks ago

Scraper has been re-written to have more modular functions in this pull request.

Next is parser.