Scraping: Small update to xpath in get_pdf_links in download.py.
Parsing: Now parses all information in the Bail Information section!
As a result of changing get_bail_info in funcs_parse.py, added three new columns to parsed data dictionary returned by parse_pdf in parse_docket.py:
bail_info_list: list of dictionaries containing data on each row in the bail section (there may be more than one item if bail was modified after the preliminary arraignment),
bail_percentage if Monetary bail type,
bail_paid_date if bail was posted.
Updated how bail_paid is computed: now computed based on the newestbail_amount and bail_percentage values (Previously, computed as 10% of the oldestbail_amount)
The bail_info_list data can be read from a string using ast.literal_eval.
Scraping: Small update to xpath in
get_pdf_linksindownload.py.Parsing: Now parses all information in the Bail Information section!
get_bail_infoinfuncs_parse.py, added three new columns to parsed data dictionary returned byparse_pdfinparse_docket.py:bail_info_list: list of dictionaries containing data on each row in the bail section (there may be more than one item if bail was modified after the preliminary arraignment),bail_percentageif Monetary bail type,bail_paid_dateif bail was posted.bail_paidis computed: now computed based on the newestbail_amountandbail_percentagevalues (Previously, computed as 10% of the oldestbail_amount)The
bail_info_listdata can be read from a string usingast.literal_eval.