Turn off SSL verification as workaround to server misconfiguration, #30.

CivicTechAtlanta / georgia-courtbot

Helping people remember to attend court to help break the cycle of fines and jail time

4 stars 5 forks source link

Turn off SSL verification as workaround to server misconfiguration, #30. #31

Closed abrie closed 2 years ago

abrie commented 2 years ago

This PR is a workaround for the SSL configuration of the https://ody.dekalbcountyga.gov website. The scraper fails to run because the site returns an incomplete certificate chain. Python's Requests package does not download intermediate certificates and is therefore unable to verify the certificate. With this patch the request is not verified, warnings are printed, and the scrape task continues.

bbrewington commented 2 years ago

the only risk we identified with this is a man-in-the-middle attack, and determined that wouldn't be an issue with our implementation