Add unit tests and data validation

CivicTechAtlanta / georgia-courtbot

Helping people remember to attend court to help break the cycle of fines and jail time

4 stars 5 forks source link

Open abrie opened 2 years ago

abrie commented 2 years ago

This PR adds unit tests and a more robust data validation step.

Major changes:

Add a caching step to save raw HTML/JSON prior to scraping desired fields.
Refactor the scrape logic into seperate fetch+scrape steps suitable for unit testing.

Leaving as Draft until ready to merge