the-radiativity-company / inmates

a tool for collating inmate rosters

2 stars 1 forks source link

inmates#59: "St Clair Spider (Part 2)" #60

Closed withtwoemms closed 4 years ago

withtwoemms commented 4 years ago

Summary:

updates StClairSpider.parse to submit FormRequests for a-z

Testing:

run LIVESITE_PARSED_OUTPUT_DIR=outdir/ make scraper-run and check "outdir/stclair.json"
where PR #58 produced 330 records, this one should produce 424

Notes:

closes #59
did manual "deduping" and giving 422 records. more investigation is needed as the 2 possible duplicates might actually be duplicated on the roster site. this work will be handled in a subsequent PR
cc @easherma / @brrusselburg