Closed spulec closed 10 years ago
I updated the scraper to make the report_id
field more reliably unique across the IG. There were report_ids like "database" from URLs that were like "/1234123/database.pdf". It's possible I may not have caught this issue in other scrapers (and the validator doesn't take a holistic view of the IG's corpus).
Now that that's done, looks good to me! Thanks as usual, @spulec.
Good call, thanks!
Adds the OIG for the Consumer Product Safety Commission.
One broken URL, but everything else looks good.