search

unitedstates / inspectors-general

Collecting reports from Inspectors General across the US federal government.
https://sunlightfoundation.com/blog/2014/11/07/opengov-voices-opening-up-government-reports-through-teamwork-and-open-data/
Creative Commons Zero v1.0 Universal
106 stars 21 forks source link

Scraper maintenance #218

Closed divergentdave closed 9 years ago

divergentdave commented 9 years ago

Various changes to fix broken scrapers

divergentdave commented 9 years ago

Argh, this page on the HUD OIG archives no longer has links. http://archives.hud.gov/offices/oig/reports/de.cfm https://web.archive.org/web/20130218181056/http://archives.hud.gov/offices/oig/reports/de.cfm

divergentdave commented 9 years ago

Ah, it looks like these links were always broken. We have them in BAD_LINKS. I'll fix the scraper to parse the rest of the page.

konklone commented 9 years ago

Sounds good, I'll await a fix for HUD -- but thank you for these fixes! They seemed to grow pretty quickly.

divergentdave commented 9 years ago

Ready to go!

konklone commented 9 years ago

Very, very nice job. These take more hand-holding than I expected. Thank you!