unitedstates / inspectors-general

Collecting reports from Inspectors General across the US federal government.
https://sunlightfoundation.com/blog/2014/11/07/opengov-voices-opening-up-government-reports-through-teamwork-and-open-data/
Creative Commons Zero v1.0 Universal
106 stars 21 forks source link

[eeoc] Update for new site #300

Closed shanecav84 closed 7 years ago

shanecav84 commented 7 years ago

Closes #247.

TODO:

divergentdave commented 7 years ago

Awesome, thanks for doing this! I'll take a look at it. I'm going to add a commit to rename eeoc-new to eeoc, as we don't need to keep the old scraper around.

Regarding the old reports no longer online, we have copies of the PDFs and associated metadata around still. I'll find which reports are now missing, clean them up, and add them over at the unitedstates/reports repository.

Reports with multiple files are a longstanding hairy issue. (see #112) In cases such as that example, we usually pick the most important/substantive file, dropping transmittal letters or memoranda. The EPA OIG scraper is a good example of that approach.

Thanks again for tackling this!

shanecav84 commented 7 years ago

Thanks, @divergentdave, for rounding out the PR!

divergentdave commented 7 years ago

Looks good, merging and deploying!

Edit: Up at https://oversight.garden/reports?inspector=eeoc