unitedstates / inspectors-general

Collecting reports from Inspectors General across the US federal government.
https://sunlightfoundation.com/blog/2014/11/07/opengov-voices-opening-up-government-reports-through-teamwork-and-open-data/
Creative Commons Zero v1.0 Universal
107 stars 21 forks source link

[doj] Website changes #228

Closed divergentdave closed 9 years ago

divergentdave commented 9 years ago

The Department of Justice OIG website has been moved to its own subdomain, and migrated to HTTPS. The scraper will need some TLC, since the base URL has changed.

Unfortunately, the server only supports TLS_RSA_WITH_RC4_128_SHA, which is already deprecated. Newer versions of urllib3 (since 1.10.2) don't support RC4 by default. Options for a workaround are downgrading, this, and shazow/urllib3#617.

konklone commented 9 years ago

I've written the DOJ OIG to request they re-evaluate their ciphersuite choices. Thanks for raising this.

divergentdave commented 9 years ago

One month on, still only one ciphersuite. :frowning: See also #229 for fixes.