search

unitedstates / inspectors-general

Collecting reports from Inspectors General across the US federal government.
https://sunlightfoundation.com/blog/2014/11/07/opengov-voices-opening-up-government-reports-through-teamwork-and-open-data/
Creative Commons Zero v1.0 Universal
107 stars 21 forks source link

IG scraping for beginners #117

Closed DanielSchuman closed 10 years ago

DanielSchuman commented 10 years ago

Hi everyone,

One of my interns is learning python and I thought it might be useful for her to try her hand at scraping an IG page or two. (I am even more of a beginner than she, and will try my hand at it as well). If you have a few websites that you'd recommend as low hanging fruit, please add them here. Thanks!

spulec commented 10 years ago

Awesome!

Two agencies that look like they might be relatively straightforward are the Corporation for Public Broadcasting and the Corporation for National and Community Service. It's always a bit hard to tell the difficulty level until you dive in though.

From the readme: The best way to "claim" an IG is to create an open pull request with an empty scraper as soon as you've begun work -- you don't need to wait until the scraper is finished to submit a pull request.

Let me know if you need any help getting setup.

DanielSchuman commented 10 years ago

Thank you.

konklone commented 10 years ago

I'm going to close this, as we're nearing the end. Refer to #140 if someone still wants to claim one.