Monitoring Changes to Government Web Pages

[dcwalk]

About the group (Web Monitoring)

The Environmental Data & Governance Initiative (EDGI) has been monitoring changes to the content on tens of thousands of US government web pages. A team of analysts manually inspecting most changes has already identified significant changes to the government’s web presence, however, our work process is extremely labour-intensive. As a result we are building an open-source platform with an easy to use interface compare millions of federal web pages and review ‘diffed’ web page snapshots. Our core experience with with Environmental and Energy Federal Agencies, but the platform is not restricted to only those web pages.

Who we're looking for

People with an interest in ensuring access to scientific research on climate, continuing evidence-based policy, and preserving government information!

All backgrounds are welcome, current skills in demand include:

• Design & UI
• Data Science
• Machine Learning
• Technical Writing

Tools

We have a few different components providing services to each other:

• Python (Data Processing)
• React (Front-end)

Relevant Links

• https://github.com/edgi-govdata-archiving/overview
• https://github.com/edgi-govdata-archiving/web-monitoring

[dcwalk]

The first step if you are interested is to join our slack! You can also ping me, @patcon, or @titantiumbones here :)