Automate saving comments and supporting documents to database

Data4Democracy / immigration-connect

Building tools to connect and coordinate efforts to help those affected by immigration law changes in partnership with the NILC

41 stars 29 forks source link

Automate saving comments and supporting documents to database #55

Open dotj opened 6 years ago

dotj commented 6 years ago

Context:

NILC Proposal
regulation.gov page

This issue is a continuation of #48, #52, #53, #54

Proposed Timeline:

The comment period closes on December 10.
This proposal is being presented on October 23.
Goal: to have the database capturing data by the first week in November.

Goal Set up the scripts and database so that new comments and supporting documents will automatically be saved.

dotj commented 5 years ago

Currently still working on getting a VM set up to automatically scrape the documents. Created new issue to ask for help in manually collecting data (#57 )