search

judgelord / rulemaking

A project to pull and merge various data on US federal agency rulemaking.
3 stars 4 forks source link

get FERC rules and comments #7

Open judgelord opened 5 years ago

judgelord commented 5 years ago

How to scrape FERC's database: https://github.com/judgelord/correspondence/blob/master/functions/DOE_FERC-scraper.Rmd

Checking "Rulemaking" and selecting "Comments/Protest" under Class should return comments but all comments may not be categorized ("Rulemaking Comment" under Class/Type does not return much).

judgelord commented 5 years ago

There is a file called FERCcomments1.htm in the main repo. This should go in a new folder FERC/html/ This is a sample of the first 200 public comment.

The example code looks for a file called 1.html, so we will need to change that.