search

catalyst-cooperative / pudl-archiver

A tool for capuring snapshots of public data sources and archiving them on Zenodo for programmatic use.
MIT License
4 stars 2 forks source link

Scrape/archive supplemental FERC forms #6

Open zschira opened 1 year ago

zschira commented 1 year ago

@zschira commented on Wed Sep 28 2022

There are several smaller FERC forms that supplement their primary forms (1,2,6,60,714). These supplemental forms include 1F, 3Q Electric, 2A, 3Q Gas, and 6Q. We should be archiving these supplemental forms even if we are not actively using them at this point in time.

e-belfer commented 1 year ago

1F and 3Q (Electric) seem to be downloaded through the same URL used to archive Form 1 data.

2A and 3Q (Gas) seem to be downloaded through the same url used to archive Form 2 data, covered in ferc2.py.

6Q seems to be downloaded through the same url used to archive Form 6 data, covered in ferc6.py.

@zschira From what I can tell, these forms should already be covered by existing archivers and we can close this issue? But perhaps it'd be helpful to update the names of the existing raw archives to reflect that they also include supplemental forms.