Devs want to be able to deliver versioned, original source data for Eia860 forms

catalyst-cooperative / pudl-scrapers

Scrapers used to acquire snapshots of raw data inputs for versioned archiving and replicable analysis.

MIT License

3 stars 3 forks source link

Closed ptvirgo closed 4 years ago

ptvirgo commented 4 years ago

UAC -

The Eia860 scraper will:

Recognize whether or not a newly downloaded copy of the Eia860 forms is different from the most recently archived Zenodo version.
Tag and upload new versions if the Eia860 source data to Zenodo
Not tag or upload repeated copies of identical Eia860 source data

ptvirgo commented 4 years ago

Use the zen_store tool for this.