catalyst-cooperative / pudl-archiver

A tool for capuring snapshots of public data sources and archiving them on Zenodo for programmatic use.
MIT License
4 stars 1 forks source link

Add ER prefix to 923 archiver #381

Closed e-belfer closed 2 months ago

e-belfer commented 2 months ago

Overview

Closes first step of https://github.com/catalyst-cooperative/pudl/issues/3677.

What problem does this address? EIA 923 data has an early release in July. The archiver currently doesn't capture files which include the early release prefix "er", unlike the EIA 860 and 861 archivers. This has caused a failure in this morning's archive run: https://github.com/catalyst-cooperative/pudl-archiver/actions/runs/9870803976

What did you change in this PR? Added the er prefix as an optional group in the 923 archiver regex.

Testing

How did you make sure this worked? How can a reviewer verify this? See the draft EIA 923 archive in Zenodo.

To-do list

- [x] Review the PR yourself and call out any questions or issues you have