search

catalyst-cooperative / pudl-scrapers

Scrapers used to acquire snapshots of raw data inputs for versioned archiving and replicable analysis.
MIT License
3 stars 3 forks source link

Create github action for running the scraping/archiving process at desired frequencies #53

Closed zschira closed 1 year ago

zschira commented 2 years ago

Once the archiver/scraper repos have been combined, and we have high level scripts for managing the process, it should be very easy to create github actions for automating the archiving process. New data is released at various frequencies for the different data sources incorporated in PUDL, so we can create multiple actions that run at frequencies reflective of this.

zaneselvans commented 2 years ago

I am so excited for this to finally happen!