search

catalyst-cooperative / pudl-scrapers

Scrapers used to acquire snapshots of raw data inputs for versioned archiving and replicable analysis.
MIT License
3 stars 3 forks source link

edit eia860 scrapper to grab the early release data #35

Closed cmgosnell closed 1 year ago

cmgosnell commented 1 year ago

this mostly involved edited how we extract the year from title. there are three types of titles: “2021 Early Release” “2015" “EIA-860 Data 2005”

so we needed to grab four digits all next to each other no matter if it was in the beginning or the end or the string.

codecov[bot] commented 1 year ago

Codecov Report

Merging #35 (ac7f8d8) into main (7d3d0c7) will increase coverage by 0.1%. The diff coverage is 77.7%.

@@           Coverage Diff           @@
##            main     #35     +/-   ##
=======================================
+ Coverage   64.7%   64.9%   +0.1%     
=======================================
  Files         15      15             
  Lines        542     550      +8     
=======================================
+ Hits         351     357      +6     
- Misses       191     193      +2
Impacted Files Coverage Δ
src/pudl_scrapers/spiders/eia860.py 71.1% <77.7%> (+0.6%) :arrow_up:

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.