trynthink / scout

A tool for estimating the future energy use, carbon emissions, and capital and operating cost impacts of energy efficiency and demand flexibility technologies in the U.S. residential and commercial building sectors.
https://scout.energy.gov
Other
60 stars 22 forks source link

Suspected error in residential boiler baseline (BTO Market Tool) #180

Closed thisIsMikeKane closed 7 years ago

thisIsMikeKane commented 7 years ago

I suspect there might be an error in the calculation of the the total market size for All Residential Boiler Heating by Fuel Use using the BTO Market Tool. Specifically, the tool calculates 762.6 TBtu of energy use in 2016 from all residential boilers running on electricity? How is the calculation substantiated? I cannot find any information in the AEO regarding residential electric boilers. Additionally, my market intuition tells me that the market for all residential gas and oil boilers should larger than electric boilers, not less as the tool calculates (476.3 TBtu and 232.1 TBtu respectively).

Thank you for working hard developing Scout and continuing to make this a valuable tool to the community.

jtlangevin commented 7 years ago

@thisIsMikeKane: Thanks very much for pointing this potential issue out. Upon further investigation of the EIA data from which these numbers were generated, it looks like on a source energy basis, EIA projected more residential electric boiler energy in 2016 than residential gas and oil boiler energy, (based on a site-source energy conversion of about 3X for electricity). The EIA data also show more residential electric boiler units on the market than gas and oil boiler units (28 million vs. 11 and 4 million, respectively).

We get these data as raw .txt output files from EIA National Energy Modeling System (NEMS) reference case runs. The specific data you're referencing come from the 'RESDBOUT.txt' file. You'll be able to find some detail about the modeling methods in the EIA Residential NEMS documentation, but let me know if you'd like to find out more and I can put you in touch with the right individual at EIA.

thisIsMikeKane commented 7 years ago

@jtlangevin Thanks for the detailed description, and also the thoroughness of your documentation and rigorous development of Scout, I'm quite impressed.

I looked into the EIA Residential NEMS documentation, and didn't find any information about electric boilers. Table 1 only lists Fuel Oil and Natural Gas as fuels for boiler based space heating. A Google search of eia.gov returns mainly information regarding commercial electric boilers, and a brief statement that no standard exists for residential boilers. These observations, and the lack even a mention of residential electric boilers in the RECS dataset are what led me to question the BTO Market Tool in the first place. Unfortunately, I don't have access to the NEMs data yet, so I can't investigate this further. I hope my observations so far are at least useful.

Thanks again for helping investigate this issue, even if it ends up being an issue with the EIA data for this corner case and not Scout.

jtlangevin commented 7 years ago

@thisisMikeKane: Good observations, thanks. I'll reach out to EIA to see if I can get a better answer on what's going on.

thisIsMikeKane commented 7 years ago

Thanks!

thisIsMikeKane commented 7 years ago

I got the data from EIA, and I think I figured it out. Scout classifies the EIA variable ELEC_RAD as 'boiler (electric)' on line 127 of mseg.py. I don't have the variable definition file from EIA, but if I had to guess, I'd say that ELEC_RAD represents pure electric radiators, i.e. Joule heating at the point of radiation, not electricity boiling water that is pumped through hydronic radiators. Do you have access to the EIA variable definition file to confirm?

jtlangevin commented 7 years ago

That's entirely possible, I will confirm with EIA ASAP. Sorry, it's been a busy week!

jtlangevin commented 7 years ago

@thisIsMikeKane: I believe you already figured this out, but EIA confirmed your suspicion that ELEC_RAD means radiator heating, not electric boiler heating. I will modify the dictionary in the AEO data import module and the market calculator accordingly and close this issue once those changes are committed. We are also in the process of updating to AEO 2017 baseline data, and I'll be sure that those data are generated with this fix implemented.

Many thanks for letting us know about the issue and for your diligence in tracking down the source of the error.

thisIsMikeKane commented 7 years ago

@jtlangevin Yup, sounds like we have a good solution. Thanks for looking into this for me. Best of luck.

trynthink commented 7 years ago

The Market Calculator website is now updated to correctly describe the "ELEC_RAD" coded AEO data as electric resistance heating. Modifications to make this change permanent for future data updates are committed now and will eventually be reflected on the master branch.