search

SEED-platform / seed

Standard Energy Efficiency Data (SEED) Platform™ is a web-based application that helps organizations easily manage data on the energy performance of large groups of buildings.
Other
110 stars 55 forks source link

Error importing Green Button meter data #1912

Closed RDmitchell closed 5 years ago

RDmitchell commented 5 years ago

Expected Behavior

Import green button data

Actual Behavior

Error occurred at import. Also triggered a Sentry error

Steps to Reproduce

See files and doc in this folder https://drive.google.com/drive/folders/1Ar7hVHkmIPdjUPQl0dERgAbB6WYRZ2oe?usp=sharing Server Instance: dev1 Server SHA: 93c4bdca

RDmitchell commented 5 years ago

Do we need a specification doc (that we can put up on our website) that shows the format of green button data that SEED will accept? It could be that this green button file, which is from 2013-2014, is old and the format changed ??

RDmitchell commented 5 years ago

@adrian-lara -- I was able to upload a much newer PGE green button file, so maybe the older files have a formatting issue. I have put the file that I was able to import into this issues directory and added that info to the issue doc.

RDmitchell commented 5 years ago

@adrian-lara -- could it be that SEED doesn't import gas green button data? The first file that got an error was gas, the 2nd file that imported was electric data.

RDmitchell commented 5 years ago

@adrian-lara -- it seems like SEED can only import electric green button data. The two electric data files I have both import, the one gas file I have does not. So that's probably the issue.

@nllong -- seems like SEED should be able to import gas green button data? Not sure what the original design / intent was.

adrian-lara commented 5 years ago

@adrian-lara -- it seems like SEED can only import electric green button data. The two electric data files I have both import, the one gas file I have does not. So that's probably the issue.

@nllong -- seems like SEED should be able to import gas green button data? Not sure what the original design / intent was.

@RDmitchell SEED is set up to accept gas green button data, but it looks like it's tripping up on receiving this particular combination of units - "milli" therm. I'm looking into a general fix now.

adrian-lara commented 5 years ago

@RDmitchell In the meantime, if you'd like to see imported gas meters, you can upload this version of the file you shared with me: https://drive.google.com/open?id=1lDfiPbVIqtVAMZ8UsqT_ply18pV7_ONW

I manually changed the contents.

Specifically, I changed the units specified in line 49 from: <powerOfTenMultiplier>-3</powerOfTenMultiplier> to: <powerOfTenMultiplier>0</powerOfTenMultiplier> just so you can see gas readings within SEED. I'll throw a fix in to get the original file uploaded.

RDmitchell commented 5 years ago

thx!

RDmitchell commented 5 years ago

@adrian-lara -- I was able to import 2 electric files with different meter numbers (same data) and also your temporarily fixed file. The program made the column for the gas data, but I don't see any data there -- but it didn't give any errors. I will retest this once you have your general fix for the gas data in place. image

RDmitchell commented 5 years ago

@adrian-lara -- actually the gas data must be there, because when I switch to the month view, it shows up. So NEVER MIND !! image

RDmitchell commented 5 years ago

@adrian-lara -- When I only select the gas meter for Interval == Exact, then the data shows up.

Presumably this is because the gas and electric data intervals don't line up.

image

adrian-lara commented 5 years ago

@adrian-lara -- When I only select the gas meter for Interval == Exact, then the data shows up.

Presumably this is because the gas and electric data intervals don't line up.

image

I think this might actually come from some readings being 0. The table adjusts the rows/times it shows when different types are filtered. If a time really doesn't have a reading for one meter (but does have it for another meter), the cell will be empty.

RDmitchell commented 5 years ago

@adrian-lara -- turns out if you sort the data by start time, then both the gas and electric data are displayed, even with different intervals. That's great !! image

adrian-lara commented 5 years ago

@RDmitchell The fix has been deployed to dev1. You should be able to import your original GreenButton gas file.

Let us know how it goes 🤞

RDmitchell commented 5 years ago

Imported natural gas GB file from 2014 pge_RESIDENTIAL_gas_interval_data_2013-01-01_to_2014-01-01.xml image image

Worked great !

Closing this issue

RDmitchell commented 5 years ago

instance: dev1 SHA: e120119f

Retested importing my sample green button data and everything worked well !