PVoutput Total Energy discrepancy Daily/Live

[GoogleCodeExporter]

What steps will reproduce the problem?
1.Run PVBeancounter with upload to PVOutput
2.
3.

What is the expected output? What do you see instead?
Discrepancy on some days between the Total Energy used in the Live Output 
figures to those showing in the equivalent Daily figures. Examples over the 
last few days:
Date       Daily(kWh) Live (kWh)
30/06/2011 4.401      4.401
01/07/2011 15.206     15.381
02/07/2011 2.474      20.458
03/07/2011 12.843     12.843
04/07/2011 11.043     13.709
05/07/2011 2.35       11.916
06/07/2011 4.006      12.475

What version of the product are you using (e.g. 1.4.1.9 32bit)?
1.5.0.5

What Operating system (XP, Vista, Windows 7 - 32bit or 64bit)?
Vista 32bit

Which Database Type (MySQL, MS Access, SQLite - If Access, 32bit or 64bit)?
SQLit

Are there any unusual messages in PVService.log? (upload a copy to this
issue if there are)
No

Please upload your settings.xml file with the issue. This answers many
questions I would otherwise need to ask.

Please provide any additional information below.
I raised the issue on the PVOutput forum and received the following reply:
bankstownbloke
The daily energy result should always equal to the greatest (i.e. latest) 
energy value submitted via the live update.

When a live status is sent the daily result is automatically updated.

For the two to be different your uploading software might be calling the 'Add 
Output' service with a different daily energy value to that of the last live 
status submission. 

Original issue reported on code.google.com by mjyoun...@googlemail.com on 12 Jul 2011 at 10:24

[GoogleCodeExporter]

Please reply with a link to the conversation with pvoutput (BB).

PVBC backfills missing data in the live uploads. If PVBC is shutdown for a 
period, it will upload CC meter data created from the two hour history records. 
PVBC tries to minimise the traffic to pvoutput. It does not send updates where 
the values are not changing. It is possible that a combination of meter 
tollerance calculations results in the last value sent to pvoutput for a day 
not being the "latest / greatest".

I will investigate.

Dennis M-F

Original comment by DennisMackayFisher on 12 Jul 2011 at 10:47

• Changed state: Started

[GoogleCodeExporter]

PVOutput conversation
http://getsatisfaction.com/pvoutput/topics/daily_live_total_consumption_discrepa
ncy
Thanks
Malcolm

Original comment by mjyoun...@googlemail.com on 12 Jul 2011 at 11:43

[GoogleCodeExporter]

I am having this exact same problem

There is a small descrepancy - I delete the daily data and force and upload and 
all is good

Original comment by em...@miskeljin.com on 22 Jul 2011 at 9:42

[GoogleCodeExporter]

same issue here since I changed to SQlite

- W7 64bit 
- no error message displayed in log
- reloading whole days fixes the issue

Original comment by 66ma...@gmail.com on 7 Aug 2011 at 9:50

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

[deleted comment]

[GoogleCodeExporter]

I have same problem today

Day 19.410 http://pvoutput.org/list.jsp?id=3635&sid=2846
Live 19.665 http://pvoutput.org/intraday.jsp?id=3635&sid=2846&dt=20110808

I have tried deleting both and forcing upload but keep getting same results

Typically the next day if I force and upload it corrects itself.

Original comment by em...@miskeljin.com on 8 Aug 2011 at 8:19

[GoogleCodeExporter]

I have also witnessed this issue last night. The overall value shown on the 
dialy figure was actually showing the value from 20minutes previous i.e. 
drilling down into the 5minute figures showed 9.001KWh @ 20:20hrs but the daily 
figure showed a total value of 8.842Kwh, which is actually the value from 19:55

Since all the 5minute figures where successfully uploaded I just edited the 
correct value in through PVOutput itself, but its not very confidence inspiring.

I'm currently evaluating on Win XP (32bit) with SQLite on an old laptop before 
deciding if I should install on the server.

Original comment by marcus.j...@gmail.com on 8 Aug 2011 at 9:32

[GoogleCodeExporter]

Just had a look and it is the data at 4:40 that has been stopped at.  Is that 
the same time for you?

Original comment by em...@miskeljin.com on 8 Aug 2011 at 10:59

[GoogleCodeExporter]

I'v only seen it happen the once and it was the 07:55pm figure that were being 
displayed as the dialy total rather then the 08:20pm figure that had been 
successfully uploaded. I suspect that there was a comms issue (between my 
laptop and the inverter) around 8pm that caused PVB to grab/fill in the data in 
a different order i.e. it filled in the 7:55pm figure after the 08:20pm figure 
and so stamped the incorrect total KWh figure into the update ?

Original comment by marcus.j...@gmail.com on 8 Aug 2011 at 11:36

[GoogleCodeExporter]

It happens to me everyday (I normally have to manually grab data from Inverter 
(as I believe their is an issue with bluetooth with me) but most days I do a 
forced upload and it corrects this but not working today

Original comment by em...@miskeljin.com on 8 Aug 2011 at 12:10

[GoogleCodeExporter]

Version 1.6.0.2 is available here:

http://code.google.com/p/pvbeancounter/downloads/list?can=4&q=&colspec=Filename+
Summary+Uploaded+ReleaseDate+Size+DownloadCount

This version splits the batch uploads to pvoutput at date boundaries. It does 
not batch entries from multiple days in a single message to pvoutput. The  
result should be that the last entry in a batch updates the most recent value 
for a day. It would appear that pvoutput updates day totals based on the last 
entry in a batch. In previous versions the last entry for a day could be in the 
middle of a batch.

Just an experiment. I am not certain it will fix the problem.

Note: 1.6.0.2 has had minimal testing at this time.

Dennis M-F

Original comment by DennisMackayFisher on 10 Aug 2011 at 11:04

[GoogleCodeExporter]

Will test it over the next few days and feedback

Cheers

Original comment by em...@miskeljin.com on 10 Aug 2011 at 12:28

[GoogleCodeExporter]

All worked fine today
Every manual update i did the live and daily titles were the same
Looking good so far

Original comment by em...@miskeljin.com on 11 Aug 2011 at 9:35

[GoogleCodeExporter]

Original comment by DennisMackayFisher on 14 Aug 2011 at 3:17

• Changed state: Verified

[GoogleCodeExporter]

I am seeing this or a very similar problem recently but haven't seen or at 
least noticed it before. My current and yesterday generation readings are very 
different between the live and daily views. Previously erroneous days seem to 
get corrected once older than "yesterday" if you see what I mean.
Eg for 27th Nov Live says 6.567kWh and Daily has 3.061. Currently Today is fine 
but I suspect later in the day/ evening it will be wrong. The day before 
yesterday 26th is also fine now but wasn't yesterday! I haven't done any manual 
or manually- initiated uploads.

Original comment by j...@burstowcottage.co.uk on 28 Nov 2011 at 10:43