Trouble with 14 day backload

[GoogleCodeExporter]

What steps will reproduce the problem?
I am trying to upload the live data from the previous 14 days to pvoutput.

What is the expected output? What do you see instead?
Instead of gradualy uploading older and older data, the same data is always 
uploaded. This means I can only upload about 7 days, before I hit the 60 
uploads limit.
This wouldn't be a problem if the older days were uploaded after one hour has 
passed, but instead it just re-uploads the already uploaded days!

What version of the product are you using (e.g. 1.4.1.9 32bit)?
1.5.0.5 x64

What Operating system (XP, Vista, Windows 7 - 32bit or 64bit)?
Windows 7 x64

Which Database Type (MySQL, MS Access, SQLite - If Access, 32bit or 64bit)?
SQLite

Are there any unusual messages in PVService.log? (upload a copy to this
issue if there are)
Just the (normal) messages about the 60 uploads limit.

Please upload your settings.xml file with the issue. This answers many
questions I would otherwise need to ask.

Please provide any additional information below.

Original issue reported on code.google.com by esther.g...@gmail.com on 30 Jun 2011 at 5:51

[GoogleCodeExporter]

I have been away for a few days. I will catch up ASAP.

Dennis M-F

Original comment by DennisMackayFisher on 3 Jul 2011 at 8:28

• Changed state: Accepted

[GoogleCodeExporter]

If this is still a problem, please upload the database (pvhistory.s3db) and 
PVService.log

Loading a full 14 days takes a long time and will encounter th 60 / hour limit 
many times. PVBC does keep trying and it does track the data that has been 
correctly uploaded.

I took a look at your site. It seems to have loaded over 14 days of data.

Is all well now?

Dennis M-F

Original comment by DennisMackayFisher on 3 Jul 2011 at 9:29

• Added labels: Type-Task
• Removed labels: Type-Defect

[GoogleCodeExporter]

I have enter the daily totals for the older days manually. As I understand, 
it's not possible to upload live data older then 14 days, not even manually.

The oldest day with "Live" data is 18/6. By now this is indeed 14 days ago, so 
it looks OK, but I'm afraid it's not complete.

I just checked, and the excel export from Sunny Explorer showed the following 
start and end hours on these dates:
21/6 6:20-21:30
22/6 6:15-21:35
23/6 5:45-21:35

When I check on pvoutput, the hours are as follows:
21/6 6:20-18:20 (evening is missing)
22/6 8:20-21:35 (morning is missing)
23/6 8:00-21:35 (morning is missing)

The PVService log DOES show the missing data, so it looks like it's queued for 
upload, so that's OK.

Is there a reason for the data not being uploaded sequentially? Because it 
looks like it uploads part of day 1, part of day 2, part of day 3, ... instead 
of first completely uploading day 1 and then continuing with day 2 ad so on. 
Correct me if I'm wrong, just trying to understand how it all works.

Original comment by esther.g...@gmail.com on 3 Jul 2011 at 7:43

[GoogleCodeExporter]

It loads recent days first moving back 1 day at a time. Each day is loaded from 
morning to evening. Part day loads can be caused by pvoutput rejections. 
pvoutput sometimes rejects if it sees a reduction in energy values at a point 
in time on a day.

Dennis M-F

Original comment by DennisMackayFisher on 9 Jul 2011 at 6:42

[GoogleCodeExporter]

OK, thanks for the explanation.
All data seems to have uploaded OK now.
I imported the older data manually. I then lowered the amount of days to upload 
to 2 and the errors in the log have vanished as well.

If anyone would be interested: I wrote an excel macro that changes sunny 
explorer exports to 100 line files, ready to import into pvoutput.org as live 
data. It's poorly written and with it's limitations (full days only, 2 
inverters only, ...), but it works! Someone with a little knowledge in VBA 
could probably make something more flexible with only half the lines.

Thanks again for your efforts on this great program!

Original comment by esther.g...@gmail.com on 9 Jul 2011 at 8:58

[GoogleCodeExporter]

Original comment by DennisMackayFisher on 18 Jul 2011 at 11:31

• Changed state: Done