MangoAutomation / ma-core-public

Mango Automation Core public code
Other
78 stars 50 forks source link

Excel Spreadsheet download maximum size exceeded #227

Open terrypacker opened 10 years ago

terrypacker commented 10 years ago

Problem Description: From: @resotek As I was viewing the watchlist named "Currents AC2," I requested a graph of all 15 datapoints from 2014-08-27,12:00 to Latest with success. That was roughly 36 hours of data: that watchlist contains 15 datapoints sampled at 1 or 2 second intervals, stored instantly, purged after two days. That seems to be 1,737,733 point samples.

I then requested an Excel download of the same data, and after perhaps half a minute received a "System exception!" page in the browser.

Subsequent testing yielded the following outcomes when attempting to download the numeric data: Reproduce the error two more times with a request for the same time interval and all 15 points Request Excel for six of the points over that interval (devices HPC2 and PM5): successful Toggle the above query and request Excel for the other nine points over that period: successful Download all 15 points to CSV over same period: successful. 1,737,734 lines, 1,737,733 samples All 15 points over a 15 minute interval (Aug 27, 0730-0745) to Excel: successful. I'm thinking the error may be related to the size of the Excel file, or the memory used to generate it.

I was able to download the data I need for this event, so prioritize this accordingly.

Solution: Split Excel exports into Sheets on Max sheet size

terrypacker commented 8 years ago

Doesn't this already happen?

terrypacker commented 8 years ago

The new UI will have a better way to manage point value exports into Excel.