search

bigdatahci2015 / forum

0 stars 4 forks source link

Data (NetApp) #34

Open doubleshow opened 8 years ago

doubleshow commented 8 years ago

The link will be available for only a few days. Please download them now.

https://dl.dropboxusercontent.com/u/5104407/netapp.csv

KevinKGifford commented 8 years ago

Brian: Can you state anything about the observation and base times, i.e., these are Unix epoch timestamps but are they localtime or gmtime (man gmtime, man date)? Does the data store (ASUP daily report receipt processing facility) convert all of the times to a consistent localtime? Does the ASUP generating facility timestamp as localtime or in gmtime? I understand the observation/initial emphasis on delta time inconsistencies, however I'd like to focus/investigate the timing in general. If this information is not available in the current NetApp.csv data set would it be possible to supplement the data set with this higher fidelity time information?

Kevin

bdmckean commented 8 years ago

The times come from the controller supplying the ASUP. I think they are local time and direct from the installed system and will confirm. Some of the systems use a time service to get the time. Others are set during installation without ongoing correction. Some may come from the manufacturing lines. A few of the systems are in our test lab our in our OEM test labs and thus may have more flaky things happening. These test systems have a FW version where the first digit is 8 or 9 instead of 0. (e.g. 97.86.48.01)

KevinKGifford commented 8 years ago

Thanks for the additional insight; I will look forward to the confirmation.

bdmckean commented 8 years ago

I could not get 100% confirmation but our local expert also says it's local time and some are synched to a time service.

bdmckean commented 8 years ago

I noticed that ~3 days at the end of the csv file are missing. Not sure how that happened. Here is a dropbox link to a file with the all days entries from 1/1/2015 to 7/31/2015.

https://www.dropbox.com/s/muz9lwrlv87fl8m/netapp2.csv?dl=0

KevinKGifford commented 8 years ago

Thanks for checking; that makes intuitive sense. A follow-on question would be is there a ASUP report field that provides geographic (physical address) information so that GMT offset can be calculated? Or even better is there a GMT offset field in the ASUP data? If either of these fields were available we could glean additional insight I would hypothesize...

On Tue, Oct 6, 2015 at 1:42 PM, co-bri notifications@github.com wrote:

I could not get 100% confirmation but our local expert also says it's local time and some are synched to a time service.

— Reply to this email directly or view it on GitHub https://github.com/bigdatahci2015/forum/issues/34#issuecomment-145975937 .

bdmckean commented 8 years ago

I've been looking through the data. I don't see a way to get time zone or a GMT correlation.