alexnathanson / solar-protocol

A repository in development for a solar powered network of servers that host a distributed web platform. Project by Tega Brain, Alex Nathanson and Benedetta Piantella. Supported by Eyebeam, Mozilla, and CS&S
http://solarprotocol.net
220 stars 19 forks source link

negative time differences #55

Open Pixouls opened 1 year ago

Pixouls commented 1 year ago

I have been running some code to learn more about trends in my system. I noticed that on 20 of my 300+ data files, there is at least one point where the sequential time is less than the following time. For example on 2022-04-19

System had negative time differences: [ -430.127956 -109.774476 -12.062889 -4.682464 -124.78222 -108.727727 -13.30134 -12.654384 -12.99282 -5.842884 -3.776641 -12.337655 -125.118799 -854.827142 -4.738896 -1186.761292] These took place at, (array([312, 320, 322, 325, 329, 336, 338, 346, 348, 351, 354, 356, 360, 381, 384, 504], dtype=int64),)

image

There are 48 times in total where negatives times occur.

I haven't had time to investigate as to why this happens, but we should eventually address it and add it to the documentation to make it clear whether there needs to be filter or sorting or replacing that needs to be accounted for from anyone working with this data.