search

RestComm / PerfCorder

Java Performance Recording and Analysis Tool
http://www.restcomm.com/
GNU Affero General Public License v3.0
6 stars 9 forks source link

Allow to test samples tendency beyond typical stats #97

Closed jaimecasero closed 7 years ago

jaimecasero commented 7 years ago

We need to be able to spot that a certain data set is increasing at a certain level. This is specially important to spot memory leaks. The stats we are providing (mean,median...) are not intended for this kind of analysis, and do not allow to spot this tendencies.

jaimecasero commented 7 years ago

One simple solution is to include the first and last samples, and test usinga ratio/relative test goal that is already supported. We also need to track the time in x-axis (we know we take periodic samples at same rate,so the order of the sample gives the time also) to figure out the final gradient of the line.

gradient=​horizontal run​​ /vertical rise​​ horizontal run = time1 - time0 vertical rise​​ = last sample - first sample

jaimecasero commented 7 years ago

consider this techniques: https://en.wikipedia.org/wiki/Linear_trend_estimation https://en.wikipedia.org/wiki/Pearson_correlation_coefficient

jaimecasero commented 7 years ago

Seems current Apache commons Math lib already supports this on: http://commons.apache.org/proper/commons-math/apidocs/org/apache/commons/math4/stat/regression/SimpleRegression.html