letalboy / testrium

Testrium is the pinnacle of testing libraries, designed to elevate your testing experience to heavenly heights. Seamlessly integrating the power and flexibility of modern testing frameworks, ElysianProbe provides an unparalleled suite of tools to ensure your code is flawless.
0 stars 1 forks source link

Implementation of benchmark scores for data normalization #1

Open letalboy opened 4 months ago

letalboy commented 4 months ago

The idea is use a bench mark mechanism to collect samples of the machine performance, then use this score of performance to store the tests results in a normalizated way, with this we can calculate how the program is becoming more fast in the machine in relation to other machines, I believe if we could capture the efficience of disk IO, the CPU performance, the IO and also the memory benchamark we will be able to make a nice variable that we can use to calculate the relation from one computer to another and this way calculate the performance of one compared to the other one, this will allow us to store the data of the tests in a less caotic way to scenarios were we need to run the tests in multiple machines that are diferent one of the another. Or that has diferent sistems. This way we can focus in the contant that is the software understanding how the code evolves with time. Turning the machine performance irrelevant to calc how much the code is better in realtion to the other machine.

letalboy commented 4 months ago

It can be configure when init the tests file or something like that, we also can create other things in the database, like add a new machine then we can run the tests for the desired machine, with this we can create a persistence indentity for each machine what can be very nice to have how to normalize the data comming from the tests...