inaos / iron-array

2 stars 0 forks source link

Benchmark reporting #92

Open stoni opened 5 years ago

stoni commented 5 years ago

Define a concept how to:

FrancescAlted commented 3 years ago

Another interesting tools are https://pypi.org/project/pytest-benchmark/ and https://github.com/rhysd/github-action-benchmark

FrancescAlted commented 3 years ago

We absolutely need this for 1.0, even if it is not fully complete. We can setup something quick for some fundamental operations, like transcendental expressions, linear algebra and load and store speed.

martaiborra commented 2 years ago

Although it is not fully completed, some work has been done regarding this issue. In the notebooks repository the perf-history folder contains some notebooks, python scripts and a *.csv file. The scripts together used with memprofiler in the notebooks measure the performance for some constructors, all the reductions, some linear algebra computations and some expression evaluations. The results are written in the perf-history.csv file, which is automatically renamed to perf-history-vX.Y.Z.csv each time a tag is pushed in the notebooks repository.