search

daanx / mimalloc-bench

Suite for benchmarking malloc implementations.
MIT License
357 stars 53 forks source link

Add new graph for multiple runs #189

Closed mjp41 closed 1 year ago

mjp41 commented 1 year ago

This addes a python script for generating graphs that have some amount of statistical information in.

The bench.sh script can be called with -r=N to run multiple times. This script can consume those runs and generate box graphs that illustrate the noise in the runs.

mjp41 commented 1 year ago

I have been using a script like this on occasion to help quickly visualise benchmarking results.

It generates two graphs

time

and

memory

The results are normalised to the average across the benchmark for all allocators. As some of the benchmarks are noisy using box plots can help visualise the noise and is suggestive of actual statistical differences.

This PR commits a tidied up version of the script.