Closed pausz closed 6 years ago
Performance experiments have to evaluate three aspects of the software: 1) Speed 2) Memory usage 3) Accuracy
The most straightforward way to evaluate speed is to run sequences of simulations for different sizes of the input (ie, model). The simulation parameters which dominate the overall size are:
The parameters that will dominate memory usage are
TBD
nf_benchmarks
functionalityuser
and sys
and % cpu usage. nf_benchmarks --to-mem <config_filename> --num-trials 10
nf_benchmarks
.
nf_benchmarks
utility.
Automate benchmark execution. A script will take a .conf file and save information about execution times, memory, hardware used, etc (use this branch)
Write benchmark results to file.