localvoid / cxx-benchmark-count-digits

C++ counting digits benchmark
23 stars 6 forks source link

=========================== Counting digits benchmark

In this benchmark we are trying to find the fastest implementation of log10(value | 1) for integer values.

Compiling

::

$ mkdir build
$ cd build
$ cmake -DCMAKE_BUILD_TYPE=Release ..
$ make

Running Benchmarks

To run benchmarking script you need to install R language <http://www.r-project.org/> and ggplot2 <http://ggplot2.org/>.

Make sure that you set cpu frequency <https://wiki.archlinux.org/index.php/CPU_Frequency_Scaling>_ to fixed value and disable any turbo mode, so the results of the benchmark should be more accurate.

And then you can run the benchmark. It will generate .png files in the current directory.

::

$ cd scripts
$ ./benchmark.sh

Benchmark details

Each algorithm is compiled in its own benchmarking application and testing application.

Benchmarking application support positional arguments:

Testing application can be launched in two modes: simple testing and random testing. For simple testing, just launch the application, and for random testing launch application with an integer argument, it will be used as a seed for random number generator.

benchmark.sh ++++++++++++

This script run benchmarks in two modes(cold, hot) and collect data from it.

In the cold mode, it runs benchmark application for 100 times with arguments (inner loop counter=1, integer size=, digits=<all values for current integer size>).

In the hot mode, it runs benchmark application for 100 times with arguments (inner loop counter=100, integer size=).

And then generates graphical representation of the collected data. As a time value it uses minimum of all time values for each (benchmark, integer size, digits).

Benchmarking results

Linux 3.10.11, gcc 4.8.1 (core i5-3570k, intel_pstate) ++++++++++++++++++++++++++++++++

Cold run

.. image:: https://raw.github.com/localvoid/cxx-benchmark-count-digits/master/results/linux/gcc_4_8/i5_3570k/cold_digits10_64.png .. image:: https://raw.github.com/localvoid/cxx-benchmark-count-digits/master/results/linux/gcc_4_8/i5_3570k/cold_digits10_32.png .. image:: https://raw.github.com/localvoid/cxx-benchmark-count-digits/master/results/linux/gcc_4_8/i5_3570k/cold_digits10_16.png .. image:: https://raw.github.com/localvoid/cxx-benchmark-count-digits/master/results/linux/gcc_4_8/i5_3570k/cold_digits10_8.png

Hot run

.. image:: https://raw.github.com/localvoid/cxx-benchmark-count-digits/master/results/linux/gcc_4_8/i5_3570k/hot_digits10_64.png .. image:: https://raw.github.com/localvoid/cxx-benchmark-count-digits/master/results/linux/gcc_4_8/i5_3570k/hot_digits10_32.png .. image:: https://raw.github.com/localvoid/cxx-benchmark-count-digits/master/results/linux/gcc_4_8/i5_3570k/hot_digits10_16.png .. image:: https://raw.github.com/localvoid/cxx-benchmark-count-digits/master/results/linux/gcc_4_8/i5_3570k/hot_digits10_8.png