mmtk / mmtk-core

Memory Management ToolKit
https://www.mmtk.io
Other
375 stars 69 forks source link

Performance microbenchmarks for mmtk-core #113

Open qinsoon opened 4 years ago

qinsoon commented 4 years ago

We should have simple kernel tests to drive critical part of mmtk-core code. This allows us to analyze performance without involving VM bindings. This also allows us to do thousands of iterations and invocations for stable results (1).

(1): https://stefan-marr.de/2020/07/is-this-noise-or-does-this-mean-something-benchmarking/

qinsoon commented 4 years ago

https://github.com/mmtk/mmtk-core/pull/131 added a microbenchmark run that reports to the related PR by comparing master and PR. We should also run microbenchmarks and track its history.

qinsoon commented 2 years ago

We may also want to include this benchmark for our microbenchmark suite: https://github.com/dsrg-uoft/LangBench/tree/main/sort/java

It heavily tests write barrier performance.

qinsoon commented 10 months ago

We have some criterion benches, but those are using MockVM right now which is slow. We need to introduce another VMBinding in mmtk-core to run those benches at reasonable performance.

qinsoon commented 9 months ago

Two most important things we want to measure are: 1. allocation throughput, and 2. tracing throughput.