realm / realm-kotlin

Kotlin Multiplatform and Android SDK for the Realm Mobile Database: Build Better Apps Faster.
Apache License 2.0
968 stars 61 forks source link

Benchmarks: Add CI Support #738

Open cmelchior opened 2 years ago

cmelchior commented 2 years ago

Currently, the /benchmarks module has to run manually, but this should run as part of CI.

Requirements:

We probably want to be able to report and handle changes to min, max, average and certain percentiles (like 25, 50, 75, and 90).

cmelchior commented 2 years ago

Seems like Jetbrains created a Benchmark library that works on Kotlin Multiplatform and uses JMH under the hood: https://github.com/Kotlin/kotlinx-benchmark

It is probably worth experimenting with rather than using JMH directly on JVM as we do now.