Closed JD557 closed 4 years ago
@JD557 I think we should document how to run the benchmarks somewhere:
i.e, ./sbt bench/jmh:run -i 1 -wi 1 -f1 -t1
, maybe the CONTRIBUTING.md
? I'll update the ticket.
Thanks again. If you have any suggestions/more ideas, would love to add them to the issue.
Here's my results using the same parameters, on a Dell XPS 15, 16GB RAM, Intel® Core™ i7-8750H CPU @ 2.20GHz × 6
Benchmark Mode Cnt Score Error Units
ArrayDistanceBenchmarks.largeDiffCosineTest thrpt 463256.862 ops/s
ArrayDistanceBenchmarks.largeDiffDamerauTest thrpt 19882.380 ops/s
ArrayDistanceBenchmarks.largeDiffDiceCoefficientTest thrpt 631493.535 ops/s
ArrayDistanceBenchmarks.largeDiffHammingTest thrpt 1464930.412 ops/s
ArrayDistanceBenchmarks.largeDiffJaccardTest thrpt 35501.091 ops/s
ArrayDistanceBenchmarks.largeDiffJaroTest thrpt 8291.683 ops/s
ArrayDistanceBenchmarks.largeDiffJaroWinklerTest thrpt 8316.724 ops/s
ArrayDistanceBenchmarks.largeDiffLevenshteinTest thrpt 13307.179 ops/s
ArrayDistanceBenchmarks.largeDiffNGramDistTest thrpt 35880.455 ops/s
ArrayDistanceBenchmarks.largeDiffNGramScoreTest thrpt 31889.103 ops/s
ArrayDistanceBenchmarks.largeDiffNeedlemanWunschTest thrpt 16332.953 ops/s
ArrayDistanceBenchmarks.largeDiffOverlapTest thrpt 31283.130 ops/s
ArrayDistanceBenchmarks.largeDiffSmithWatermanGotohTest thrpt 16083.343 ops/s
ArrayDistanceBenchmarks.largeDiffSmithWatermanTest thrpt 1247.211 ops/s
ArrayDistanceBenchmarks.largeDiffTverskyTest thrpt 11251.254 ops/s
ArrayDistanceBenchmarks.largeSameCosineTest thrpt 407963.255 ops/s
ArrayDistanceBenchmarks.largeSameDamerauTest thrpt 13001.855 ops/s
ArrayDistanceBenchmarks.largeSameDiceCoefficientTest thrpt 482972.464 ops/s
ArrayDistanceBenchmarks.largeSameHammingTest thrpt 1058518.906 ops/s
ArrayDistanceBenchmarks.largeSameJaccardTest thrpt 77212.547 ops/s
ArrayDistanceBenchmarks.largeSameJaroTest thrpt 92520.326 ops/s
ArrayDistanceBenchmarks.largeSameJaroWinklerTest thrpt 84377.621 ops/s
ArrayDistanceBenchmarks.largeSameLevenshteinTest thrpt 10648.974 ops/s
ArrayDistanceBenchmarks.largeSameNGramDistTest thrpt 75980.752 ops/s
ArrayDistanceBenchmarks.largeSameNGramScoreTest thrpt 75287.870 ops/s
ArrayDistanceBenchmarks.largeSameNeedlemanWunschTest thrpt 1474620.965 ops/s
ArrayDistanceBenchmarks.largeSameOverlapTest thrpt 74760.483 ops/s
ArrayDistanceBenchmarks.largeSameSmithWatermanGotohTest thrpt 15637.325 ops/s
ArrayDistanceBenchmarks.largeSameSmithWatermanTest thrpt 1163.969 ops/s
ArrayDistanceBenchmarks.largeSameTverskyTest thrpt 74420.307 ops/s
ArrayDistanceBenchmarks.smallDiffCosineTest thrpt 881964.240 ops/s
ArrayDistanceBenchmarks.smallDiffDamerauTest thrpt 295043.787 ops/s
ArrayDistanceBenchmarks.smallDiffDiceCoefficientTest thrpt 1390611.681 ops/s
ArrayDistanceBenchmarks.smallDiffHammingTest thrpt 3175494.749 ops/s
ArrayDistanceBenchmarks.smallDiffJaccardTest thrpt 235655.354 ops/s
ArrayDistanceBenchmarks.smallDiffJaroTest thrpt 368428.064 ops/s
ArrayDistanceBenchmarks.smallDiffJaroWinklerTest thrpt 340532.643 ops/s
ArrayDistanceBenchmarks.smallDiffLevenshteinTest thrpt 218356.645 ops/s
ArrayDistanceBenchmarks.smallDiffLongestCommonSeqTest thrpt 351.577 ops/s
ArrayDistanceBenchmarks.smallDiffNGramDistTest thrpt 243391.176 ops/s
ArrayDistanceBenchmarks.smallDiffNGramScoreTest thrpt 248387.995 ops/s
ArrayDistanceBenchmarks.smallDiffNeedlemanWunschTest thrpt 348656.779 ops/s
ArrayDistanceBenchmarks.smallDiffOverlapTest thrpt 244052.050 ops/s
ArrayDistanceBenchmarks.smallDiffSmithWatermanGotohTest thrpt 334112.438 ops/s
ArrayDistanceBenchmarks.smallDiffSmithWatermanTest thrpt 129757.925 ops/s
ArrayDistanceBenchmarks.smallDiffTverskyTest thrpt 183541.753 ops/s
ArrayDistanceBenchmarks.smallSameCosineTest thrpt 994661.654 ops/s
ArrayDistanceBenchmarks.smallSameDamerauTest thrpt 276295.859 ops/s
ArrayDistanceBenchmarks.smallSameDiceCoefficientTest thrpt 1004635.635 ops/s
ArrayDistanceBenchmarks.smallSameHammingTest thrpt 3537342.102 ops/s
ArrayDistanceBenchmarks.smallSameJaccardTest thrpt 1280571.412 ops/s
ArrayDistanceBenchmarks.smallSameJaroTest thrpt 506491.705 ops/s
ArrayDistanceBenchmarks.smallSameJaroWinklerTest thrpt 510600.949 ops/s
ArrayDistanceBenchmarks.smallSameLevenshteinTest thrpt 220997.361 ops/s
ArrayDistanceBenchmarks.smallSameLongestCommonSeqTest thrpt 7151477.247 ops/s
ArrayDistanceBenchmarks.smallSameNGramDistTest thrpt 1327008.651 ops/s
ArrayDistanceBenchmarks.smallSameNGramScoreTest thrpt 1302470.502 ops/s
ArrayDistanceBenchmarks.smallSameNeedlemanWunschTest thrpt 13202646.597 ops/s
ArrayDistanceBenchmarks.smallSameOverlapTest thrpt 1250181.714 ops/s
ArrayDistanceBenchmarks.smallSameSmithWatermanGotohTest thrpt 329937.512 ops/s
ArrayDistanceBenchmarks.smallSameSmithWatermanTest thrpt 128986.998 ops/s
ArrayDistanceBenchmarks.smallSameTverskyTest thrpt 1124017.169 ops/s
[success] Total time: 1263 s (21:03), completed Nov 1, 2020 2:34:05 PM
As a follow-up to https://github.com/vickumar1981/stringdistance/pull/58#pullrequestreview-517270531, this PR adds some JMH benchmarks to the
ArrayDistance
methods.Here are the results of running
jmh:run -i 1 -wi 1 -f1 -t1
on my 2015 MacBook Pro.I had to disable the
large*LongestCommonSeqTest
, since those took a very long time to run.