search

attractivechaos / plb2

A programming language benchmark
Creative Commons Zero v1.0 Universal
257 stars 36 forks source link

Consider benchmarking using TruffleRuby Native #64

Closed eregon closed 9 months ago

eregon commented 9 months ago

Hello,

I did a run of the 3 Ruby benchmarks (with smaller input size) under:

Here are my results on smaller input sizes (to keep it short), I used the average of 5 runs.

benchmark and size 3.3.0+YJIT truffleruby
src/ruby/matmul.rb 400 2165ms 334ms
src/ruby/nqueen.rb 12 656ms 199ms
src/ruby/sudoku.rb 5 811ms 479ms

So TruffleRuby is quite a bit faster (as expected as it's a more advanced JIT, example results).

Would it be possible to include TruffleRuby Native in your next run of benchmarking? See https://github.com/oracle/truffleruby/blob/master/doc/user/installing-truffleruby.md for how to install.

attractivechaos commented 9 months ago

Thanks. I will consider. Which release from the download page to use?

eregon commented 9 months ago

Please use the latest release at the time at https://github.com/oracle/truffleruby/releases (FYI, release schedule is https://www.graalvm.org/release-calendar/)

attractivechaos commented 9 months ago

Added. Thanks for the suggestion.

attractivechaos commented 9 months ago

I am very impressed by truffleruby.