Shopify / yjit-bench

Set of benchmarks for the YJIT CRuby JIT compiler and other Ruby implementations.
MIT License
87 stars 22 forks source link

Bump the gems in ruby-lsp benchmark #304

Closed rwstauner closed 4 months ago

rwstauner commented 4 months ago

The 0.19 version of prism fails to compile with the latest gcc.

Bumping the gems makes the benchmark take longer for both CRuby and YJIT, but also shows an improved ratio for YJIT:

before:
--------  --------  ----------  ----------  ----------  -------------  ---------
bench     dev (ms)  stddev (%)   yjit (ms)  stddev (%)   yjit 1st itr  dev/ yjit
ruby-lsp  129.6     2.3         87.2        2.9         0.46           1.49
--------  --------  ----------  ----------  ----------  -------------  ---------

after:
--------  --------  ----------  ----------  ----------  -------------  ---------
bench     dev (ms)  stddev (%)   yjit (ms)  stddev (%)   yjit 1st itr  dev/ yjit
ruby-lsp  180.0     1.1         105.6       3.9         0.41           1.71
--------  --------  ----------  ----------  ----------  -------------  ---------