search

k0kubun / hamlit

High Performance Haml Implementation
https://rubygems.org/gems/hamlit
Other
980 stars 60 forks source link

Add bench to GitHub Actions #185

Closed tnir closed 3 years ago

tnir commented 3 years ago

Revert benchmark CI jobs dropped on migration from Travis CI to GitHub Actions in #167.

  1. travis-ci.org will be shut down in days https://blog.travis-ci.com/2021-05-07-orgshutdown, so we will be able to see the job shown in README: https://travis-ci.org/github/k0kubun/hamlit/jobs/732178446.
  2. With hamlit 2.15.0, I sometimes saw some performance degradation with uncertain stability in my (unstable) environment (see below), so I will be happy to track the results continuously.

Test 1

Comparison:
       erubi v1.10.0:   221094.2 i/s
         slim v4.1.0:   217911.3 i/s - 1.01x slower
      hamlit v2.15.0:   181058.4 i/s - 1.22x slower
         faml v0.8.1:   165955.5 i/s - 1.33x slower
         haml v5.2.1:   130652.8 i/s - 1.69x slower

Test 2

Comparison:
      hamlit v2.15.0:   229626.8 i/s
       erubi v1.10.0:   215138.1 i/s - 1.07x slower
         slim v4.1.0:   208698.4 i/s - 1.10x slower
         faml v0.8.1:   187905.2 i/s - 1.22x slower
         haml v5.2.1:   134914.5 i/s - 1.70x slower

Signed-off-by: Takuya Noguchi takninnovationresearch@gmail.com

azure-pipelines[bot] commented 3 years ago
There was an error handling pipeline event ac818b9a-22a7-4861-a0b6-f19ae065561d.
tnir commented 3 years ago

Thanks. Performance instability happened on the default branch on GH Actions (bundle exec rake bench SLIM_BENCH=1):

Comparison:
       erubi v1.10.0:   164506.6 i/s
         slim v4.1.0:   162024.9 i/s - 1.02x slower
      hamlit v2.15.0:   159994.3 i/s - 1.03x slower
         faml v0.8.1:   131554.8 i/s - 1.25x slower
         haml v5.2.1:    96235.7 i/s - 1.71x slower

https://github.com/k0kubun/hamlit/runs/2784565136