myaaghubi / PHP-Frameworks-Bench

A library to make benchmarks from PHP frameworks.
GNU General Public License v2.0
109 stars 4 forks source link

Only use the major version in the frameworks dir name #44

Closed joanhey closed 1 year ago

joanhey commented 1 year ago

The frameworks create new versions very fast. We can use minor version and lock the version in composer, but it'll be a never ending change list.

I suggest to only use the major version in dir name. If we want to know the exact version in the actual benchmark run, we can use composer show.

Actual diff in dir name and actual versions used in the bench.

Framework Dir name Actual version
Codeigniter 4.3 4.4.0
Fatfree 3.8.1 3.8.2
Laminas 2.0 2.2.0
Laravel 10.0 10.2.6
Leaf 3.3 3.4.1
Slim 4.11 4.12.0
Ubiquity 2.4.x.dev 2.5.2

For that list, we used: https://github.com/myaaghubi/PHP-Frameworks-Bench/actions/runs/5984291041/job/16235305243#step:6:2

myaaghubi commented 1 year ago

The point is updating even the sub-minor version may makes a considerable change on score 07275bcecaf42fea5ddf7f58c6a97e7d613b4d10 composer show is not helpful since we using create-project, I fixed the mentioned frameworks 42837936990417c1a91933d49c5c9a80f0e317bb, It is not necessary to update the results since the results are for the mentioned dir names, I'll do update all of them after the next PHP release