dunglas
commented
3 months ago Your config doesn't seem to be optimal at all for benchmarking (Docker Volume, dev mode of Laravel, all features enabled while it's not the case for other tools).
That being said, we cannot review all benchmarks. We maintain one in this repository (https://github.com/dunglas/frankenphp/blob/main/testdata/load-test.js / https://github.com/dunglas/frankenphp/blob/main/testdata/benchmark.Caddyfile) and one for Symfony (https://github.com/dunglas/frankenphp-demo/tree/main/benchmark).
There is also the TechEmpower benchmark (https://github.com/TechEmpower/FrameworkBenchmarks/tree/d9bc7017125517e6ad95de2f5518e9e1361b8bb4/frameworks/PHP/laravel) that uses Laravel. Note that we didn't carefully review it and that it can probably be optimized (for instance, by disabling logs, which are known and expected to slow down benchmarks).
You may also be interested in these issues: https://github.com/dunglas/frankenphp/discussions/72
Feel free to reopen if you can provide a reproducer after having applied these optimizations.
withinboredom
alexskra
joanhey
What happened?
I did a few performance comparisons in requests per second with a basic Laravel skeleton. I tested Nginx + PHP-FPM, FrankenPHP worker(octane), Swoole(octane), and FrankenPHP(not worker mode).
FrankenPHP worker mode is 4,59 % faster than Nginx + PHP-FPM, so very similar, while the performance for static files is 69,57% lower.
FrankenPHP without worker mode is very slow at just ~1 % of the RPS I get with Nginx + PHP-FPM. Despite the low performance, it is still using many cores, so it is spending time doing something.
I would expect Laravel Octane with FrankenPHP to be closer to Swoole, and I would expect the non worker docker run to be much faster.
Additionally I tried embedding the Laravel app following the steps in the docs. Performance was slightly better but still terrible, and when the benchmark was done it crashed with a segfault.
Results
Method
The non-worker mode test of FrankenPHP used docker with host networking to reduce overhead, using the same project as Nginx + PHP-FPM:
docker run --net=host -v $PWD:/app dunglas/frankenphpFrankenPHP does redirect to HTTPS, but the tests are done with Keep-Alive, so it should perform much better despite it being HTTPS.
Commands for PHP benchmarking:
wrk -c 100 -t 1 -d 10s http://localhost/api/hiFor static file serving:wrk -c 100 -t 8 -d 10s http://localhost/ok.txtSystem info
Ubuntu 24.04 Ryzen 9 3950X Linux spark 6.8.0-31-generic #31-Ubuntu SMP PREEMPT_DYNAMIC Sat Apr 20 00:40:06 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux Docker version 26.1.2, build 211e74b
How to reproduce FrankenPHP non-worker results
Build Type
Docker (Debian Bookworm)
Worker Mode
No
Operating System
GNU/Linux
CPU Architecture
x86_64
PHP configuration
Relevant log output
No response