search

busy-hour-studio / blaze

Event Driven Framework for @honojs/hono
MIT License
8 stars 0 forks source link

[REST API] Performance are lower than Express #44

Open krsbx opened 8 months ago

krsbx commented 8 months ago

Express: image

Blaze: image

Hono: image

Since Blaze is based on Hono, it should have a performance which closest to Hono. The PR #42 are mean to fix this issues but the performance of the REST are still far from what we expected.

After #42 implemented: image

Result in the becnhmark: image

krsbx commented 8 months ago

Update 28/02/2024: Found the issues, it's on the rest response itself on PR #47, on the latest commit (e18b2fd9d97e1f44ad9cf894df39bda6847bd3fe), we succeed to increase the throughput to 5.96MB with average Request/Seconds is 27798.30

krsbx commented 8 months ago

Update 04/03/20240: Results in the benchmark: image

krsbx commented 7 months ago

Update 22/04/2024 w/ changes on #53 :

[Express]
Statistics        Avg      Stdev        Max
  Reqs/sec     10335.13    1447.90   11739.41
  Latency       12.09ms     2.69ms    92.45ms
  HTTP codes:
    1xx - 0, 2xx - 103441, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     2.84MB/s

[Blaze]
Statistics        Avg      Stdev        Max
  Reqs/sec     26020.97    3352.23   28432.99
  Latency        4.80ms     1.57ms    77.16ms
  HTTP codes:
    1xx - 0, 2xx - 260304, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     5.58MB/s

[Hono]
Statistics        Avg      Stdev        Max
  Reqs/sec     33221.54    4401.20   37051.42
  Latency        3.76ms     1.03ms    56.72ms
  HTTP codes:
    1xx - 0, 2xx - 332295, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     7.13MB/s
krsbx commented 7 months ago

Update 25/04/2024 with changes on #54 :

[Express]
Statistics        Avg      Stdev        Max
  Reqs/sec     10642.25    1415.21   11948.79
  Latency       11.74ms     2.50ms    89.29ms
  HTTP codes:
    1xx - 0, 2xx - 106531, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     2.92MB/s

[Blaze]
Statistics        Avg      Stdev        Max
  Reqs/sec     26162.52    3563.90   28526.28
  Latency        4.78ms     1.59ms    77.34ms
  HTTP codes:
    1xx - 0, 2xx - 261732, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     5.61MB/s

[Hono]
Statistics        Avg      Stdev        Max
  Reqs/sec     33822.25    4214.40   36983.55
  Latency        3.69ms     1.02ms    58.09ms
  HTTP codes:
    1xx - 0, 2xx - 338291, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     7.26MB/s
krsbx commented 1 month ago

Update 12/09/2024, WIP

[Express]
Statistics        Avg      Stdev        Max
  Reqs/sec     11458.65    1825.28   16791.01
  Latency       10.90ms     3.91ms   131.68ms
  HTTP codes:
    1xx - 0, 2xx - 114650, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     3.15MB/s

[Blaze]
Statistics        Avg      Stdev        Max
  Reqs/sec     40168.13    7241.35   58179.51
  Latency        3.11ms     2.22ms   133.19ms
  HTTP codes:
    1xx - 0, 2xx - 401527, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     8.61MB/s

[Hono]
Statistics        Avg      Stdev        Max
  Reqs/sec     33585.36    5037.15   50599.75
  Latency        3.72ms     2.67ms   146.33ms
  HTTP codes:
    1xx - 0, 2xx - 335813, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     7.20MB/s
[Express]
Statistics        Avg      Stdev        Max
  Reqs/sec     14740.17    2630.31   19298.29
  Latency        8.48ms     2.85ms   104.43ms
  HTTP codes:
    1xx - 0, 2xx - 147516, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     4.05MB/s

[Blaze]
Statistics        Avg      Stdev        Max
  Reqs/sec     38696.34    7403.31   62715.90
  Latency        3.23ms     2.46ms   144.34ms
  HTTP codes:
    1xx - 0, 2xx - 386839, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     8.30MB/s

[Hono]
Statistics        Avg      Stdev        Max
  Reqs/sec     42213.38    9320.22   68698.58
  Latency        2.96ms     1.75ms   107.77ms
  HTTP codes:
    1xx - 0, 2xx - 422139, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     9.06MB/s
[Express]
Statistics        Avg      Stdev        Max
  Reqs/sec     11770.35    1960.63   16511.99
  Latency       10.61ms     4.74ms   158.57ms
  HTTP codes:
    1xx - 0, 2xx - 117770, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     3.23MB/s

[Blaze]
Statistics        Avg      Stdev        Max
  Reqs/sec     40782.03    6972.87   58174.99
  Latency        3.06ms     2.20ms   133.06ms
  HTTP codes:
    1xx - 0, 2xx - 407831, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     8.75MB/s

[Hono]
Statistics        Avg      Stdev        Max
  Reqs/sec     44074.35    6299.59   63117.17
  Latency        2.83ms     2.50ms   157.16ms
  HTTP codes:
    1xx - 0, 2xx - 440739, 3xx - 0, 4xx - 0, 5xx - 0
    others - 0
  Throughput:     9.45MB/s

Need further investigation is this a fluke or not