search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update oven/bun Docker tag to v1.0.32 #401

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Type Update Change
oven/bun final patch 1.0.30 -> 1.0.32

Release Notes

oven-sh/bun (oven/bun) ### [`v1.0.32`](https://togithub.com/oven-sh/bun/releases/tag/bun-v1.0.32): Bun v1.0.32 To install Bun v1.0.32: ```bash curl https://bun.sh/install | bash ### or you can use npm ### npm install -g bun ``` To upgrade to Bun v1.0.32: ```bash bun upgrade ``` ##### **[Read Bun v1.0.32's release notes on Bun's blog](https://bun.sh/blog/bun-v1.0.32)** ##### Thank you to 8 contributors! - [@​cirospaciari](https://togithub.com/cirospaciari) - [@​dylan-conway](https://togithub.com/dylan-conway) - [@​eventualbuddha](https://togithub.com/eventualbuddha) - [@​fmajestic](https://togithub.com/fmajestic) - [@​Jarred-Sumner](https://togithub.com/Jarred-Sumner) - [@​nektro](https://togithub.com/nektro) - [@​paperdave](https://togithub.com/paperdave) - [@​zackradisic](https://togithub.com/zackradisic) ### [`v1.0.31`](https://togithub.com/oven-sh/bun/releases/tag/bun-v1.0.31): Bun v1.0.31 To install Bun v1.0.31: ```bash curl https://bun.sh/install | bash ### or you can use npm ### npm install -g bun ``` To upgrade to Bun v1.0.31: ```bash bun upgrade ``` ##### **[Read Bun v1.0.31's release notes on Bun's blog](https://bun.sh/blog/bun-v1.0.31)** ##### Thank you to 18 contributors! - [@​BrookJeynes](https://togithub.com/BrookJeynes) - [@​camero2734](https://togithub.com/camero2734) - [@​cirospaciari](https://togithub.com/cirospaciari) - [@​cyfung1031](https://togithub.com/cyfung1031) - [@​dylan-conway](https://togithub.com/dylan-conway) - [@​Electroid](https://togithub.com/Electroid) - [@​ErikOnBike](https://togithub.com/ErikOnBike) - [@​eventualbuddha](https://togithub.com/eventualbuddha) - [@​Jarred-Sumner](https://togithub.com/Jarred-Sumner) - [@​jdalton](https://togithub.com/jdalton) - [@​Marukome0743](https://togithub.com/Marukome0743) - [@​nektro](https://togithub.com/nektro) - [@​paperdave](https://togithub.com/paperdave) - [@​ryands17](https://togithub.com/ryands17) - [@​sequencerr](https://togithub.com/sequencerr) - [@​sharpobject](https://togithub.com/sharpobject) - [@​Yash-Singh1](https://togithub.com/Yash-Singh1) - [@​zieka](https://togithub.com/zieka)

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 172 5256 total, 0 failed avg: 496ms, p95: 692ms ✅
apollo-router 168 5134 total, 0 failed avg: 519ms, p95: 709ms ✅
wundergraph 151 4591 total, 0 failed avg: 550ms, p95: 1027ms ✅
mesh-supergraph-bun 99 3048 total, 0 failed avg: 975ms, p95: 1676ms ✅
apollo-server 50 1590 total, 0 failed avg: 1928ms, p95: 2395ms ✅
mercurius 31 966 total, 0 failed avg: 3127ms, p95: 4485ms ✅
mesh-supergraph 28 889 total, 0 failed avg: 3457ms, p95: 5783ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15768 ✗ 0 data_received..................: 461 MB 15 MB/s data_sent......................: 6.2 MB 205 kB/s http_req_blocked...............: avg=68.12µs min=1.56µs med=3.05µs max=51.62ms p(90)=4.69µs p(95)=5.79µs http_req_connecting............: avg=49.39µs min=0s med=0s max=51.54ms p(90)=0s p(95)=0s http_req_duration..............: avg=495.98ms min=29.06ms med=500.06ms max=1.65s p(90)=611.77ms p(95)=691.91ms { expected_response:true }...: avg=495.98ms min=29.06ms med=500.06ms max=1.65s p(90)=611.77ms p(95)=691.91ms http_req_failed................: 0.00% ✓ 0 ✗ 5256 http_req_receiving.............: avg=30.79ms min=37.95µs med=81.2µs max=1.15s p(90)=69.2ms p(95)=210.86ms http_req_sending...............: avg=2.03ms min=8.38µs med=14.47µs max=903.79ms p(90)=47.67µs p(95)=1ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=463.15ms min=25.1ms med=485.55ms max=764.75ms p(90)=573.73ms p(95)=600.48ms http_reqs......................: 5256 172.970413/s iteration_duration.............: avg=575.21ms min=47.8ms med=545.01ms max=2.12s p(90)=778.5ms p(95)=937.97ms iterations.....................: 5256 172.970413/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15402 ✗ 0 data_received..................: 450 MB 15 MB/s data_sent......................: 6.1 MB 200 kB/s http_req_blocked...............: avg=40.63µs min=1.38µs med=2.85µs max=24.04ms p(90)=4.51µs p(95)=5.52µs http_req_connecting............: avg=28.15µs min=0s med=0s max=5.98ms p(90)=0s p(95)=0s http_req_duration..............: avg=519.08ms min=15.9ms med=524.83ms max=1.53s p(90)=657.96ms p(95)=709.46ms { expected_response:true }...: avg=519.08ms min=15.9ms med=524.83ms max=1.53s p(90)=657.96ms p(95)=709.46ms http_req_failed................: 0.00% ✓ 0 ✗ 5134 http_req_receiving.............: avg=18.82ms min=34.32µs med=69.09µs max=1.17s p(90)=17.31ms p(95)=86.19ms http_req_sending...............: avg=1.56ms min=7.12µs med=13.71µs max=769.67ms p(90)=36.5µs p(95)=655.03µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=498.69ms min=14.93ms med=513.04ms max=897.87ms p(90)=634.78ms p(95)=667.54ms http_reqs......................: 5134 168.671736/s iteration_duration.............: avg=588.91ms min=38.31ms med=569.08ms max=2.19s p(90)=758.99ms p(95)=856.78ms iterations.....................: 5134 168.671736/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13773 ✗ 0 data_received..................: 403 MB 13 MB/s data_sent......................: 5.4 MB 180 kB/s http_req_blocked...............: avg=133.87µs min=1.28µs med=3.28µs max=136.94ms p(90)=5.45µs p(95)=6.48µs http_req_connecting............: avg=95.59µs min=0s med=0s max=102.83ms p(90)=0s p(95)=0s http_req_duration..............: avg=550.16ms min=16.65ms med=513.87ms max=2.25s p(90)=877.44ms p(95)=1.02s { expected_response:true }...: avg=550.16ms min=16.65ms med=513.87ms max=2.25s p(90)=877.44ms p(95)=1.02s http_req_failed................: 0.00% ✓ 0 ✗ 4591 http_req_receiving.............: avg=57.43ms min=39.99µs med=106.73µs max=1.53s p(90)=194.74ms p(95)=412.08ms http_req_sending...............: avg=3.6ms min=8µs med=15.16µs max=1.36s p(90)=67.51µs p(95)=753.38µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=489.13ms min=16.33ms med=461.02ms max=1.28s p(90)=798.27ms p(95)=885.95ms http_reqs......................: 4591 151.188929/s iteration_duration.............: avg=657.74ms min=33.35ms med=592.53ms max=2.81s p(90)=1.08s p(95)=1.32s iterations.....................: 4591 151.188929/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9144 ✗ 0 data_received..................: 267 MB 8.7 MB/s data_sent......................: 3.6 MB 118 kB/s http_req_blocked...............: avg=35.68µs min=1.3µs med=2.78µs max=44.34ms p(90)=4.4µs p(95)=8.27µs http_req_connecting............: avg=15.75µs min=0s med=0s max=5.52ms p(90)=0s p(95)=0s http_req_duration..............: avg=975.12ms min=260.15ms med=847.07ms max=2.63s p(90)=1.57s p(95)=1.67s { expected_response:true }...: avg=975.12ms min=260.15ms med=847.07ms max=2.63s p(90)=1.57s p(95)=1.67s http_req_failed................: 0.00% ✓ 0 ✗ 3048 http_req_receiving.............: avg=9.29ms min=36.05µs med=92.47µs max=485.86ms p(90)=743.32µs p(95)=31.09ms http_req_sending...............: avg=344.44µs min=7.88µs med=13.55µs max=48.86ms p(90)=39.75µs p(95)=162.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=965.47ms min=259.69ms med=842.91ms max=2.63s p(90)=1.57s p(95)=1.67s http_reqs......................: 3048 99.170111/s iteration_duration.............: avg=1s min=272.93ms med=872.43ms max=2.69s p(90)=1.59s p(95)=1.71s iterations.....................: 3048 99.170111/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4770 ✗ 0 data_received..................: 140 MB 4.4 MB/s data_sent......................: 1.9 MB 60 kB/s http_req_blocked...............: avg=222.42µs min=1.43µs med=2.85µs max=6.62ms p(90)=4.9µs p(95)=1.46ms http_req_connecting............: avg=204.1µs min=0s med=0s max=6.59ms p(90)=0s p(95)=1.19ms http_req_duration..............: avg=1.92s min=894.14ms med=1.65s max=19.72s p(90)=1.9s p(95)=2.39s { expected_response:true }...: avg=1.92s min=894.14ms med=1.65s max=19.72s p(90)=1.9s p(95)=2.39s http_req_failed................: 0.00% ✓ 0 ✗ 1590 http_req_receiving.............: avg=195.33µs min=51.32µs med=118.91µs max=35.16ms p(90)=178.01µs p(95)=208.71µs http_req_sending...............: avg=33.74µs min=8.19µs med=14.5µs max=557.4µs p(90)=31.2µs p(95)=115.59µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.92s min=893.93ms med=1.65s max=19.72s p(90)=1.9s p(95)=2.39s http_reqs......................: 1590 50.608461/s iteration_duration.............: avg=1.93s min=899.61ms med=1.66s max=19.75s p(90)=1.91s p(95)=2.4s iterations.....................: 1590 50.608461/s vus............................: 47 min=47 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2898 ✗ 0 data_received..................: 85 MB 2.8 MB/s data_sent......................: 1.1 MB 38 kB/s http_req_blocked...............: avg=69.14µs min=1.75µs med=4.04µs max=2.28ms p(90)=100.22µs p(95)=455.7µs http_req_connecting............: avg=58.19µs min=0s med=0s max=2.25ms p(90)=73.13µs p(95)=397.07µs http_req_duration..............: avg=3.12s min=602.05ms med=2.96s max=7.61s p(90)=4.16s p(95)=4.48s { expected_response:true }...: avg=3.12s min=602.05ms med=2.96s max=7.61s p(90)=4.16s p(95)=4.48s http_req_failed................: 0.00% ✓ 0 ✗ 966 http_req_receiving.............: avg=317.12µs min=41.96µs med=123.1µs max=73.38ms p(90)=189.05µs p(95)=224.94µs http_req_sending...............: avg=50.39µs min=9.08µs med=22.04µs max=2.85ms p(90)=50.54µs p(95)=289.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.12s min=601.47ms med=2.96s max=7.61s p(90)=4.16s p(95)=4.48s http_reqs......................: 966 31.598105/s iteration_duration.............: avg=3.13s min=611.02ms med=2.97s max=7.62s p(90)=4.17s p(95)=4.49s iterations.....................: 966 31.598105/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2667 ✗ 0 data_received..................: 78 MB 2.5 MB/s data_sent......................: 1.1 MB 34 kB/s http_req_blocked...............: avg=410.57µs min=2.1µs med=5.04µs max=8.09ms p(90)=1.03ms p(95)=3.49ms http_req_connecting............: avg=400.05µs min=0s med=0s max=7.95ms p(90)=1ms p(95)=3.46ms http_req_duration..............: avg=3.45s min=1.29s med=3.29s max=7.56s p(90)=4.77s p(95)=5.78s { expected_response:true }...: avg=3.45s min=1.29s med=3.29s max=7.56s p(90)=4.77s p(95)=5.78s http_req_failed................: 0.00% ✓ 0 ✗ 889 http_req_receiving.............: avg=2.25ms min=45.62µs med=166.21µs max=77.23ms p(90)=1.37ms p(95)=5.86ms http_req_sending...............: avg=77.87µs min=9.82µs med=28.4µs max=7.36ms p(90)=138.53µs p(95)=380.36µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.45s min=1.29s med=3.29s max=7.56s p(90)=4.77s p(95)=5.77s http_reqs......................: 889 28.222239/s iteration_duration.............: avg=3.47s min=1.3s med=3.31s max=7.57s p(90)=4.79s p(95)=5.8s iterations.....................: 889 28.222239/s vus............................: 50 min=50 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 163 5003 total, 0 failed avg: 541ms, p95: 725ms ✅
wundergraph 105 3247 total, 0 failed avg: 896ms, p95: 1101ms ✅
mesh-supergraph-bun 100 3121 total, 0 failed avg: 942ms, p95: 1356ms ✅
cosmo 81 2544 total, 0 failed avg: 1170ms, p95: 1461ms ✅
mesh-supergraph 64 1995 total, 0 failed avg: 1509ms, p95: 2132ms ✅
apollo-server 63 1961 total, 0 failed avg: 1536ms, p95: 1877ms ✅
mercurius 12 469 total, 0 failed avg: 7227ms, p95: 8505ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15009 ✗ 0 data_received..................: 439 MB 14 MB/s data_sent......................: 5.9 MB 194 kB/s http_req_blocked...............: avg=69.55µs min=1.13µs med=2.79µs max=76.29ms p(90)=4.37µs p(95)=5.52µs http_req_connecting............: avg=50.2µs min=0s med=0s max=9.7ms p(90)=0s p(95)=0s http_req_duration..............: avg=541ms min=260.44ms med=533.58ms max=1.24s p(90)=669.55ms p(95)=724.82ms { expected_response:true }...: avg=541ms min=260.44ms med=533.58ms max=1.24s p(90)=669.55ms p(95)=724.82ms http_req_failed................: 0.00% ✓ 0 ✗ 5003 http_req_receiving.............: avg=17.02ms min=38.63µs med=75.46µs max=447.84ms p(90)=66.73ms p(95)=107.23ms http_req_sending...............: avg=1.74ms min=7.95µs med=13.52µs max=452.29ms p(90)=34.33µs p(95)=1.19ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=522.23ms min=260.34ms med=518.88ms max=851.92ms p(90)=638ms p(95)=672.99ms http_reqs......................: 5003 163.782513/s iteration_duration.............: avg=606.16ms min=284.12ms med=593.2ms max=1.5s p(90)=771.31ms p(95)=848.19ms iterations.....................: 5003 163.782513/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9741 ✗ 0 data_received..................: 285 MB 9.3 MB/s data_sent......................: 3.9 MB 126 kB/s http_req_blocked...............: avg=44.29µs min=1.34µs med=2.6µs max=3.6ms p(90)=4.02µs p(95)=8.46µs http_req_connecting............: avg=39.12µs min=0s med=0s max=3.58ms p(90)=0s p(95)=0s http_req_duration..............: avg=896.1ms min=530.26ms med=893.23ms max=1.41s p(90)=1.04s p(95)=1.1s { expected_response:true }...: avg=896.1ms min=530.26ms med=893.23ms max=1.41s p(90)=1.04s p(95)=1.1s http_req_failed................: 0.00% ✓ 0 ✗ 3247 http_req_receiving.............: avg=11.1ms min=34.03µs med=76.42µs max=306.89ms p(90)=35.45ms p(95)=81ms http_req_sending...............: avg=1.56ms min=7.7µs med=12.85µs max=247.59ms p(90)=40.94µs p(95)=738.91µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=883.44ms min=526.68ms med=882.49ms max=1.27s p(90)=1.02s p(95)=1.07s http_reqs......................: 3247 105.709246/s iteration_duration.............: avg=934.07ms min=542.93ms med=927.52ms max=1.43s p(90)=1.09s p(95)=1.16s iterations.....................: 3247 105.709246/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9363 ✗ 0 data_received..................: 274 MB 8.9 MB/s data_sent......................: 3.7 MB 120 kB/s http_req_blocked...............: avg=41.16µs min=1.53µs med=2.98µs max=7.91ms p(90)=4.7µs p(95)=10.1µs http_req_connecting............: avg=33.2µs min=0s med=0s max=7.88ms p(90)=0s p(95)=0s http_req_duration..............: avg=941.64ms min=360.68ms med=923.87ms max=1.83s p(90)=1.23s p(95)=1.35s { expected_response:true }...: avg=941.64ms min=360.68ms med=923.87ms max=1.83s p(90)=1.23s p(95)=1.35s http_req_failed................: 0.00% ✓ 0 ✗ 3121 http_req_receiving.............: avg=12.31ms min=36.04µs med=85.65µs max=883.95ms p(90)=1.56ms p(95)=44.26ms http_req_sending...............: avg=634.56µs min=8.18µs med=14.66µs max=137.95ms p(90)=40.53µs p(95)=403.28µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=928.69ms min=360.53ms med=911.48ms max=1.83s p(90)=1.21s p(95)=1.33s http_reqs......................: 3121 100.91367/s iteration_duration.............: avg=978.28ms min=370.77ms med=955.49ms max=1.87s p(90)=1.28s p(95)=1.41s iterations.....................: 3121 100.91367/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7632 ✗ 0 data_received..................: 223 MB 7.1 MB/s data_sent......................: 3.0 MB 97 kB/s http_req_blocked...............: avg=63.84µs min=1.43µs med=2.51µs max=5.22ms p(90)=3.9µs p(95)=9.5µs http_req_connecting............: avg=55.28µs min=0s med=0s max=3.82ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=713.85ms med=1.14s max=1.78s p(90)=1.38s p(95)=1.46s { expected_response:true }...: avg=1.16s min=713.85ms med=1.14s max=1.78s p(90)=1.38s p(95)=1.46s http_req_failed................: 0.00% ✓ 0 ✗ 2544 http_req_receiving.............: avg=13.43ms min=38.93µs med=82.46µs max=351.79ms p(90)=47.91ms p(95)=100.95ms http_req_sending...............: avg=824.79µs min=7.91µs med=12.73µs max=170.9ms p(90)=38.68µs p(95)=603.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=713.72ms med=1.13s max=1.73s p(90)=1.35s p(95)=1.44s http_reqs......................: 2544 81.450386/s iteration_duration.............: avg=1.2s min=751.7ms med=1.18s max=1.89s p(90)=1.43s p(95)=1.52s iterations.....................: 2544 81.450386/s vus............................: 26 min=26 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5985 ✗ 0 data_received..................: 175 MB 5.6 MB/s data_sent......................: 2.4 MB 76 kB/s http_req_blocked...............: avg=114.17µs min=1.51µs med=3.44µs max=67.4ms p(90)=4.92µs p(95)=96.39µs http_req_connecting............: avg=71.72µs min=0s med=0s max=6.17ms p(90)=0s p(95)=19.32µs http_req_duration..............: avg=1.5s min=720.21ms med=1.46s max=3.61s p(90)=1.92s p(95)=2.13s { expected_response:true }...: avg=1.5s min=720.21ms med=1.46s max=3.61s p(90)=1.92s p(95)=2.13s http_req_failed................: 0.00% ✓ 0 ✗ 1995 http_req_receiving.............: avg=1.98ms min=40.47µs med=125.2µs max=100.45ms p(90)=2.24ms p(95)=10.82ms http_req_sending...............: avg=198.11µs min=7.49µs med=17.58µs max=87.87ms p(90)=35.6µs p(95)=122.27µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.5s min=720.11ms med=1.46s max=3.61s p(90)=1.91s p(95)=2.12s http_reqs......................: 1995 64.348543/s iteration_duration.............: avg=1.53s min=727.19ms med=1.48s max=3.63s p(90)=1.95s p(95)=2.15s iterations.....................: 1995 64.348543/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5883 ✗ 0 data_received..................: 172 MB 5.6 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=109.52µs min=1.38µs med=3.22µs max=5.81ms p(90)=4.89µs p(95)=99.79µs http_req_connecting............: avg=104.22µs min=0s med=0s max=5.67ms p(90)=0s p(95)=63.52µs http_req_duration..............: avg=1.53s min=740.11ms med=1.46s max=9.58s p(90)=1.76s p(95)=1.87s { expected_response:true }...: avg=1.53s min=740.11ms med=1.46s max=9.58s p(90)=1.76s p(95)=1.87s http_req_failed................: 0.00% ✓ 0 ✗ 1961 http_req_receiving.............: avg=432.86µs min=44.42µs med=114.33µs max=107.2ms p(90)=186.73µs p(95)=267.55µs http_req_sending...............: avg=65µs min=8.81µs med=16.45µs max=34.09ms p(90)=32.24µs p(95)=109.12µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.53s min=740ms med=1.46s max=9.58s p(90)=1.76s p(95)=1.87s http_reqs......................: 1961 63.387819/s iteration_duration.............: avg=1.55s min=750.01ms med=1.47s max=9.59s p(90)=1.78s p(95)=1.9s iterations.....................: 1961 63.387819/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1407 ✗ 0 data_received..................: 41 MB 1.1 MB/s data_sent......................: 557 kB 15 kB/s http_req_blocked...............: avg=436.08µs min=2.11µs med=4.46µs max=5.44ms p(90)=1.73ms p(95)=3.46ms http_req_connecting............: avg=403.5µs min=0s med=0s max=4.72ms p(90)=1.64ms p(95)=3.42ms http_req_duration..............: avg=7.22s min=3.19s med=7.53s max=8.86s p(90)=8.32s p(95)=8.5s { expected_response:true }...: avg=7.22s min=3.19s med=7.53s max=8.86s p(90)=8.32s p(95)=8.5s http_req_failed................: 0.00% ✓ 0 ✗ 469 http_req_receiving.............: avg=153.8µs min=60.29µs med=131.15µs max=2.51ms p(90)=194.66µs p(95)=250.95µs http_req_sending...............: avg=205.24µs min=12.79µs med=26.41µs max=3.06ms p(90)=965.43µs p(95)=1.53ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.22s min=3.19s med=7.53s max=8.86s p(90)=8.32s p(95)=8.5s http_reqs......................: 469 12.554746/s iteration_duration.............: avg=7.23s min=3.2s med=7.54s max=8.87s p(90)=8.32s p(95)=8.52s iterations.....................: 469 12.554746/s vus............................: 8 min=8 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 150 4596 total, 0 failed avg: 612ms, p95: 793ms ✅
wundergraph 101 3119 total, 0 failed avg: 938ms, p95: 1179ms ✅
mesh-supergraph-bun 82 2548 total, 0 failed avg: 1168ms, p95: 1852ms ✅
cosmo 79 2479 total, 0 failed avg: 1204ms, p95: 1513ms ✅
apollo-server 43 1360 total, 0 failed avg: 2269ms, p95: 2785ms ✅
mesh-supergraph 30 977 total, 0 failed avg: 3149ms, p95: 5439ms ✅
mercurius 11 449 total, 0 failed avg: 7561ms, p95: 9046ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13788 ✗ 0 data_received..................: 403 MB 13 MB/s data_sent......................: 5.5 MB 178 kB/s http_req_blocked...............: avg=59.57µs min=1.21µs med=2.62µs max=40.31ms p(90)=3.96µs p(95)=4.99µs http_req_connecting............: avg=38.21µs min=0s med=0s max=5.58ms p(90)=0s p(95)=0s http_req_duration..............: avg=611.99ms min=291.24ms med=603.29ms max=1.29s p(90)=736.16ms p(95)=793.21ms { expected_response:true }...: avg=611.99ms min=291.24ms med=603.29ms max=1.29s p(90)=736.16ms p(95)=793.21ms http_req_failed................: 0.00% ✓ 0 ✗ 4596 http_req_receiving.............: avg=12.43ms min=33.46µs med=71.78µs max=406.03ms p(90)=49.3ms p(95)=83.72ms http_req_sending...............: avg=1.28ms min=7.75µs med=13µs max=335.37ms p(90)=32.02µs p(95)=138.58µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=598.27ms min=291.02ms med=592.9ms max=935.16ms p(90)=713.49ms p(95)=757.12ms http_reqs......................: 4596 150.261927/s iteration_duration.............: avg=660.38ms min=300.43ms med=648.25ms max=1.31s p(90)=808.11ms p(95)=872.95ms iterations.....................: 4596 150.261927/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9357 ✗ 0 data_received..................: 274 MB 8.9 MB/s data_sent......................: 3.7 MB 120 kB/s http_req_blocked...............: avg=108.86µs min=1.26µs med=2.46µs max=82.06ms p(90)=3.7µs p(95)=7.96µs http_req_connecting............: avg=73.91µs min=0s med=0s max=5.87ms p(90)=0s p(95)=0s http_req_duration..............: avg=938.14ms min=591.35ms med=923.85ms max=1.5s p(90)=1.1s p(95)=1.17s { expected_response:true }...: avg=938.14ms min=591.35ms med=923.85ms max=1.5s p(90)=1.1s p(95)=1.17s http_req_failed................: 0.00% ✓ 0 ✗ 3119 http_req_receiving.............: avg=12.79ms min=38.37µs med=84.22µs max=382.45ms p(90)=44.24ms p(95)=86.82ms http_req_sending...............: avg=1.52ms min=7.18µs med=12.53µs max=312.4ms p(90)=42.18µs p(95)=379.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=923.83ms min=591.28ms med=915.15ms max=1.42s p(90)=1.08s p(95)=1.13s http_reqs......................: 3119 101.342815/s iteration_duration.............: avg=973.97ms min=601.47ms med=956ms max=1.51s p(90)=1.15s p(95)=1.24s iterations.....................: 3119 101.342815/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7644 ✗ 0 data_received..................: 224 MB 7.2 MB/s data_sent......................: 3.0 MB 98 kB/s http_req_blocked...............: avg=108.33µs min=1.34µs med=2.86µs max=5.76ms p(90)=4.44µs p(95)=10.41µs http_req_connecting............: avg=97.63µs min=0s med=0s max=5.74ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.16s min=544.19ms med=1.09s max=2.46s p(90)=1.6s p(95)=1.85s { expected_response:true }...: avg=1.16s min=544.19ms med=1.09s max=2.46s p(90)=1.6s p(95)=1.85s http_req_failed................: 0.00% ✓ 0 ✗ 2548 http_req_receiving.............: avg=11.72ms min=38.12µs med=93.61µs max=715.55ms p(90)=1.17ms p(95)=36.39ms http_req_sending...............: avg=364.46µs min=8.16µs med=14.25µs max=71.03ms p(90)=40.37µs p(95)=348.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.15s min=543.9ms med=1.08s max=2.36s p(90)=1.58s p(95)=1.84s http_reqs......................: 2548 82.423952/s iteration_duration.............: avg=1.19s min=553.88ms med=1.12s max=2.47s p(90)=1.63s p(95)=1.87s iterations.....................: 2548 82.423952/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7437 ✗ 0 data_received..................: 218 MB 7.0 MB/s data_sent......................: 2.9 MB 94 kB/s http_req_blocked...............: avg=55.73µs min=1.19µs med=2.4µs max=9.96ms p(90)=3.71µs p(95)=9.55µs http_req_connecting............: avg=51.79µs min=0s med=0s max=9.92ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.2s min=811.77ms med=1.19s max=1.93s p(90)=1.4s p(95)=1.51s { expected_response:true }...: avg=1.2s min=811.77ms med=1.19s max=1.93s p(90)=1.4s p(95)=1.51s http_req_failed................: 0.00% ✓ 0 ✗ 2479 http_req_receiving.............: avg=13.23ms min=37.58µs med=83.87µs max=370.67ms p(90)=46.08ms p(95)=97.16ms http_req_sending...............: avg=1.41ms min=7.71µs med=12.46µs max=239.61ms p(90)=53.04µs p(95)=694.53µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.18s min=811.61ms med=1.18s max=1.63s p(90)=1.38s p(95)=1.47s http_reqs......................: 2479 79.260035/s iteration_duration.............: avg=1.24s min=821.08ms med=1.22s max=1.97s p(90)=1.45s p(95)=1.54s iterations.....................: 2479 79.260035/s vus............................: 22 min=22 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4080 ✗ 0 data_received..................: 120 MB 3.8 MB/s data_sent......................: 1.6 MB 51 kB/s http_req_blocked...............: avg=96.98µs min=2.2µs med=4.92µs max=4.19ms p(90)=11.99µs p(95)=520.22µs http_req_connecting............: avg=88.61µs min=0s med=0s max=4.15ms p(90)=0s p(95)=493.59µs http_req_duration..............: avg=2.26s min=929.21ms med=1.98s max=16.12s p(90)=2.46s p(95)=2.78s { expected_response:true }...: avg=2.26s min=929.21ms med=1.98s max=16.12s p(90)=2.46s p(95)=2.78s http_req_failed................: 0.00% ✓ 0 ✗ 1360 http_req_receiving.............: avg=306.71µs min=50.69µs med=139.06µs max=63.49ms p(90)=204.95µs p(95)=279.37µs http_req_sending...............: avg=73.35µs min=11.48µs med=29.1µs max=1.24ms p(90)=64.51µs p(95)=352.24µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.26s min=928.99ms med=1.98s max=16.12s p(90)=2.46s p(95)=2.78s http_reqs......................: 1360 43.233005/s iteration_duration.............: avg=2.27s min=938.72ms med=1.99s max=16.14s p(90)=2.47s p(95)=2.79s iterations.....................: 1360 43.233005/s vus............................: 65 min=65 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2931 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=103.53µs min=1.4µs med=3.13µs max=7.53ms p(90)=91.94µs p(95)=391.33µs http_req_connecting............: avg=83.39µs min=0s med=0s max=5.85ms p(90)=56.78µs p(95)=317.04µs http_req_duration..............: avg=3.14s min=860.61ms med=3.2s max=7.59s p(90)=4.37s p(95)=5.43s { expected_response:true }...: avg=3.14s min=860.61ms med=3.2s max=7.59s p(90)=4.37s p(95)=5.43s http_req_failed................: 0.00% ✓ 0 ✗ 977 http_req_receiving.............: avg=3.21ms min=39.58µs med=125.4µs max=98.08ms p(90)=1.78ms p(95)=11.36ms http_req_sending...............: avg=89.27µs min=8.44µs med=16.47µs max=21.45ms p(90)=51.73µs p(95)=216.51µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.14s min=859.98ms med=3.2s max=7.59s p(90)=4.37s p(95)=5.43s http_reqs......................: 977 30.948498/s iteration_duration.............: avg=3.16s min=872.03ms med=3.21s max=7.6s p(90)=4.38s p(95)=5.46s iterations.....................: 977 30.948498/s vus............................: 51 min=51 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1347 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 533 kB 14 kB/s http_req_blocked...............: avg=173.86µs min=1.47µs med=3.02µs max=8.07ms p(90)=499.44µs p(95)=850.21µs http_req_connecting............: avg=116.04µs min=0s med=0s max=3.78ms p(90)=423.78µs p(95)=760.71µs http_req_duration..............: avg=7.56s min=3.13s med=7.74s max=9.26s p(90)=8.91s p(95)=9.04s { expected_response:true }...: avg=7.56s min=3.13s med=7.74s max=9.26s p(90)=8.91s p(95)=9.04s http_req_failed................: 0.00% ✓ 0 ✗ 449 http_req_receiving.............: avg=272.06µs min=62.78µs med=115.89µs max=65.78ms p(90)=167.99µs p(95)=191.21µs http_req_sending...............: avg=63.74µs min=8.54µs med=18.65µs max=581.96µs p(90)=210.32µs p(95)=380.81µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.56s min=3.13s med=7.74s max=9.26s p(90)=8.91s p(95)=9.04s http_reqs......................: 449 11.959393/s iteration_duration.............: avg=7.56s min=3.14s med=7.75s max=9.27s p(90)=8.92s p(95)=9.05s iterations.....................: 449 11.959393/s vus............................: 11 min=11 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
apollo-router 2351ms 171 12023 total, 0 failed avg: 832ms, p95: 2351ms, max: 5520ms, med: 618ms ✅
cosmo 2582ms 174 12215 total, 0 failed avg: 821ms, p95: 2582ms, max: 7356ms, med: 563ms ❌ 1 unexpected GraphQL errors, non-compatible response structure (1)
wundergraph 2587ms 158 11062 total, 0 failed avg: 837ms, p95: 2587ms, max: 6077ms, med: 506ms ✅
mesh-supergraph-bun 5627ms 115 8068 total, 0 failed avg: 2293ms, p95: 5627ms, max: 9060ms, med: 2121ms ✅
mesh-supergraph 6433ms 70 4963 total, 0 failed avg: 3840ms, p95: 6433ms, max: 8273ms, med: 3937ms ✅
apollo-server 23927ms 68 4987 total, 0 failed avg: 4188ms, p95: 23927ms, max: 45258ms, med: 2226ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36069 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 204 kB/s http_req_blocked...............: avg=16.43ms min=1.46µs med=3.15µs max=2.97s p(90)=5.14µs p(95)=12.93µs http_req_connecting............: avg=16.25ms min=0s med=0s max=2.97s p(90)=0s p(95)=0s http_req_duration..............: avg=832.12ms min=7.05ms med=618.43ms max=5.51s p(90)=1.87s p(95)=2.35s { expected_response:true }...: avg=832.12ms min=7.05ms med=618.43ms max=5.51s p(90)=1.87s p(95)=2.35s http_req_failed................: 0.00% ✓ 0 ✗ 12023 http_req_receiving.............: avg=259.19ms min=29.53µs med=81.14µs max=4.59s p(90)=1.08s p(95)=1.59s http_req_sending...............: avg=36.69ms min=7.98µs med=14.87µs max=3.76s p(90)=354.67µs p(95)=97.64ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=536.23ms min=6.97ms med=407.17ms max=2.64s p(90)=1.11s p(95)=1.36s http_reqs......................: 12023 171.728955/s iteration_duration.............: avg=1.52s min=13.99ms med=1.12s max=9.41s p(90)=3.47s p(95)=4.33s iterations.....................: 12023 171.728955/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12214 / ✗ 1 ✗ valid response structure ↳ 99% — ✓ 12214 / ✗ 1 checks.........................: 99.99% ✓ 36643 ✗ 2 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 207 kB/s http_req_blocked...............: avg=19.95ms min=1.38µs med=2.93µs max=4.09s p(90)=4.69µs p(95)=11.91µs http_req_connecting............: avg=19.06ms min=0s med=0s max=4.09s p(90)=0s p(95)=0s http_req_duration..............: avg=820.65ms min=6.74ms med=562.94ms max=7.35s p(90)=1.86s p(95)=2.58s { expected_response:true }...: avg=820.65ms min=6.74ms med=562.94ms max=7.35s p(90)=1.86s p(95)=2.58s http_req_failed................: 0.00% ✓ 0 ✗ 12215 http_req_receiving.............: avg=313.67ms min=25.11µs med=80.02µs max=6.65s p(90)=1.12s p(95)=1.94s http_req_sending...............: avg=30.12ms min=8.46µs med=13.56µs max=4.64s p(90)=171.13µs p(95)=72.52ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=476.85ms min=6.64ms med=391.29ms max=2.91s p(90)=978.11ms p(95)=1.18s http_reqs......................: 12215 174.475287/s iteration_duration.............: avg=1.5s min=12.22ms med=1.02s max=12.62s p(90)=3.59s p(95)=4.63s iterations.....................: 12215 174.475287/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 33186 ✗ 0 data_received..................: 971 MB 14 MB/s data_sent......................: 13 MB 188 kB/s http_req_blocked...............: avg=23.24ms min=1.81µs med=4.02µs max=3.08s p(90)=6.62µs p(95)=26.8µs http_req_connecting............: avg=22.29ms min=0s med=0s max=3.08s p(90)=0s p(95)=0s http_req_duration..............: avg=836.63ms min=7.34ms med=506.06ms max=6.07s p(90)=2.02s p(95)=2.58s { expected_response:true }...: avg=836.63ms min=7.34ms med=506.06ms max=6.07s p(90)=2.02s p(95)=2.58s http_req_failed................: 0.00% ✓ 0 ✗ 11062 http_req_receiving.............: avg=320.57ms min=34.98µs med=110.23µs max=4.76s p(90)=1.3s p(95)=1.89s http_req_sending...............: avg=38.09ms min=8.83µs med=20.23µs max=3.79s p(90)=646.26µs p(95)=76.86ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=477.95ms min=7.23ms med=323.56ms max=3.15s p(90)=1.14s p(95)=1.46s http_reqs......................: 11062 158.011195/s iteration_duration.............: avg=1.66s min=13.16ms med=1.12s max=13.18s p(90)=3.92s p(95)=4.93s iterations.....................: 11062 158.011195/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24204 ✗ 0 data_received..................: 708 MB 10 MB/s data_sent......................: 9.6 MB 137 kB/s http_req_blocked...............: avg=1.93ms min=1.68µs med=3.29µs max=612.09ms p(90)=6.06µs p(95)=225.51µs http_req_connecting............: avg=1.75ms min=0s med=0s max=322.53ms p(90)=0s p(95)=150.9µs http_req_duration..............: avg=2.29s min=6.42ms med=2.12s max=9.06s p(90)=4.51s p(95)=5.62s { expected_response:true }...: avg=2.29s min=6.42ms med=2.12s max=9.06s p(90)=4.51s p(95)=5.62s http_req_failed................: 0.00% ✓ 0 ✗ 8068 http_req_receiving.............: avg=28.51ms min=37.83µs med=81.88µs max=1.82s p(90)=61.45ms p(95)=190.03ms http_req_sending...............: avg=2.76ms min=8.67µs med=15.39µs max=530.08ms p(90)=78.7µs p(95)=5.19ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.26s min=6.2ms med=2.07s max=8.95s p(90)=4.49s p(95)=5.61s http_reqs......................: 8068 115.249682/s iteration_duration.............: avg=2.35s min=12.22ms med=2.17s max=9.44s p(90)=4.57s p(95)=5.68s iterations.....................: 8068 115.249682/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14889 ✗ 0 data_received..................: 436 MB 6.2 MB/s data_sent......................: 5.9 MB 84 kB/s http_req_blocked...............: avg=669.9µs min=1.23µs med=3.37µs max=213.89ms p(90)=113.64µs p(95)=418.78µs http_req_connecting............: avg=654.09µs min=0s med=0s max=213.83ms p(90)=66.99µs p(95)=345.76µs http_req_duration..............: avg=3.83s min=10.75ms med=3.93s max=8.27s p(90)=6.03s p(95)=6.43s { expected_response:true }...: avg=3.83s min=10.75ms med=3.93s max=8.27s p(90)=6.03s p(95)=6.43s http_req_failed................: 0.00% ✓ 0 ✗ 4963 http_req_receiving.............: avg=2.71ms min=35.84µs med=93µs max=317.9ms p(90)=1.36ms p(95)=9.85ms http_req_sending...............: avg=633.67µs min=7.99µs med=16.7µs max=128.19ms p(90)=48.18µs p(95)=126.07µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.83s min=10.65ms med=3.93s max=8.27s p(90)=6.02s p(95)=6.43s http_reqs......................: 4963 70.885429/s iteration_duration.............: avg=3.87s min=17.45ms med=3.95s max=8.29s p(90)=6.05s p(95)=6.49s iterations.....................: 4963 70.885429/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14961 ✗ 0 data_received..................: 438 MB 6.0 MB/s data_sent......................: 5.9 MB 81 kB/s http_req_blocked...............: avg=91.67µs min=1.49µs med=3.4µs max=40.3ms p(90)=102.3µs p(95)=279.65µs http_req_connecting............: avg=80.13µs min=0s med=0s max=40.21ms p(90)=60.02µs p(95)=206.97µs http_req_duration..............: avg=4.18s min=84.14ms med=2.22s max=45.25s p(90)=3.6s p(95)=23.92s { expected_response:true }...: avg=4.18s min=84.14ms med=2.22s max=45.25s p(90)=3.6s p(95)=23.92s http_req_failed................: 0.00% ✓ 0 ✗ 4987 http_req_receiving.............: avg=211.58µs min=45.7µs med=118.94µs max=112.34ms p(90)=181.03µs p(95)=215.49µs http_req_sending...............: avg=38.86µs min=8.29µs med=18.25µs max=16.97ms p(90)=39.81µs p(95)=57.63µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.18s min=84ms med=2.22s max=45.25s p(90)=3.6s p(95)=23.92s http_reqs......................: 4987 68.086802/s iteration_duration.............: avg=4.19s min=91.01ms med=2.24s max=45.27s p(90)=3.61s p(95)=23.93s iterations.....................: 4987 68.086802/s vus............................: 25 min=25 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview