search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update oven/bun Docker tag to v1.0.35 #417

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Type Update Change
oven/bun final patch 1.0.33 -> 1.0.35

Release Notes

oven-sh/bun (oven/bun) ### [`v1.0.35`](https://togithub.com/oven-sh/bun/compare/bun-v1.0.34...bun-v1.0.35) ### [`v1.0.34`](https://togithub.com/oven-sh/bun/releases/tag/bun-v1.0.34): Bun v1.0.34 To install Bun v1.0.34: ```bash curl https://bun.sh/install | bash ### or you can use npm ### npm install -g bun ``` To upgrade to Bun v1.0.34: ```bash bun upgrade ``` ##### **[Read Bun v1.0.34's release notes on Bun's blog](https://bun.sh/blog/bun-v1.0.34)** ##### Thank you to 6 contributors! - [@​hustLer2k](https://togithub.com/hustLer2k) - [@​Jarred-Sumner](https://togithub.com/Jarred-Sumner) - [@​dylan-conway](https://togithub.com/dylan-conway) - [@​eroblaze](https://togithub.com/eroblaze) - [@​gnuns](https://togithub.com/gnuns) - [@​nektro](https://togithub.com/nektro) **Full Changelog**: https://github.com/oven-sh/bun/compare/bun-v1.0.33...bun-v1.0.34

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 175 5341 total, 0 failed avg: 502ms, p95: 695ms ✅
cosmo 174 5309 total, 0 failed avg: 494ms, p95: 678ms ✅
wundergraph 159 4859 total, 0 failed avg: 517ms, p95: 972ms ✅
mesh-supergraph-bun 99 3081 total, 0 failed avg: 963ms, p95: 1656ms ✅
apollo-server 49 1549 total, 0 failed avg: 1973ms, p95: 3174ms ✅
mercurius 30 929 total, 0 failed avg: 3287ms, p95: 4438ms ✅
mesh-supergraph 30 958 total, 0 failed avg: 3191ms, p95: 5179ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16023 ✗ 0 data_received..................: 469 MB 15 MB/s data_sent......................: 6.3 MB 208 kB/s http_req_blocked...............: avg=50.17µs min=1.18µs med=2.71µs max=8.88ms p(90)=4.1µs p(95)=5µs http_req_connecting............: avg=45.56µs min=0s med=0s max=8.85ms p(90)=0s p(95)=0s http_req_duration..............: avg=502.25ms min=84.53ms med=498.64ms max=2.04s p(90)=629.26ms p(95)=694.8ms { expected_response:true }...: avg=502.25ms min=84.53ms med=498.64ms max=2.04s p(90)=629.26ms p(95)=694.8ms http_req_failed................: 0.00% ✓ 0 ✗ 5341 http_req_receiving.............: avg=25.84ms min=30.04µs med=68.07µs max=1.73s p(90)=49.95ms p(95)=109.21ms http_req_sending...............: avg=1.36ms min=7.81µs med=12.91µs max=991.15ms p(90)=31.63µs p(95)=160.21µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=475.04ms min=25.51ms med=486ms max=881.75ms p(90)=597.82ms p(95)=630.2ms http_reqs......................: 5341 175.359992/s iteration_duration.............: avg=566.81ms min=112.46ms med=542.14ms max=2.33s p(90)=734.91ms p(95)=851.94ms iterations.....................: 5341 175.359992/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15927 ✗ 0 data_received..................: 466 MB 15 MB/s data_sent......................: 6.3 MB 207 kB/s http_req_blocked...............: avg=53.93µs min=1.48µs med=2.81µs max=50.41ms p(90)=4.41µs p(95)=5.49µs http_req_connecting............: avg=33.43µs min=0s med=0s max=11.82ms p(90)=0s p(95)=0s http_req_duration..............: avg=494.23ms min=24.14ms med=493.2ms max=1.68s p(90)=604.56ms p(95)=677.87ms { expected_response:true }...: avg=494.23ms min=24.14ms med=493.2ms max=1.68s p(90)=604.56ms p(95)=677.87ms http_req_failed................: 0.00% ✓ 0 ✗ 5309 http_req_receiving.............: avg=30.99ms min=35.12µs med=76.99µs max=1.25s p(90)=81.42ms p(95)=210.48ms http_req_sending...............: avg=1.32ms min=8.15µs med=13.24µs max=370.46ms p(90)=34.49µs p(95)=177.16µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=461.91ms min=19.01ms med=479.52ms max=786.18ms p(90)=565.68ms p(95)=594.58ms http_reqs......................: 5309 174.227873/s iteration_duration.............: avg=570.81ms min=33.96ms med=535.01ms max=2.42s p(90)=768.83ms p(95)=950.22ms iterations.....................: 5309 174.227873/s vus............................: 99 min=99 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14577 ✗ 0 data_received..................: 426 MB 14 MB/s data_sent......................: 5.8 MB 189 kB/s http_req_blocked...............: avg=112.39µs min=1.33µs med=2.74µs max=101.41ms p(90)=4.32µs p(95)=5.43µs http_req_connecting............: avg=87.21µs min=0s med=0s max=73.37ms p(90)=0s p(95)=0s http_req_duration..............: avg=516.83ms min=12.13ms med=484.6ms max=2.19s p(90)=824.55ms p(95)=972.19ms { expected_response:true }...: avg=516.83ms min=12.13ms med=484.6ms max=2.19s p(90)=824.55ms p(95)=972.19ms http_req_failed................: 0.00% ✓ 0 ✗ 4859 http_req_receiving.............: avg=52.19ms min=33.93µs med=83.18µs max=1.25s p(90)=156.32ms p(95)=354.66ms http_req_sending...............: avg=3.38ms min=7.65µs med=13.4µs max=908.56ms p(90)=37.88µs p(95)=894.05µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=461.25ms min=12.05ms med=436.57ms max=1.28s p(90)=726.1ms p(95)=837.11ms http_reqs......................: 4859 159.516718/s iteration_duration.............: avg=623.02ms min=27.92ms med=568.1ms max=2.81s p(90)=1.01s p(95)=1.21s iterations.....................: 4859 159.516718/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9243 ✗ 0 data_received..................: 270 MB 8.8 MB/s data_sent......................: 3.7 MB 119 kB/s http_req_blocked...............: avg=99.21µs min=1.2µs med=2.7µs max=27.29ms p(90)=4.31µs p(95)=7.98µs http_req_connecting............: avg=82.63µs min=0s med=0s max=5.8ms p(90)=0s p(95)=0s http_req_duration..............: avg=962.56ms min=421.07ms med=831.32ms max=2.45s p(90)=1.52s p(95)=1.65s { expected_response:true }...: avg=962.56ms min=421.07ms med=831.32ms max=2.45s p(90)=1.52s p(95)=1.65s http_req_failed................: 0.00% ✓ 0 ✗ 3081 http_req_receiving.............: avg=9.67ms min=34.99µs med=82.43µs max=563.93ms p(90)=927.65µs p(95)=39.84ms http_req_sending...............: avg=711.04µs min=7.66µs med=13.23µs max=177.86ms p(90)=36.55µs p(95)=184.65µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=952.18ms min=420.63ms med=824.83ms max=2.45s p(90)=1.51s p(95)=1.64s http_reqs......................: 3081 99.988508/s iteration_duration.............: avg=992.15ms min=434.08ms med=856.94ms max=2.47s p(90)=1.54s p(95)=1.7s iterations.....................: 3081 99.988508/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4647 ✗ 0 data_received..................: 136 MB 4.3 MB/s data_sent......................: 1.8 MB 59 kB/s http_req_blocked...............: avg=58.36µs min=1.44µs med=3.3µs max=7.22ms p(90)=5.43µs p(95)=182.02µs http_req_connecting............: avg=42.13µs min=0s med=0s max=2.1ms p(90)=0s p(95)=140.05µs http_req_duration..............: avg=1.97s min=365ms med=1.62s max=21.12s p(90)=2.13s p(95)=3.17s { expected_response:true }...: avg=1.97s min=365ms med=1.62s max=21.12s p(90)=2.13s p(95)=3.17s http_req_failed................: 0.00% ✓ 0 ✗ 1549 http_req_receiving.............: avg=164.4µs min=47.2µs med=122.87µs max=23.42ms p(90)=181.44µs p(95)=206.95µs http_req_sending...............: avg=41.41µs min=8.16µs med=17.76µs max=3.2ms p(90)=33.35µs p(95)=79.29µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.97s min=364.86ms med=1.62s max=21.12s p(90)=2.13s p(95)=3.17s http_reqs......................: 1549 49.44878/s iteration_duration.............: avg=1.98s min=375.62ms med=1.63s max=21.13s p(90)=2.14s p(95)=3.18s iterations.....................: 1549 49.44878/s vus............................: 42 min=42 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2787 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=96µs min=1.65µs med=3.7µs max=7.64ms p(90)=107.79µs p(95)=664.63µs http_req_connecting............: avg=83.94µs min=0s med=0s max=7.61ms p(90)=72.86µs p(95)=558.45µs http_req_duration..............: avg=3.28s min=788.01ms med=3.08s max=7.44s p(90)=4.12s p(95)=4.43s { expected_response:true }...: avg=3.28s min=788.01ms med=3.08s max=7.44s p(90)=4.12s p(95)=4.43s http_req_failed................: 0.00% ✓ 0 ✗ 929 http_req_receiving.............: avg=472.7µs min=43.1µs med=116.25µs max=69.9ms p(90)=175.25µs p(95)=224.01µs http_req_sending...............: avg=60.14µs min=8.91µs med=19.84µs max=1.06ms p(90)=46.05µs p(95)=489.85µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.28s min=787.09ms med=3.08s max=7.44s p(90)=4.12s p(95)=4.43s http_reqs......................: 929 30.061391/s iteration_duration.............: avg=3.29s min=796.72ms med=3.09s max=7.45s p(90)=4.14s p(95)=4.44s iterations.....................: 929 30.061391/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2874 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=132.09µs min=1.42µs med=3.21µs max=4.04ms p(90)=103.78µs p(95)=879.64µs http_req_connecting............: avg=110.81µs min=0s med=0s max=3.76ms p(90)=74.77µs p(95)=786.01µs http_req_duration..............: avg=3.19s min=781.87ms med=3s max=6.86s p(90)=4.55s p(95)=5.17s { expected_response:true }...: avg=3.19s min=781.87ms med=3s max=6.86s p(90)=4.55s p(95)=5.17s http_req_failed................: 0.00% ✓ 0 ✗ 958 http_req_receiving.............: avg=3.09ms min=43.17µs med=134.4µs max=186.81ms p(90)=1.89ms p(95)=9.8ms http_req_sending...............: avg=96.36µs min=8.21µs med=17.39µs max=13.27ms p(90)=81.3µs p(95)=497.77µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.18s min=780.62ms med=3s max=6.86s p(90)=4.52s p(95)=5.17s http_reqs......................: 958 30.533058/s iteration_duration.............: avg=3.2s min=804.49ms med=3.01s max=6.87s p(90)=4.56s p(95)=5.18s iterations.....................: 958 30.533058/s vus............................: 29 min=29 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 163 4992 total, 0 failed avg: 541ms, p95: 731ms ✅
wundergraph 103 3188 total, 0 failed avg: 917ms, p95: 1151ms ✅
mesh-supergraph-bun 101 3114 total, 0 failed avg: 943ms, p95: 1330ms ✅
cosmo 82 2554 total, 0 failed avg: 1159ms, p95: 1410ms ✅
mesh-supergraph 64 1985 total, 0 failed avg: 1514ms, p95: 2088ms ✅
apollo-server 63 1985 total, 0 failed avg: 1535ms, p95: 1862ms ✅
mercurius 12 477 total, 0 failed avg: 7074ms, p95: 8339ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14976 ✗ 0 data_received..................: 438 MB 14 MB/s data_sent......................: 5.9 MB 194 kB/s http_req_blocked...............: avg=81.53µs min=1.62µs med=3.01µs max=55.58ms p(90)=4.62µs p(95)=5.8µs http_req_connecting............: avg=51.15µs min=0s med=0s max=6.22ms p(90)=0s p(95)=0s http_req_duration..............: avg=541.42ms min=263.97ms med=530.91ms max=1.3s p(90)=671.14ms p(95)=730.67ms { expected_response:true }...: avg=541.42ms min=263.97ms med=530.91ms max=1.3s p(90)=671.14ms p(95)=730.67ms http_req_failed................: 0.00% ✓ 0 ✗ 4992 http_req_receiving.............: avg=17.03ms min=38.75µs med=76.05µs max=504.22ms p(90)=60.2ms p(95)=113.06ms http_req_sending...............: avg=1.7ms min=8.83µs med=14.49µs max=355.48ms p(90)=52.54µs p(95)=296.6µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=522.67ms min=263.8ms med=518.12ms max=953.12ms p(90)=638.05ms p(95)=679.61ms http_reqs......................: 4992 163.033811/s iteration_duration.............: avg=609.19ms min=286.97ms med=586.92ms max=1.58s p(90)=790.99ms p(95)=877.15ms iterations.....................: 4992 163.033811/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9564 ✗ 0 data_received..................: 280 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=82.18µs min=1.21µs med=2.67µs max=7ms p(90)=4.21µs p(95)=6.7µs http_req_connecting............: avg=74.42µs min=0s med=0s max=4.53ms p(90)=0s p(95)=0s http_req_duration..............: avg=917.31ms min=567.62ms med=903.97ms max=1.47s p(90)=1.07s p(95)=1.15s { expected_response:true }...: avg=917.31ms min=567.62ms med=903.97ms max=1.47s p(90)=1.07s p(95)=1.15s http_req_failed................: 0.00% ✓ 0 ✗ 3188 http_req_receiving.............: avg=10.94ms min=35.88µs med=82.85µs max=376.21ms p(90)=38.06ms p(95)=82.99ms http_req_sending...............: avg=1.24ms min=7.72µs med=13.1µs max=156.95ms p(90)=51.27µs p(95)=281.87µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=905.12ms min=567.41ms med=895.3ms max=1.42s p(90)=1.05s p(95)=1.1s http_reqs......................: 3188 103.46241/s iteration_duration.............: avg=954.37ms min=605.4ms med=939.75ms max=1.5s p(90)=1.12s p(95)=1.19s iterations.....................: 3188 103.46241/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9342 ✗ 0 data_received..................: 273 MB 8.9 MB/s data_sent......................: 3.7 MB 120 kB/s http_req_blocked...............: avg=46.86µs min=1.43µs med=2.98µs max=21.7ms p(90)=4.71µs p(95)=10.16µs http_req_connecting............: avg=26.45µs min=0s med=0s max=2.82ms p(90)=0s p(95)=0s http_req_duration..............: avg=943.2ms min=359.64ms med=922.06ms max=2.28s p(90)=1.22s p(95)=1.33s { expected_response:true }...: avg=943.2ms min=359.64ms med=922.06ms max=2.28s p(90)=1.22s p(95)=1.33s http_req_failed................: 0.00% ✓ 0 ✗ 3114 http_req_receiving.............: avg=13.83ms min=39.42µs med=89.31µs max=655.66ms p(90)=3.84ms p(95)=68.86ms http_req_sending...............: avg=680.31µs min=8.2µs med=14.78µs max=281.69ms p(90)=40.39µs p(95)=211.62µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=928.68ms min=359.53ms med=910.75ms max=2.28s p(90)=1.2s p(95)=1.28s http_reqs......................: 3114 101.241293/s iteration_duration.............: avg=979.48ms min=370.87ms med=954.69ms max=2.32s p(90)=1.28s p(95)=1.39s iterations.....................: 3114 101.241293/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7662 ✗ 0 data_received..................: 224 MB 7.2 MB/s data_sent......................: 3.0 MB 98 kB/s http_req_blocked...............: avg=127.89µs min=1.15µs med=2.5µs max=9.71ms p(90)=3.76µs p(95)=9.26µs http_req_connecting............: avg=116.57µs min=0s med=0s max=9.63ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=737.06ms med=1.14s max=1.74s p(90)=1.35s p(95)=1.4s { expected_response:true }...: avg=1.15s min=737.06ms med=1.14s max=1.74s p(90)=1.35s p(95)=1.4s http_req_failed................: 0.00% ✓ 0 ✗ 2554 http_req_receiving.............: avg=8.89ms min=36.01µs med=78.53µs max=375.29ms p(90)=21.32ms p(95)=65.3ms http_req_sending...............: avg=1.32ms min=7.77µs med=12.76µs max=208.1ms p(90)=41.26µs p(95)=1.25ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=736.87ms med=1.13s max=1.6s p(90)=1.33s p(95)=1.39s http_reqs......................: 2554 82.512814/s iteration_duration.............: avg=1.19s min=748.08ms med=1.17s max=1.76s p(90)=1.38s p(95)=1.44s iterations.....................: 2554 82.512814/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5955 ✗ 0 data_received..................: 174 MB 5.6 MB/s data_sent......................: 2.4 MB 76 kB/s http_req_blocked...............: avg=118.82µs min=1.55µs med=3.76µs max=5.75ms p(90)=5.57µs p(95)=96.5µs http_req_connecting............: avg=97.84µs min=0s med=0s max=5.3ms p(90)=0s p(95)=43.31µs http_req_duration..............: avg=1.51s min=613.67ms med=1.47s max=3.21s p(90)=1.86s p(95)=2.08s { expected_response:true }...: avg=1.51s min=613.67ms med=1.47s max=3.21s p(90)=1.86s p(95)=2.08s http_req_failed................: 0.00% ✓ 0 ✗ 1985 http_req_receiving.............: avg=1.45ms min=41.43µs med=111.99µs max=86.44ms p(90)=1.74ms p(95)=7.75ms http_req_sending...............: avg=118.32µs min=7.52µs med=20.39µs max=29.33ms p(90)=40.3µs p(95)=135.33µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.51s min=613.54ms med=1.46s max=3.21s p(90)=1.86s p(95)=2.08s http_reqs......................: 1985 64.313786/s iteration_duration.............: avg=1.53s min=631.72ms med=1.49s max=3.22s p(90)=1.89s p(95)=2.1s iterations.....................: 1985 64.313786/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5955 ✗ 0 data_received..................: 175 MB 5.6 MB/s data_sent......................: 2.4 MB 76 kB/s http_req_blocked...............: avg=129.95µs min=1.49µs med=3.38µs max=5.3ms p(90)=5.16µs p(95)=199.97µs http_req_connecting............: avg=123.96µs min=0s med=0s max=5.21ms p(90)=0s p(95)=110.65µs http_req_duration..............: avg=1.53s min=756.89ms med=1.46s max=9.54s p(90)=1.71s p(95)=1.86s { expected_response:true }...: avg=1.53s min=756.89ms med=1.46s max=9.54s p(90)=1.71s p(95)=1.86s http_req_failed................: 0.00% ✓ 0 ✗ 1985 http_req_receiving.............: avg=158.23µs min=50.68µs med=115.13µs max=9.61ms p(90)=178.42µs p(95)=221.92µs http_req_sending...............: avg=38.93µs min=9.09µs med=18.3µs max=5.4ms p(90)=35.04µs p(95)=81.59µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.53s min=756.73ms med=1.46s max=9.54s p(90)=1.71s p(95)=1.86s http_reqs......................: 1985 63.786115/s iteration_duration.............: avg=1.54s min=771.67ms med=1.47s max=9.56s p(90)=1.73s p(95)=1.87s iterations.....................: 1985 63.786115/s vus............................: 24 min=24 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1431 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 566 kB 15 kB/s http_req_blocked...............: avg=202.78µs min=1.61µs med=3.22µs max=7.49ms p(90)=403.23µs p(95)=1.33ms http_req_connecting............: avg=158.67µs min=0s med=0s max=7.43ms p(90)=339.04µs p(95)=1.11ms http_req_duration..............: avg=7.07s min=3.16s med=7.4s max=8.68s p(90)=8.12s p(95)=8.33s { expected_response:true }...: avg=7.07s min=3.16s med=7.4s max=8.68s p(90)=8.12s p(95)=8.33s http_req_failed................: 0.00% ✓ 0 ✗ 477 http_req_receiving.............: avg=137.25µs min=59.01µs med=114.69µs max=4.04ms p(90)=175.69µs p(95)=204.3µs http_req_sending...............: avg=69.9µs min=8.86µs med=19.27µs max=752.81µs p(90)=176.4µs p(95)=531.69µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.07s min=3.16s med=7.39s max=8.68s p(90)=8.12s p(95)=8.33s http_reqs......................: 477 12.792811/s iteration_duration.............: avg=7.08s min=3.17s med=7.4s max=8.69s p(90)=8.13s p(95)=8.34s iterations.....................: 477 12.792811/s vus............................: 8 min=8 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 153 4689 total, 0 failed avg: 599ms, p95: 780ms ✅
wundergraph 103 3179 total, 0 failed avg: 922ms, p95: 1128ms ✅
mesh-supergraph-bun 84 2587 total, 0 failed avg: 1145ms, p95: 1666ms ✅
cosmo 78 2451 total, 0 failed avg: 1208ms, p95: 1441ms ✅
apollo-server 47 1492 total, 0 failed avg: 2037ms, p95: 2339ms ✅
mesh-supergraph 30 975 total, 0 failed avg: 3166ms, p95: 5086ms ✅
mercurius 11 443 total, 0 failed avg: 7698ms, p95: 9257ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14067 ✗ 0 data_received..................: 411 MB 14 MB/s data_sent......................: 5.6 MB 182 kB/s http_req_blocked...............: avg=94.23µs min=1.27µs med=2.83µs max=120.5ms p(90)=4.34µs p(95)=5.6µs http_req_connecting............: avg=50.26µs min=0s med=0s max=5.05ms p(90)=0s p(95)=0s http_req_duration..............: avg=599.37ms min=306.57ms med=592.47ms max=1.05s p(90)=724.02ms p(95)=779.55ms { expected_response:true }...: avg=599.37ms min=306.57ms med=592.47ms max=1.05s p(90)=724.02ms p(95)=779.55ms http_req_failed................: 0.00% ✓ 0 ✗ 4689 http_req_receiving.............: avg=8.69ms min=35.81µs med=68.1µs max=314.47ms p(90)=20.03ms p(95)=68.97ms http_req_sending...............: avg=959µs min=8.05µs med=13.66µs max=269.55ms p(90)=32.47µs p(95)=172.99µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=589.72ms min=306.47ms med=585.06ms max=1s p(90)=710.2ms p(95)=752.12ms http_reqs......................: 4689 153.483987/s iteration_duration.............: avg=647.55ms min=315.73ms med=637.81ms max=1.2s p(90)=796.94ms p(95)=870.17ms iterations.....................: 4689 153.483987/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9537 ✗ 0 data_received..................: 279 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=40.88µs min=1.18µs med=2.48µs max=75.2ms p(90)=3.68µs p(95)=7.65µs http_req_connecting............: avg=9.7µs min=0s med=0s max=8.31ms p(90)=0s p(95)=0s http_req_duration..............: avg=921.91ms min=592.5ms med=910.33ms max=1.43s p(90)=1.06s p(95)=1.12s { expected_response:true }...: avg=921.91ms min=592.5ms med=910.33ms max=1.43s p(90)=1.06s p(95)=1.12s http_req_failed................: 0.00% ✓ 0 ✗ 3179 http_req_receiving.............: avg=8.14ms min=37.9µs med=79.09µs max=217.46ms p(90)=25.18ms p(95)=64.17ms http_req_sending...............: avg=1.24ms min=7.33µs med=12.68µs max=152.58ms p(90)=27.94µs p(95)=134.06µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=912.52ms min=587.88ms med=902.63ms max=1.38s p(90)=1.05s p(95)=1.1s http_reqs......................: 3179 103.577958/s iteration_duration.............: avg=956.21ms min=610.06ms med=948.95ms max=1.46s p(90)=1.11s p(95)=1.17s iterations.....................: 3179 103.577958/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7761 ✗ 0 data_received..................: 227 MB 7.4 MB/s data_sent......................: 3.1 MB 100 kB/s http_req_blocked...............: avg=119.89µs min=1.27µs med=2.76µs max=19.66ms p(90)=4.36µs p(95)=9.77µs http_req_connecting............: avg=102.46µs min=0s med=0s max=6.12ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=575.14ms med=1.1s max=2.43s p(90)=1.51s p(95)=1.66s { expected_response:true }...: avg=1.14s min=575.14ms med=1.1s max=2.43s p(90)=1.51s p(95)=1.66s http_req_failed................: 0.00% ✓ 0 ✗ 2587 http_req_receiving.............: avg=15.13ms min=38.03µs med=81.78µs max=654.23ms p(90)=977.22µs p(95)=40.69ms http_req_sending...............: avg=525.09µs min=7.92µs med=13.6µs max=108.41ms p(90)=46.93µs p(95)=313.83µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.12s min=575.04ms med=1.09s max=2.43s p(90)=1.46s p(95)=1.62s http_reqs......................: 2587 84.021708/s iteration_duration.............: avg=1.17s min=585.48ms med=1.13s max=2.58s p(90)=1.54s p(95)=1.7s iterations.....................: 2587 84.021708/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7353 ✗ 0 data_received..................: 215 MB 6.9 MB/s data_sent......................: 2.9 MB 93 kB/s http_req_blocked...............: avg=29.01µs min=1.26µs med=2.59µs max=4.52ms p(90)=4.1µs p(95)=9.35µs http_req_connecting............: avg=23.64µs min=0s med=0s max=4.5ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.2s min=729.61ms med=1.2s max=1.66s p(90)=1.38s p(95)=1.44s { expected_response:true }...: avg=1.2s min=729.61ms med=1.2s max=1.66s p(90)=1.38s p(95)=1.44s http_req_failed................: 0.00% ✓ 0 ✗ 2451 http_req_receiving.............: avg=14.24ms min=39.48µs med=85.55µs max=300.6ms p(90)=49.07ms p(95)=100.09ms http_req_sending...............: avg=1.39ms min=8.01µs med=12.78µs max=228.63ms p(90)=68.22µs p(95)=520.13µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.19s min=729.55ms med=1.19s max=1.61s p(90)=1.35s p(95)=1.4s http_reqs......................: 2451 78.541338/s iteration_duration.............: avg=1.24s min=740.3ms med=1.24s max=1.69s p(90)=1.44s p(95)=1.49s iterations.....................: 2451 78.541338/s vus............................: 25 min=25 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4476 ✗ 0 data_received..................: 131 MB 4.2 MB/s data_sent......................: 1.8 MB 57 kB/s http_req_blocked...............: avg=102.63µs min=1.57µs med=3.09µs max=4.89ms p(90)=5.31µs p(95)=244.34µs http_req_connecting............: avg=96.04µs min=0s med=0s max=4.77ms p(90)=0s p(95)=157.13µs http_req_duration..............: avg=2.03s min=994.24ms med=1.83s max=13.58s p(90)=2.2s p(95)=2.33s { expected_response:true }...: avg=2.03s min=994.24ms med=1.83s max=13.58s p(90)=2.2s p(95)=2.33s http_req_failed................: 0.00% ✓ 0 ✗ 1492 http_req_receiving.............: avg=304µs min=45.06µs med=112.43µs max=64.2ms p(90)=181.55µs p(95)=238.78µs http_req_sending...............: avg=78.52µs min=8.57µs med=16.15µs max=26.05ms p(90)=32.26µs p(95)=201.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.03s min=994.15ms med=1.83s max=13.58s p(90)=2.2s p(95)=2.33s http_reqs......................: 1492 47.960105/s iteration_duration.............: avg=2.05s min=1s med=1.85s max=13.59s p(90)=2.22s p(95)=2.34s iterations.....................: 1492 47.960105/s vus............................: 5 min=5 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2925 ✗ 0 data_received..................: 86 MB 2.7 MB/s data_sent......................: 1.2 MB 36 kB/s http_req_blocked...............: avg=105.65µs min=1.47µs med=3.15µs max=6.72ms p(90)=109.37µs p(95)=471.19µs http_req_connecting............: avg=72.66µs min=0s med=0s max=2.99ms p(90)=76.46µs p(95)=366.43µs http_req_duration..............: avg=3.16s min=1.07s med=2.99s max=5.99s p(90)=4.16s p(95)=5.08s { expected_response:true }...: avg=3.16s min=1.07s med=2.99s max=5.99s p(90)=4.16s p(95)=5.08s http_req_failed................: 0.00% ✓ 0 ✗ 975 http_req_receiving.............: avg=3.41ms min=38.39µs med=132.29µs max=279.36ms p(90)=2.33ms p(95)=12.92ms http_req_sending...............: avg=77.59µs min=8.01µs med=17.07µs max=20.53ms p(90)=74.17µs p(95)=184.18µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.16s min=1.07s med=2.99s max=5.99s p(90)=4.16s p(95)=5.08s http_reqs......................: 975 30.702217/s iteration_duration.............: avg=3.18s min=1.08s med=3.01s max=6.01s p(90)=4.17s p(95)=5.1s iterations.....................: 975 30.702217/s vus............................: 54 min=54 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1329 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 526 kB 14 kB/s http_req_blocked...............: avg=344.28µs min=1.6µs med=3.95µs max=11.34ms p(90)=1.37ms p(95)=2.15ms http_req_connecting............: avg=289.41µs min=0s med=0s max=8.19ms p(90)=1.15ms p(95)=1.93ms http_req_duration..............: avg=7.69s min=3.58s med=7.93s max=9.83s p(90)=8.94s p(95)=9.25s { expected_response:true }...: avg=7.69s min=3.58s med=7.93s max=9.83s p(90)=8.94s p(95)=9.25s http_req_failed................: 0.00% ✓ 0 ✗ 443 http_req_receiving.............: avg=160.84µs min=64.33µs med=123.33µs max=5.31ms p(90)=183.84µs p(95)=213.83µs http_req_sending...............: avg=382.65µs min=10.15µs med=23.14µs max=14.51ms p(90)=678.41µs p(95)=1.46ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.69s min=3.58s med=7.92s max=9.83s p(90)=8.94s p(95)=9.25s http_reqs......................: 443 11.773244/s iteration_duration.............: avg=7.7s min=3.59s med=7.93s max=9.83s p(90)=8.95s p(95)=9.26s iterations.....................: 443 11.773244/s vus............................: 14 min=14 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2139ms 174 12222 total, 0 failed avg: 832ms, p95: 2140ms, max: 6827ms, med: 660ms ❌ 1 unexpected GraphQL errors, non-compatible response structure (1)
apollo-router 2412ms 173 12134 total, 0 failed avg: 829ms, p95: 2412ms, max: 5974ms, med: 609ms ✅
wundergraph 2442ms 167 11711 total, 0 failed avg: 855ms, p95: 2443ms, max: 6227ms, med: 599ms ✅
mesh-supergraph-bun 5253ms 118 8279 total, 0 failed avg: 2208ms, p95: 5253ms, max: 9201ms, med: 1976ms ✅
mesh-supergraph 6453ms 69 4870 total, 0 failed avg: 3907ms, p95: 6454ms, max: 8334ms, med: 4144ms ✅
apollo-server 23869ms 68 4993 total, 0 failed avg: 4185ms, p95: 23870ms, max: 45149ms, med: 2236ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12221 / ✗ 1 ✗ valid response structure ↳ 99% — ✓ 12221 / ✗ 1 checks.........................: 99.99% ✓ 36664 ✗ 2 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 207 kB/s http_req_blocked...............: avg=20.57ms min=1.33µs med=2.83µs max=3.83s p(90)=4.34µs p(95)=11.28µs http_req_connecting............: avg=19.55ms min=0s med=0s max=3.83s p(90)=0s p(95)=0s http_req_duration..............: avg=832.34ms min=6.56ms med=660.19ms max=6.82s p(90)=1.68s p(95)=2.13s { expected_response:true }...: avg=832.34ms min=6.56ms med=660.19ms max=6.82s p(90)=1.68s p(95)=2.13s http_req_failed................: 0.00% ✓ 0 ✗ 12222 http_req_receiving.............: avg=244.91ms min=27.05µs med=77.61µs max=5.52s p(90)=906.49ms p(95)=1.31s http_req_sending...............: avg=36.03ms min=7.58µs med=13.31µs max=4.21s p(90)=281.45µs p(95)=127.77ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=551.39ms min=6.47ms med=422.51ms max=3s p(90)=1.18s p(95)=1.43s http_reqs......................: 12222 174.589348/s iteration_duration.............: avg=1.49s min=12.01ms med=1.11s max=9.23s p(90)=3.32s p(95)=4.19s iterations.....................: 12222 174.589348/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36402 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 206 kB/s http_req_blocked...............: avg=17ms min=1.68µs med=3.37µs max=4.56s p(90)=5.64µs p(95)=13.57µs http_req_connecting............: avg=15.8ms min=0s med=0s max=3.14s p(90)=0s p(95)=0s http_req_duration..............: avg=828.73ms min=6.45ms med=608.5ms max=5.97s p(90)=1.81s p(95)=2.41s { expected_response:true }...: avg=828.73ms min=6.45ms med=608.5ms max=5.97s p(90)=1.81s p(95)=2.41s http_req_failed................: 0.00% ✓ 0 ✗ 12134 http_req_receiving.............: avg=265.59ms min=31.11µs med=83.65µs max=4.56s p(90)=1.08s p(95)=1.53s http_req_sending...............: avg=31.08ms min=8.47µs med=16.2µs max=3.31s p(90)=165.83µs p(95)=70.95ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=532.04ms min=6.37ms med=447.77ms max=3.27s p(90)=1.03s p(95)=1.26s http_reqs......................: 12134 173.33694/s iteration_duration.............: avg=1.51s min=12.2ms med=1.04s max=11.07s p(90)=3.47s p(95)=4.28s iterations.....................: 12134 173.33694/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35133 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 199 kB/s http_req_blocked...............: avg=21.01ms min=1.52µs med=2.91µs max=3.17s p(90)=4.51µs p(95)=20.66µs http_req_connecting............: avg=20.23ms min=0s med=0s max=3.17s p(90)=0s p(95)=0s http_req_duration..............: avg=855.49ms min=6.32ms med=598.57ms max=6.22s p(90)=1.9s p(95)=2.44s { expected_response:true }...: avg=855.49ms min=6.32ms med=598.57ms max=6.22s p(90)=1.9s p(95)=2.44s http_req_failed................: 0.00% ✓ 0 ✗ 11711 http_req_receiving.............: avg=307.65ms min=32.95µs med=77.37µs max=5.15s p(90)=1.16s p(95)=1.81s http_req_sending...............: avg=32.7ms min=7.58µs med=13.78µs max=4.04s p(90)=165.67µs p(95)=63.62ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=515.13ms min=6.22ms med=376.87ms max=2.88s p(90)=1.12s p(95)=1.36s http_reqs......................: 11711 167.280372/s iteration_duration.............: avg=1.58s min=12.19ms med=1.1s max=12.59s p(90)=3.72s p(95)=4.77s iterations.....................: 11711 167.280372/s vus............................: 1 min=1 max=496 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24837 ✗ 0 data_received..................: 726 MB 10 MB/s data_sent......................: 9.8 MB 140 kB/s http_req_blocked...............: avg=1.83ms min=1.24µs med=2.8µs max=338.29ms p(90)=4.68µs p(95)=211.17µs http_req_connecting............: avg=1.76ms min=0s med=0s max=338.24ms p(90)=0s p(95)=142.04µs http_req_duration..............: avg=2.2s min=5.21ms med=1.97s max=9.2s p(90)=4.39s p(95)=5.25s { expected_response:true }...: avg=2.2s min=5.21ms med=1.97s max=9.2s p(90)=4.39s p(95)=5.25s http_req_failed................: 0.00% ✓ 0 ✗ 8279 http_req_receiving.............: avg=28.54ms min=37.24µs med=76.47µs max=1.53s p(90)=26.16ms p(95)=202.28ms http_req_sending...............: avg=2.97ms min=7.83µs med=13.49µs max=729.23ms p(90)=81.29µs p(95)=9.75ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.17s min=5.09ms med=1.96s max=9.18s p(90)=4.35s p(95)=5.23s http_reqs......................: 8279 118.23139/s iteration_duration.............: avg=2.27s min=13.95ms med=2.03s max=9.33s p(90)=4.42s p(95)=5.34s iterations.....................: 8279 118.23139/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14610 ✗ 0 data_received..................: 427 MB 6.1 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=701.58µs min=1.37µs med=3.7µs max=224.34ms p(90)=169.67µs p(95)=444.7µs http_req_connecting............: avg=689.07µs min=0s med=0s max=224.27ms p(90)=114.34µs p(95)=380.49µs http_req_duration..............: avg=3.9s min=9.84ms med=4.14s max=8.33s p(90)=5.95s p(95)=6.45s { expected_response:true }...: avg=3.9s min=9.84ms med=4.14s max=8.33s p(90)=5.95s p(95)=6.45s http_req_failed................: 0.00% ✓ 0 ✗ 4870 http_req_receiving.............: avg=3.44ms min=39.82µs med=100.17µs max=411.93ms p(90)=1.22ms p(95)=9.13ms http_req_sending...............: avg=639.41µs min=7.89µs med=19.66µs max=250.6ms p(90)=51.88µs p(95)=107.33µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.9s min=9.77ms med=4.14s max=8.3s p(90)=5.94s p(95)=6.43s http_reqs......................: 4870 69.563984/s iteration_duration.............: avg=3.94s min=15.28ms med=4.18s max=8.34s p(90)=6.05s p(95)=6.51s iterations.....................: 4870 69.563984/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14979 ✗ 0 data_received..................: 439 MB 6.0 MB/s data_sent......................: 5.9 MB 81 kB/s http_req_blocked...............: avg=72.05µs min=1.4µs med=3.45µs max=26.2ms p(90)=98.11µs p(95)=262.7µs http_req_connecting............: avg=61.56µs min=0s med=0s max=26.1ms p(90)=47.77µs p(95)=188.41µs http_req_duration..............: avg=4.18s min=75.58ms med=2.23s max=45.14s p(90)=3.41s p(95)=23.86s { expected_response:true }...: avg=4.18s min=75.58ms med=2.23s max=45.14s p(90)=3.41s p(95)=23.86s http_req_failed................: 0.00% ✓ 0 ✗ 4993 http_req_receiving.............: avg=325.3µs min=47.62µs med=120.04µs max=307.35ms p(90)=181.73µs p(95)=221.15µs http_req_sending...............: avg=60.53µs min=8.67µs med=17.46µs max=21.59ms p(90)=41.15µs p(95)=61.33µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.18s min=75.49ms med=2.23s max=45.14s p(90)=3.41s p(95)=23.86s http_reqs......................: 4993 68.094796/s iteration_duration.............: avg=4.19s min=84.06ms med=2.24s max=45.17s p(90)=3.42s p(95)=23.87s iterations.....................: 4993 68.094796/s vus............................: 29 min=29 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview