search

the-guild-org / gateways-benchmark

MIT License
40 stars 7 forks source link

Update dependency @apollo/server to v4.10.2 #423

Closed renovate[bot] closed 4 months ago

renovate[bot] commented 4 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@apollo/server (source) 4.10.1 -> 4.10.2 age adoption passing confidence

Release Notes

apollographql/apollo-server (@​apollo/server) ### [`v4.10.2`](https://togithub.com/apollographql/apollo-server/blob/HEAD/packages/server/CHANGELOG.md#4102) [Compare Source](https://togithub.com/apollographql/apollo-server/compare/@apollo/server@4.10.1...@apollo/server@4.10.2) ##### Patch Changes - [#​7849](https://togithub.com/apollographql/apollo-server/pull/7849) [`c7e514c`](https://togithub.com/apollographql/apollo-server/commit/c7e514cf67b05521c66d0561448b3c36b2facee6) Thanks [@​TylerBloom](https://togithub.com/TylerBloom)! - In the subscription callback server plugin, terminating a subscription now immediately closes the internal async generator. This avoids that generator existing after termination and until the next message is received.

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 147 4513 total, 0 failed avg: 618ms, p95: 795ms ✅
wundergraph 101 3138 total, 0 failed avg: 940ms, p95: 1189ms ✅
mesh-supergraph-bun 88 2732 total, 0 failed avg: 1082ms, p95: 1617ms ✅
cosmo 78 2443 total, 0 failed avg: 1222ms, p95: 1465ms ✅
apollo-server 48 1524 total, 0 failed avg: 2003ms, p95: 2393ms ✅
mesh-supergraph 29 933 total, 0 failed avg: 3317ms, p95: 5173ms ✅
mercurius 12 455 total, 0 failed avg: 7535ms, p95: 9038ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13539 ✗ 0 data_received..................: 396 MB 13 MB/s data_sent......................: 5.4 MB 176 kB/s http_req_blocked...............: avg=53.73µs min=1.36µs med=2.77µs max=89.26ms p(90)=4.17µs p(95)=5.34µs http_req_connecting............: avg=28.33µs min=0s med=0s max=5.03ms p(90)=0s p(95)=0s http_req_duration..............: avg=618.28ms min=264.68ms med=611.27ms max=1.2s p(90)=749.09ms p(95)=795.45ms { expected_response:true }...: avg=618.28ms min=264.68ms med=611.27ms max=1.2s p(90)=749.09ms p(95)=795.45ms http_req_failed................: 0.00% ✓ 0 ✗ 4513 http_req_receiving.............: avg=8.59ms min=35.12µs med=68.98µs max=279.4ms p(90)=26.93ms p(95)=65.77ms http_req_sending...............: avg=1.02ms min=7.43µs med=13.09µs max=287.81ms p(90)=33.93µs p(95)=272.31µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=608.65ms min=264.56ms med=603.51ms max=1.19s p(90)=737.32ms p(95)=781.53ms http_reqs......................: 4513 147.942404/s iteration_duration.............: avg=670.11ms min=275.02ms med=652.87ms max=1.38s p(90)=838.33ms p(95)=905.99ms iterations.....................: 4513 147.942404/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9414 ✗ 0 data_received..................: 275 MB 8.9 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=56.09µs min=1.39µs med=2.91µs max=10.41ms p(90)=4.72µs p(95)=9.21µs http_req_connecting............: avg=48.23µs min=0s med=0s max=10.37ms p(90)=0s p(95)=0s http_req_duration..............: avg=939.75ms min=597.76ms med=924.6ms max=1.62s p(90)=1.09s p(95)=1.18s { expected_response:true }...: avg=939.75ms min=597.76ms med=924.6ms max=1.62s p(90)=1.09s p(95)=1.18s http_req_failed................: 0.00% ✓ 0 ✗ 3138 http_req_receiving.............: avg=10.64ms min=40.17µs med=90.43µs max=282.74ms p(90)=38.18ms p(95)=74.49ms http_req_sending...............: avg=922.49µs min=8.16µs med=13.4µs max=201.61ms p(90)=43.4µs p(95)=392.31µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=928.18ms min=597.6ms med=915.84ms max=1.5s p(90)=1.07s p(95)=1.15s http_reqs......................: 3138 101.481121/s iteration_duration.............: avg=978.1ms min=632.02ms med=963.65ms max=1.64s p(90)=1.14s p(95)=1.24s iterations.....................: 3138 101.481121/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8196 ✗ 0 data_received..................: 240 MB 7.8 MB/s data_sent......................: 3.2 MB 106 kB/s http_req_blocked...............: avg=47.19µs min=1.35µs med=2.71µs max=4.21ms p(90)=4.31µs p(95)=8.77µs http_req_connecting............: avg=42µs min=0s med=0s max=4.18ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.08s min=512.99ms med=1.04s max=2.4s p(90)=1.44s p(95)=1.61s { expected_response:true }...: avg=1.08s min=512.99ms med=1.04s max=2.4s p(90)=1.44s p(95)=1.61s http_req_failed................: 0.00% ✓ 0 ✗ 2732 http_req_receiving.............: avg=13.56ms min=37.16µs med=80.62µs max=524.8ms p(90)=1.35ms p(95)=42.97ms http_req_sending...............: avg=553.25µs min=7.31µs med=13.37µs max=91.26ms p(90)=43.06µs p(95)=349.01µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.06s min=494.05ms med=1.02s max=2.4s p(90)=1.41s p(95)=1.6s http_reqs......................: 2732 88.957529/s iteration_duration.............: avg=1.1s min=519.89ms med=1.06s max=2.46s p(90)=1.47s p(95)=1.65s iterations.....................: 2732 88.957529/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7329 ✗ 0 data_received..................: 214 MB 6.9 MB/s data_sent......................: 2.9 MB 93 kB/s http_req_blocked...............: avg=45.55µs min=1.24µs med=2.7µs max=4.91ms p(90)=4.28µs p(95)=9.57µs http_req_connecting............: avg=38.84µs min=0s med=0s max=3.64ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.22s min=771.94ms med=1.21s max=1.8s p(90)=1.39s p(95)=1.46s { expected_response:true }...: avg=1.22s min=771.94ms med=1.21s max=1.8s p(90)=1.39s p(95)=1.46s http_req_failed................: 0.00% ✓ 0 ✗ 2443 http_req_receiving.............: avg=8.94ms min=37.53µs med=75.57µs max=299.65ms p(90)=21.15ms p(95)=65.92ms http_req_sending...............: avg=1.79ms min=7.27µs med=13.09µs max=186.4ms p(90)=79.44µs p(95)=779.11µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.21s min=769.65ms med=1.2s max=1.64s p(90)=1.37s p(95)=1.44s http_reqs......................: 2443 78.400759/s iteration_duration.............: avg=1.26s min=782.66ms med=1.24s max=1.82s p(90)=1.43s p(95)=1.51s iterations.....................: 2443 78.400759/s vus............................: 52 min=52 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4572 ✗ 0 data_received..................: 134 MB 4.3 MB/s data_sent......................: 1.8 MB 58 kB/s http_req_blocked...............: avg=75.09µs min=1.65µs med=3.39µs max=8.41ms p(90)=5.68µs p(95)=166.38µs http_req_connecting............: avg=54.29µs min=0s med=0s max=7.62ms p(90)=0s p(95)=106.75µs http_req_duration..............: avg=2s min=989.64ms med=1.78s max=13.71s p(90)=2.16s p(95)=2.39s { expected_response:true }...: avg=2s min=989.64ms med=1.78s max=13.71s p(90)=2.16s p(95)=2.39s http_req_failed................: 0.00% ✓ 0 ✗ 1524 http_req_receiving.............: avg=212.21µs min=44.43µs med=120.34µs max=28.28ms p(90)=190.85µs p(95)=287.86µs http_req_sending...............: avg=44.65µs min=9.09µs med=17.51µs max=13.48ms p(90)=35.63µs p(95)=84.86µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2s min=989.46ms med=1.78s max=13.71s p(90)=2.16s p(95)=2.39s http_reqs......................: 1524 48.710507/s iteration_duration.............: avg=2.01s min=999.77ms med=1.79s max=13.72s p(90)=2.18s p(95)=2.4s iterations.....................: 1524 48.710507/s vus............................: 46 min=46 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2799 ✗ 0 data_received..................: 82 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=218.51µs min=1.33µs med=3.81µs max=25.99ms p(90)=172.06µs p(95)=1.48ms http_req_connecting............: avg=208.85µs min=0s med=0s max=25.96ms p(90)=101.78µs p(95)=1.42ms http_req_duration..............: avg=3.31s min=1.77s med=3.16s max=7.4s p(90)=4.53s p(95)=5.17s { expected_response:true }...: avg=3.31s min=1.77s med=3.16s max=7.4s p(90)=4.53s p(95)=5.17s http_req_failed................: 0.00% ✓ 0 ✗ 933 http_req_receiving.............: avg=3.35ms min=45.28µs med=135.38µs max=494.31ms p(90)=1.2ms p(95)=8.32ms http_req_sending...............: avg=115.97µs min=8.63µs med=20.79µs max=19.29ms p(90)=93.48µs p(95)=850.01µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.31s min=1.77s med=3.15s max=7.4s p(90)=4.53s p(95)=5.17s http_reqs......................: 933 29.473637/s iteration_duration.............: avg=3.33s min=1.79s med=3.17s max=7.41s p(90)=4.54s p(95)=5.18s iterations.....................: 933 29.473637/s vus............................: 64 min=64 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1365 ✗ 0 data_received..................: 40 MB 1.1 MB/s data_sent......................: 540 kB 14 kB/s http_req_blocked...............: avg=558.14µs min=1.58µs med=3.69µs max=6.08ms p(90)=2.25ms p(95)=3.89ms http_req_connecting............: avg=526.41µs min=0s med=0s max=5.98ms p(90)=2.11ms p(95)=3.33ms http_req_duration..............: avg=7.53s min=3.3s med=7.74s max=9.52s p(90)=8.83s p(95)=9.03s { expected_response:true }...: avg=7.53s min=3.3s med=7.74s max=9.52s p(90)=8.83s p(95)=9.03s http_req_failed................: 0.00% ✓ 0 ✗ 455 http_req_receiving.............: avg=312.41µs min=59.49µs med=121.93µs max=73.33ms p(90)=195.38µs p(95)=245.28µs http_req_sending...............: avg=71.32µs min=9.85µs med=20.2µs max=4.7ms p(90)=228.6µs p(95)=316.16µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.53s min=3.3s med=7.74s max=9.52s p(90)=8.83s p(95)=9.03s http_reqs......................: 455 12.019088/s iteration_duration.............: avg=7.54s min=3.31s med=7.74s max=9.53s p(90)=8.83s p(95)=9.04s iterations.....................: 455 12.019088/s vus............................: 18 min=18 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 174 5301 total, 0 failed avg: 510ms, p95: 677ms ✅
apollo-router 171 5218 total, 0 failed avg: 514ms, p95: 697ms ✅
wundergraph 154 4691 total, 0 failed avg: 534ms, p95: 953ms ✅
mesh-supergraph-bun 99 3059 total, 0 failed avg: 973ms, p95: 1679ms ✅
apollo-server 50 1592 total, 0 failed avg: 1917ms, p95: 2475ms ✅
mercurius 31 970 total, 0 failed avg: 3130ms, p95: 4496ms ✅
mesh-supergraph 29 944 total, 0 failed avg: 3300ms, p95: 5704ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15903 ✗ 0 data_received..................: 465 MB 15 MB/s data_sent......................: 6.3 MB 207 kB/s http_req_blocked...............: avg=26.15µs min=1.45µs med=2.96µs max=32.36ms p(90)=4.77µs p(95)=5.85µs http_req_connecting............: avg=9.9µs min=0s med=0s max=5.55ms p(90)=0s p(95)=0s http_req_duration..............: avg=509.54ms min=66.41ms med=510.08ms max=1.63s p(90)=611.76ms p(95)=677.39ms { expected_response:true }...: avg=509.54ms min=66.41ms med=510.08ms max=1.63s p(90)=611.76ms p(95)=677.39ms http_req_failed................: 0.00% ✓ 0 ✗ 5301 http_req_receiving.............: avg=23.33ms min=36.86µs med=74.89µs max=1.16s p(90)=31.37ms p(95)=116.17ms http_req_sending...............: avg=1.49ms min=8.36µs med=14.21µs max=452.98ms p(90)=56.45µs p(95)=394.8µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=484.71ms min=36.58ms med=498.54ms max=947.61ms p(90)=580.33ms p(95)=607.61ms http_reqs......................: 5301 174.465754/s iteration_duration.............: avg=570.4ms min=75.98ms med=545.06ms max=1.85s p(90)=726.67ms p(95)=857.01ms iterations.....................: 5301 174.465754/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15654 ✗ 0 data_received..................: 458 MB 15 MB/s data_sent......................: 6.2 MB 203 kB/s http_req_blocked...............: avg=22.99µs min=1.37µs med=2.76µs max=3.95ms p(90)=4.18µs p(95)=4.91µs http_req_connecting............: avg=18.67µs min=0s med=0s max=3.75ms p(90)=0s p(95)=0s http_req_duration..............: avg=513.65ms min=24.53ms med=512.77ms max=1.43s p(90)=647.59ms p(95)=697.36ms { expected_response:true }...: avg=513.65ms min=24.53ms med=512.77ms max=1.43s p(90)=647.59ms p(95)=697.36ms http_req_failed................: 0.00% ✓ 0 ✗ 5218 http_req_receiving.............: avg=17.29ms min=34.15µs med=66.58µs max=757.88ms p(90)=29.14ms p(95)=106.66ms http_req_sending...............: avg=1.23ms min=7.87µs med=13.47µs max=722.19ms p(90)=43.49µs p(95)=742.22µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=495.12ms min=24.45ms med=500.14ms max=848.99ms p(90)=618.54ms p(95)=656.03ms http_reqs......................: 5218 171.183545/s iteration_duration.............: avg=580.29ms min=33.87ms med=557.91ms max=1.97s p(90)=756.58ms p(95)=877.45ms iterations.....................: 5218 171.183545/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14073 ✗ 0 data_received..................: 412 MB 14 MB/s data_sent......................: 5.6 MB 183 kB/s http_req_blocked...............: avg=34.71µs min=1.26µs med=2.9µs max=7.57ms p(90)=4.69µs p(95)=5.76µs http_req_connecting............: avg=27.26µs min=0s med=0s max=7.53ms p(90)=0s p(95)=0s http_req_duration..............: avg=533.68ms min=16.09ms med=522.41ms max=2.38s p(90)=841.36ms p(95)=953.15ms { expected_response:true }...: avg=533.68ms min=16.09ms med=522.41ms max=2.38s p(90)=841.36ms p(95)=953.15ms http_req_failed................: 0.00% ✓ 0 ✗ 4691 http_req_receiving.............: avg=63.48ms min=39.21µs med=89.65µs max=1.5s p(90)=217.29ms p(95)=470.94ms http_req_sending...............: avg=2.83ms min=7.58µs med=13.79µs max=774.46ms p(90)=42.44µs p(95)=944.96µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=467.36ms min=15.97ms med=465.61ms max=1.12s p(90)=741.02ms p(95)=826.34ms http_reqs......................: 4691 154.522856/s iteration_duration.............: avg=643.53ms min=28.59ms med=600.54ms max=2.75s p(90)=1.04s p(95)=1.19s iterations.....................: 4691 154.522856/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9177 ✗ 0 data_received..................: 268 MB 8.7 MB/s data_sent......................: 3.6 MB 118 kB/s http_req_blocked...............: avg=27.51µs min=1.2µs med=2.57µs max=5.12ms p(90)=3.99µs p(95)=8.72µs http_req_connecting............: avg=20.22µs min=0s med=0s max=2.48ms p(90)=0s p(95)=0s http_req_duration..............: avg=973.43ms min=551.76ms med=847.92ms max=1.94s p(90)=1.56s p(95)=1.67s { expected_response:true }...: avg=973.43ms min=551.76ms med=847.92ms max=1.94s p(90)=1.56s p(95)=1.67s http_req_failed................: 0.00% ✓ 0 ✗ 3059 http_req_receiving.............: avg=10.18ms min=37.71µs med=83.88µs max=530.86ms p(90)=1.09ms p(95)=46.15ms http_req_sending...............: avg=372.84µs min=7.93µs med=12.99µs max=130.62ms p(90)=29.35µs p(95)=169.27µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=962.88ms min=551.4ms med=840.51ms max=1.94s p(90)=1.56s p(95)=1.67s http_reqs......................: 3059 99.211123/s iteration_duration.............: avg=998.74ms min=569.15ms med=876.63ms max=2.02s p(90)=1.6s p(95)=1.7s iterations.....................: 3059 99.211123/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4776 ✗ 0 data_received..................: 140 MB 4.5 MB/s data_sent......................: 1.9 MB 60 kB/s http_req_blocked...............: avg=59.43µs min=1.54µs med=2.92µs max=7.31ms p(90)=5.09µs p(95)=165.92µs http_req_connecting............: avg=46.62µs min=0s med=0s max=3.44ms p(90)=0s p(95)=107.08µs http_req_duration..............: avg=1.91s min=510.24ms med=1.59s max=20.79s p(90)=2.04s p(95)=2.47s { expected_response:true }...: avg=1.91s min=510.24ms med=1.59s max=20.79s p(90)=2.04s p(95)=2.47s http_req_failed................: 0.00% ✓ 0 ✗ 1592 http_req_receiving.............: avg=201.49µs min=47.52µs med=123.2µs max=28.01ms p(90)=184.6µs p(95)=214.89µs http_req_sending...............: avg=44.77µs min=8.64µs med=14.9µs max=2.43ms p(90)=33.41µs p(95)=118.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.91s min=509.77ms med=1.59s max=20.79s p(90)=2.04s p(95)=2.47s http_reqs......................: 1592 50.831983/s iteration_duration.............: avg=1.92s min=518.31ms med=1.6s max=20.8s p(90)=2.05s p(95)=2.48s iterations.....................: 1592 50.831983/s vus............................: 35 min=35 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2910 ✗ 0 data_received..................: 85 MB 2.8 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=95.25µs min=1.47µs med=3.84µs max=8.11ms p(90)=98.53µs p(95)=612.9µs http_req_connecting............: avg=86.68µs min=0s med=0s max=8.07ms p(90)=65.7µs p(95)=532.34µs http_req_duration..............: avg=3.12s min=631.07ms med=2.94s max=7.73s p(90)=4.1s p(95)=4.49s { expected_response:true }...: avg=3.12s min=631.07ms med=2.94s max=7.73s p(90)=4.1s p(95)=4.49s http_req_failed................: 0.00% ✓ 0 ✗ 970 http_req_receiving.............: avg=463.27µs min=43.42µs med=121.71µs max=70.46ms p(90)=197.33µs p(95)=340.4µs http_req_sending...............: avg=88.61µs min=8.37µs med=21.01µs max=23.75ms p(90)=47.71µs p(95)=490.09µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.12s min=630.76ms med=2.94s max=7.73s p(90)=4.1s p(95)=4.49s http_reqs......................: 970 31.336985/s iteration_duration.............: avg=3.14s min=640.79ms med=2.95s max=7.75s p(90)=4.11s p(95)=4.5s iterations.....................: 970 31.336985/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2832 ✗ 0 data_received..................: 83 MB 2.6 MB/s data_sent......................: 1.1 MB 35 kB/s http_req_blocked...............: avg=165.44µs min=1.64µs med=4.47µs max=20.02ms p(90)=117.53µs p(95)=688.43µs http_req_connecting............: avg=142.65µs min=0s med=0s max=19.98ms p(90)=78.34µs p(95)=509.72µs http_req_duration..............: avg=3.29s min=1.67s med=3.18s max=7.32s p(90)=4.38s p(95)=5.7s { expected_response:true }...: avg=3.29s min=1.67s med=3.18s max=7.32s p(90)=4.38s p(95)=5.7s http_req_failed................: 0.00% ✓ 0 ✗ 944 http_req_receiving.............: avg=3.14ms min=43.99µs med=190.14µs max=74.31ms p(90)=2.58ms p(95)=14.07ms http_req_sending...............: avg=77.07µs min=7.06µs med=25.54µs max=6.11ms p(90)=99.92µs p(95)=265.54µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.29s min=1.67s med=3.17s max=7.31s p(90)=4.38s p(95)=5.7s http_reqs......................: 944 29.582747/s iteration_duration.............: avg=3.31s min=1.68s med=3.19s max=7.33s p(90)=4.39s p(95)=5.71s iterations.....................: 944 29.582747/s vus............................: 71 min=71 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 164 5032 total, 0 failed avg: 536ms, p95: 726ms ✅
wundergraph 104 3236 total, 0 failed avg: 909ms, p95: 1111ms ✅
mesh-supergraph-bun 102 3148 total, 0 failed avg: 928ms, p95: 1323ms ✅
cosmo 83 2591 total, 0 failed avg: 1144ms, p95: 1363ms ✅
apollo-server 63 1947 total, 0 failed avg: 1547ms, p95: 1856ms ✅
mesh-supergraph 62 1951 total, 0 failed avg: 1545ms, p95: 2223ms ✅
mercurius 12 475 total, 0 failed avg: 7126ms, p95: 8328ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15096 ✗ 0 data_received..................: 441 MB 15 MB/s data_sent......................: 6.0 MB 196 kB/s http_req_blocked...............: avg=71.35µs min=1.53µs med=2.98µs max=70.56ms p(90)=4.62µs p(95)=5.63µs http_req_connecting............: avg=40.98µs min=0s med=0s max=15.35ms p(90)=0s p(95)=0s http_req_duration..............: avg=535.64ms min=232.32ms med=523.84ms max=1.15s p(90)=672.33ms p(95)=725.8ms { expected_response:true }...: avg=535.64ms min=232.32ms med=523.84ms max=1.15s p(90)=672.33ms p(95)=725.8ms http_req_failed................: 0.00% ✓ 0 ✗ 5032 http_req_receiving.............: avg=16.7ms min=37.71µs med=72.23µs max=420.05ms p(90)=58.17ms p(95)=112.05ms http_req_sending...............: avg=1.7ms min=8.45µs med=13.89µs max=433.48ms p(90)=34.37µs p(95)=517.16µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=517.23ms min=232.26ms med=512.4ms max=881.28ms p(90)=639.48ms p(95)=686.29ms http_reqs......................: 5032 164.918825/s iteration_duration.............: avg=599.91ms min=245.77ms med=581.2ms max=1.2s p(90)=762.51ms p(95)=856.37ms iterations.....................: 5032 164.918825/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9708 ✗ 0 data_received..................: 284 MB 9.2 MB/s data_sent......................: 3.8 MB 124 kB/s http_req_blocked...............: avg=71.84µs min=1.27µs med=2.51µs max=18.79ms p(90)=3.7µs p(95)=8.14µs http_req_connecting............: avg=59.52µs min=0s med=0s max=5.78ms p(90)=0s p(95)=0s http_req_duration..............: avg=908.96ms min=555.26ms med=904.66ms max=1.35s p(90)=1.05s p(95)=1.11s { expected_response:true }...: avg=908.96ms min=555.26ms med=904.66ms max=1.35s p(90)=1.05s p(95)=1.11s http_req_failed................: 0.00% ✓ 0 ✗ 3236 http_req_receiving.............: avg=13.02ms min=38.45µs med=72.29µs max=362.58ms p(90)=36.9ms p(95)=95.69ms http_req_sending...............: avg=1.57ms min=8.06µs med=12.64µs max=338.78ms p(90)=37.44µs p(95)=1.12ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=894.36ms min=555.18ms med=895.11ms max=1.3s p(90)=1.01s p(95)=1.06s http_reqs......................: 3236 104.408332/s iteration_duration.............: avg=944.8ms min=565.83ms med=937.91ms max=1.42s p(90)=1.1s p(95)=1.16s iterations.....................: 3236 104.408332/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9444 ✗ 0 data_received..................: 276 MB 9.0 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=107.62µs min=1.71µs med=3.57µs max=7.77ms p(90)=5.56µs p(95)=9.41µs http_req_connecting............: avg=18.4µs min=0s med=0s max=3.91ms p(90)=0s p(95)=0s http_req_duration..............: avg=928.24ms min=391.12ms med=906.33ms max=1.88s p(90)=1.22s p(95)=1.32s { expected_response:true }...: avg=928.24ms min=391.12ms med=906.33ms max=1.88s p(90)=1.22s p(95)=1.32s http_req_failed................: 0.00% ✓ 0 ✗ 3148 http_req_receiving.............: avg=13.75ms min=36.46µs med=86.21µs max=673.78ms p(90)=9.61ms p(95)=78.76ms http_req_sending...............: avg=1.12ms min=8.83µs med=18.02µs max=233.77ms p(90)=49.39µs p(95)=311.94µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=913.35ms min=390.76ms med=890.18ms max=1.83s p(90)=1.2s p(95)=1.3s http_reqs......................: 3148 102.068252/s iteration_duration.............: avg=970.02ms min=401.82ms med=946.14ms max=1.97s p(90)=1.27s p(95)=1.39s iterations.....................: 3148 102.068252/s vus............................: 96 min=96 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7773 ✗ 0 data_received..................: 227 MB 7.3 MB/s data_sent......................: 3.1 MB 99 kB/s http_req_blocked...............: avg=58.53µs min=1.32µs med=2.64µs max=56.27ms p(90)=4.23µs p(95)=9.67µs http_req_connecting............: avg=25.27µs min=0s med=0s max=2.57ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.14s min=748.69ms med=1.13s max=1.56s p(90)=1.31s p(95)=1.36s { expected_response:true }...: avg=1.14s min=748.69ms med=1.13s max=1.56s p(90)=1.31s p(95)=1.36s http_req_failed................: 0.00% ✓ 0 ✗ 2591 http_req_receiving.............: avg=9.2ms min=38.15µs med=80.9µs max=261.83ms p(90)=30.03ms p(95)=70.24ms http_req_sending...............: avg=1.19ms min=7.75µs med=12.64µs max=157.57ms p(90)=36.69µs p(95)=347.21µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.13s min=748.57ms med=1.12s max=1.51s p(90)=1.3s p(95)=1.33s http_reqs......................: 2591 83.051388/s iteration_duration.............: avg=1.18s min=763.57ms med=1.17s max=1.6s p(90)=1.36s p(95)=1.43s iterations.....................: 2591 83.051388/s vus............................: 46 min=46 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5841 ✗ 0 data_received..................: 171 MB 5.5 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=153.74µs min=1.48µs med=3.24µs max=6.65ms p(90)=5.13µs p(95)=186.12µs http_req_connecting............: avg=145.04µs min=0s med=0s max=6.16ms p(90)=0s p(95)=109.41µs http_req_duration..............: avg=1.54s min=764.16ms med=1.48s max=9.69s p(90)=1.72s p(95)=1.85s { expected_response:true }...: avg=1.54s min=764.16ms med=1.48s max=9.69s p(90)=1.72s p(95)=1.85s http_req_failed................: 0.00% ✓ 0 ✗ 1947 http_req_receiving.............: avg=350.13µs min=45.69µs med=111.36µs max=67.65ms p(90)=191.55µs p(95)=314.68µs http_req_sending...............: avg=64.26µs min=9.17µs med=16.68µs max=23.38ms p(90)=35.42µs p(95)=348.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.54s min=764.02ms med=1.48s max=9.69s p(90)=1.72s p(95)=1.84s http_reqs......................: 1947 63.008239/s iteration_duration.............: avg=1.56s min=770.12ms med=1.49s max=9.7s p(90)=1.74s p(95)=1.87s iterations.....................: 1947 63.008239/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5853 ✗ 0 data_received..................: 171 MB 5.5 MB/s data_sent......................: 2.3 MB 75 kB/s http_req_blocked...............: avg=217.54µs min=1.48µs med=3.77µs max=8.12ms p(90)=5.64µs p(95)=210.72µs http_req_connecting............: avg=208.95µs min=0s med=0s max=8.08ms p(90)=0s p(95)=181.25µs http_req_duration..............: avg=1.54s min=628.89ms med=1.5s max=3.42s p(90)=2.02s p(95)=2.22s { expected_response:true }...: avg=1.54s min=628.89ms med=1.5s max=3.42s p(90)=2.02s p(95)=2.22s http_req_failed................: 0.00% ✓ 0 ✗ 1951 http_req_receiving.............: avg=2.39ms min=39.68µs med=117.69µs max=130.06ms p(90)=2.47ms p(95)=10.53ms http_req_sending...............: avg=221.37µs min=8.27µs med=19.65µs max=47.28ms p(90)=42.33µs p(95)=166.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.54s min=628.21ms med=1.5s max=3.42s p(90)=2.02s p(95)=2.22s http_reqs......................: 1951 62.971658/s iteration_duration.............: avg=1.56s min=655.31ms med=1.53s max=3.61s p(90)=2.05s p(95)=2.24s iterations.....................: 1951 62.971658/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1425 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 564 kB 15 kB/s http_req_blocked...............: avg=102.6µs min=1.52µs med=3.7µs max=1.3ms p(90)=388.59µs p(95)=790.65µs http_req_connecting............: avg=86.71µs min=0s med=0s max=1.28ms p(90)=314.14µs p(95)=635.19µs http_req_duration..............: avg=7.12s min=3.35s med=7.4s max=8.61s p(90)=8.21s p(95)=8.32s { expected_response:true }...: avg=7.12s min=3.35s med=7.4s max=8.61s p(90)=8.21s p(95)=8.32s http_req_failed................: 0.00% ✓ 0 ✗ 475 http_req_receiving.............: avg=150.51µs min=65.61µs med=123.96µs max=4.86ms p(90)=187.48µs p(95)=219.55µs http_req_sending...............: avg=83.32µs min=8.75µs med=21.63µs max=5.12ms p(90)=306.98µs p(95)=416.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.12s min=3.35s med=7.4s max=8.61s p(90)=8.21s p(95)=8.32s http_reqs......................: 475 12.726229/s iteration_duration.............: avg=7.13s min=3.36s med=7.41s max=8.63s p(90)=8.22s p(95)=8.33s iterations.....................: 475 12.726229/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 4 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
wundergraph 1871ms 166 11633 total, 0 failed avg: 685ms, p95: 1872ms, max: 4355ms, med: 523ms ✅
cosmo 2669ms 172 12086 total, 0 failed avg: 811ms, p95: 2670ms, max: 8943ms, med: 514ms ✅
apollo-router 2745ms 173 12123 total, 0 failed avg: 801ms, p95: 2746ms, max: 9840ms, med: 483ms ✅
mesh-supergraph-bun 5562ms 118 8318 total, 0 failed avg: 2208ms, p95: 5563ms, max: 8535ms, med: 2016ms ✅
mesh-supergraph 6714ms 66 4648 total, 0 failed avg: 4103ms, p95: 6715ms, max: 8278ms, med: 4288ms ✅
apollo-server 23637ms 68 5024 total, 0 failed avg: 4156ms, p95: 23637ms, max: 45152ms, med: 2227ms ✅
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 34899 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 197 kB/s http_req_blocked...............: avg=18.36ms min=1.49µs med=3.05µs max=2.88s p(90)=4.96µs p(95)=16.48µs http_req_connecting............: avg=17.29ms min=0s med=0s max=2.88s p(90)=0s p(95)=0s http_req_duration..............: avg=684.55ms min=6.34ms med=523.49ms max=4.35s p(90)=1.55s p(95)=1.87s { expected_response:true }...: avg=684.55ms min=6.34ms med=523.49ms max=4.35s p(90)=1.55s p(95)=1.87s http_req_failed................: 0.00% ✓ 0 ✗ 11633 http_req_receiving.............: avg=215.14ms min=31.36µs med=79.5µs max=4.07s p(90)=994.46ms p(95)=1.26s http_req_sending...............: avg=28.38ms min=7.54µs med=14.6µs max=2.89s p(90)=1.01ms p(95)=92.84ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=441.02ms min=6.23ms med=362.09ms max=2.72s p(90)=880.34ms p(95)=1.08s http_reqs......................: 11633 166.171948/s iteration_duration.............: avg=1.56s min=12.16ms med=1.04s max=11.18s p(90)=3.66s p(95)=4.64s iterations.....................: 11633 166.171948/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36258 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 205 kB/s http_req_blocked...............: avg=16.05ms min=1.58µs med=3.03µs max=5.31s p(90)=4.98µs p(95)=12.23µs http_req_connecting............: avg=15.17ms min=0s med=0s max=5.31s p(90)=0s p(95)=0s http_req_duration..............: avg=810.84ms min=6.76ms med=513.92ms max=8.94s p(90)=1.86s p(95)=2.66s { expected_response:true }...: avg=810.84ms min=6.76ms med=513.92ms max=8.94s p(90)=1.86s p(95)=2.66s http_req_failed................: 0.00% ✓ 0 ✗ 12086 http_req_receiving.............: avg=349.39ms min=31.47µs med=82.8µs max=8.03s p(90)=1.27s p(95)=1.92s http_req_sending...............: avg=39.93ms min=7.55µs med=14.25µs max=7.15s p(90)=228.89µs p(95)=67.79ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=421.52ms min=6.66ms med=347.5ms max=2.09s p(90)=865.89ms p(95)=1.02s http_reqs......................: 12086 172.637597/s iteration_duration.............: avg=1.54s min=12.24ms med=968.42ms max=12.1s p(90)=3.81s p(95)=4.88s iterations.....................: 12086 172.637597/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36369 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 206 kB/s http_req_blocked...............: avg=13.44ms min=1.55µs med=3.06µs max=4.45s p(90)=4.9µs p(95)=12.28µs http_req_connecting............: avg=12.65ms min=0s med=0s max=4.4s p(90)=0s p(95)=0s http_req_duration..............: avg=801.44ms min=6.11ms med=483.36ms max=9.83s p(90)=2.03s p(95)=2.74s { expected_response:true }...: avg=801.44ms min=6.11ms med=483.36ms max=9.83s p(90)=2.03s p(95)=2.74s http_req_failed................: 0.00% ✓ 0 ✗ 12123 http_req_receiving.............: avg=326.56ms min=31.45µs med=79.5µs max=7.65s p(90)=1.24s p(95)=2.11s http_req_sending...............: avg=32.27ms min=7.98µs med=14.23µs max=5.86s p(90)=137.44µs p(95)=37.41ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=442.59ms min=6.02ms med=355.74ms max=2.65s p(90)=894.52ms p(95)=1.15s http_reqs......................: 12123 173.179957/s iteration_duration.............: avg=1.53s min=11.65ms med=896.73ms max=14.56s p(90)=3.83s p(95)=4.93s iterations.....................: 12123 173.179957/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24954 ✗ 0 data_received..................: 730 MB 10 MB/s data_sent......................: 9.9 MB 141 kB/s http_req_blocked...............: avg=1.89ms min=1.42µs med=2.91µs max=376.08ms p(90)=5.22µs p(95)=216.22µs http_req_connecting............: avg=1.82ms min=0s med=0s max=367.36ms p(90)=0s p(95)=145.51µs http_req_duration..............: avg=2.2s min=8.58ms med=2.01s max=8.53s p(90)=4.21s p(95)=5.56s { expected_response:true }...: avg=2.2s min=8.58ms med=2.01s max=8.53s p(90)=4.21s p(95)=5.56s http_req_failed................: 0.00% ✓ 0 ✗ 8318 http_req_receiving.............: avg=26.04ms min=36.15µs med=76.77µs max=1.4s p(90)=27.39ms p(95)=187.43ms http_req_sending...............: avg=3.18ms min=7.9µs med=13.84µs max=867.34ms p(90)=113.16µs p(95)=9.7ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.17s min=8.45ms med=1.97s max=8.53s p(90)=4.18s p(95)=5.39s http_reqs......................: 8318 118.800642/s iteration_duration.............: avg=2.27s min=15.89ms med=2.09s max=8.87s p(90)=4.35s p(95)=5.63s iterations.....................: 8318 118.800642/s vus............................: 2 min=2 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13944 ✗ 0 data_received..................: 408 MB 5.8 MB/s data_sent......................: 5.5 MB 79 kB/s http_req_blocked...............: avg=588.46µs min=1.61µs med=4.99µs max=185.53ms p(90)=208.82µs p(95)=521.28µs http_req_connecting............: avg=553.45µs min=0s med=0s max=122.55ms p(90)=143.96µs p(95)=443.65µs http_req_duration..............: avg=4.1s min=12.09ms med=4.28s max=8.27s p(90)=6.37s p(95)=6.71s { expected_response:true }...: avg=4.1s min=12.09ms med=4.28s max=8.27s p(90)=6.37s p(95)=6.71s http_req_failed................: 0.00% ✓ 0 ✗ 4648 http_req_receiving.............: avg=2.75ms min=38.01µs med=117.84µs max=661.35ms p(90)=1.29ms p(95)=9.64ms http_req_sending...............: avg=545.33µs min=9.14µs med=28.14µs max=119.84ms p(90)=64.36µs p(95)=166.17µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.09s min=11.96ms med=4.28s max=8.27s p(90)=6.37s p(95)=6.7s http_reqs......................: 4648 66.388511/s iteration_duration.............: avg=4.13s min=17.83ms med=4.31s max=8.32s p(90)=6.4s p(95)=6.75s iterations.....................: 4648 66.388511/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15072 ✗ 0 data_received..................: 442 MB 6.0 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=89.04µs min=1.44µs med=3.32µs max=38.16ms p(90)=74.61µs p(95)=277.53µs http_req_connecting............: avg=75.81µs min=0s med=0s max=38.1ms p(90)=0s p(95)=206.59µs http_req_duration..............: avg=4.15s min=74.62ms med=2.22s max=45.15s p(90)=3.4s p(95)=23.63s { expected_response:true }...: avg=4.15s min=74.62ms med=2.22s max=45.15s p(90)=3.4s p(95)=23.63s http_req_failed................: 0.00% ✓ 0 ✗ 5024 http_req_receiving.............: avg=277.2µs min=44.01µs med=118.29µs max=152.19ms p(90)=181.46µs p(95)=211.03µs http_req_sending...............: avg=64.86µs min=8.16µs med=16.43µs max=39.43ms p(90)=40.41µs p(95)=62.51µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.15s min=74.51ms med=2.22s max=45.15s p(90)=3.4s p(95)=23.63s http_reqs......................: 5024 68.67083/s iteration_duration.............: avg=4.16s min=85.17ms med=2.23s max=45.15s p(90)=3.41s p(95)=23.64s iterations.....................: 5024 68.67083/s vus............................: 18 min=18 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview