search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update dependency @graphql-mesh/cli to v0.89.4 #398

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Change Age Adoption Passing Confidence
@graphql-mesh/cli (source) 0.89.3 -> 0.89.4 age adoption passing confidence

Release Notes

ardatan/graphql-mesh (@​graphql-mesh/cli) ### [`v0.89.4`](https://togithub.com/ardatan/graphql-mesh/blob/HEAD/packages/legacy/cli/CHANGELOG.md#0894) [Compare Source](https://togithub.com/ardatan/graphql-mesh/compare/@graphql-mesh/cli@0.89.3...103621c913f20849d97184a1f87a5127a3d8a1ca) ##### Patch Changes - [`e2fb7ed`](https://togithub.com/ardatan/graphql-mesh/commit/e2fb7edb8b02a53fa6f1b1f1fba629ea7c84488f) Thanks [@​ardatan](https://togithub.com/ardatan)! - Terminate handler registry - Updated dependencies \[[`e2fb7ed`](https://togithub.com/ardatan/graphql-mesh/commit/e2fb7edb8b02a53fa6f1b1f1fba629ea7c84488f), [`e2fb7ed`](https://togithub.com/ardatan/graphql-mesh/commit/e2fb7edb8b02a53fa6f1b1f1fba629ea7c84488f), [`ff33394`](https://togithub.com/ardatan/graphql-mesh/commit/ff3339451d8911f9b9265e158ad86844648ee12f)]: - [@​graphql-mesh/utils](https://togithub.com/graphql-mesh/utils)[@​0](https://togithub.com/0).97.4 - [@​graphql-mesh/types](https://togithub.com/graphql-mesh/types)[@​0](https://togithub.com/0).97.4 - [@​graphql-mesh/config](https://togithub.com/graphql-mesh/config)[@​0](https://togithub.com/0).99.4 - [@​graphql-mesh/http](https://togithub.com/graphql-mesh/http)[@​0](https://togithub.com/0).98.4 - [@​graphql-mesh/runtime](https://togithub.com/graphql-mesh/runtime)[@​0](https://togithub.com/0).98.4 - [@​graphql-mesh/store](https://togithub.com/graphql-mesh/store)[@​0](https://togithub.com/0).97.4

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 164 5027 total, 0 failed avg: 539ms, p95: 726ms ✅
mesh-supergraph-bun 103 3172 total, 0 failed avg: 926ms, p95: 1328ms ✅
wundergraph 102 3184 total, 0 failed avg: 917ms, p95: 1113ms ✅
cosmo 83 2600 total, 0 failed avg: 1155ms, p95: 1442ms ✅
mesh-supergraph 64 1998 total, 0 failed avg: 1503ms, p95: 2239ms ✅
apollo-server 63 1978 total, 0 failed avg: 1529ms, p95: 1885ms ✅
mercurius 12 472 total, 0 failed avg: 7191ms, p95: 8450ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15081 ✗ 0 data_received..................: 441 MB 15 MB/s data_sent......................: 6.0 MB 196 kB/s http_req_blocked...............: avg=48.41µs min=1.39µs med=2.99µs max=5.68ms p(90)=4.74µs p(95)=5.82µs http_req_connecting............: avg=42.91µs min=0s med=0s max=5.56ms p(90)=0s p(95)=0s http_req_duration..............: avg=539.45ms min=255.57ms med=526.61ms max=1.15s p(90)=671.33ms p(95)=726.17ms { expected_response:true }...: avg=539.45ms min=255.57ms med=526.61ms max=1.15s p(90)=671.33ms p(95)=726.17ms http_req_failed................: 0.00% ✓ 0 ✗ 5027 http_req_receiving.............: avg=20.7ms min=37.76µs med=78.68µs max=529.92ms p(90)=75.09ms p(95)=125.95ms http_req_sending...............: avg=1.98ms min=7.95µs med=14.12µs max=390.46ms p(90)=39.07µs p(95)=241.27µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=516.75ms min=255.49ms med=513.13ms max=861.22ms p(90)=628.38ms p(95)=672.11ms http_reqs......................: 5027 164.984328/s iteration_duration.............: avg=602.74ms min=277.09ms med=579.81ms max=1.27s p(90)=774.32ms p(95)=867.29ms iterations.....................: 5027 164.984328/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9516 ✗ 0 data_received..................: 278 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=50.49µs min=1.49µs med=2.86µs max=35.71ms p(90)=4.58µs p(95)=9.45µs http_req_connecting............: avg=28.25µs min=0s med=0s max=3.74ms p(90)=0s p(95)=0s http_req_duration..............: avg=925.61ms min=396.56ms med=902.56ms max=1.99s p(90)=1.2s p(95)=1.32s { expected_response:true }...: avg=925.61ms min=396.56ms med=902.56ms max=1.99s p(90)=1.2s p(95)=1.32s http_req_failed................: 0.00% ✓ 0 ✗ 3172 http_req_receiving.............: avg=12.04ms min=38.25µs med=91.9µs max=685.3ms p(90)=5.13ms p(95)=58.32ms http_req_sending...............: avg=500.9µs min=8.18µs med=13.8µs max=120.35ms p(90)=31.98µs p(95)=126.39µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=913.07ms min=396.32ms med=892.94ms max=1.84s p(90)=1.17s p(95)=1.28s http_reqs......................: 3172 103.483238/s iteration_duration.............: avg=958.88ms min=404.39ms med=930.79ms max=2.01s p(90)=1.24s p(95)=1.38s iterations.....................: 3172 103.483238/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9552 ✗ 0 data_received..................: 279 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=51.91µs min=1.36µs med=2.84µs max=5.33ms p(90)=4.68µs p(95)=6.53µs http_req_connecting............: avg=43.09µs min=0s med=0s max=5.29ms p(90)=0s p(95)=0s http_req_duration..............: avg=916.74ms min=581.24ms med=914.77ms max=1.42s p(90)=1.06s p(95)=1.11s { expected_response:true }...: avg=916.74ms min=581.24ms med=914.77ms max=1.42s p(90)=1.06s p(95)=1.11s http_req_failed................: 0.00% ✓ 0 ✗ 3184 http_req_receiving.............: avg=13.09ms min=39.82µs med=93.54µs max=334.59ms p(90)=49.42ms p(95)=83.83ms http_req_sending...............: avg=1.39ms min=8.24µs med=13.69µs max=288.06ms p(90)=38.38µs p(95)=646.25µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=902.24ms min=580.9ms med=903.44ms max=1.38s p(90)=1.03s p(95)=1.07s http_reqs......................: 3184 102.586216/s iteration_duration.............: avg=961.39ms min=626.1ms med=958.24ms max=1.43s p(90)=1.11s p(95)=1.19s iterations.....................: 3184 102.586216/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7800 ✗ 0 data_received..................: 228 MB 7.3 MB/s data_sent......................: 3.1 MB 99 kB/s http_req_blocked...............: avg=71.1µs min=1.33µs med=2.68µs max=8.07ms p(90)=4.24µs p(95)=9.19µs http_req_connecting............: avg=58.81µs min=0s med=0s max=6.42ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=700.2ms med=1.14s max=1.85s p(90)=1.33s p(95)=1.44s { expected_response:true }...: avg=1.15s min=700.2ms med=1.14s max=1.85s p(90)=1.33s p(95)=1.44s http_req_failed................: 0.00% ✓ 0 ✗ 2600 http_req_receiving.............: avg=10.84ms min=39.5µs med=86.57µs max=375.92ms p(90)=40.53ms p(95)=69.35ms http_req_sending...............: avg=1.16ms min=8.44µs med=12.91µs max=178.57ms p(90)=37.47µs p(95)=354.73µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=700.01ms med=1.13s max=1.67s p(90)=1.31s p(95)=1.39s http_reqs......................: 2600 83.151841/s iteration_duration.............: avg=1.19s min=730.07ms med=1.17s max=1.89s p(90)=1.38s p(95)=1.48s iterations.....................: 2600 83.151841/s vus............................: 55 min=55 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5994 ✗ 0 data_received..................: 175 MB 5.7 MB/s data_sent......................: 2.4 MB 77 kB/s http_req_blocked...............: avg=158.51µs min=1.49µs med=3.46µs max=8.06ms p(90)=5.15µs p(95)=115.05µs http_req_connecting............: avg=146.86µs min=0s med=0s max=6.75ms p(90)=0s p(95)=11.65µs http_req_duration..............: avg=1.5s min=588.54ms med=1.48s max=3.28s p(90)=1.93s p(95)=2.23s { expected_response:true }...: avg=1.5s min=588.54ms med=1.48s max=3.28s p(90)=1.93s p(95)=2.23s http_req_failed................: 0.00% ✓ 0 ✗ 1998 http_req_receiving.............: avg=2.18ms min=39.75µs med=111.94µs max=176.31ms p(90)=2.65ms p(95)=8.94ms http_req_sending...............: avg=220.61µs min=8.28µs med=18.42µs max=165.67ms p(90)=38.58µs p(95)=242.15µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.5s min=588.19ms med=1.48s max=3.28s p(90)=1.93s p(95)=2.23s http_reqs......................: 1998 64.859687/s iteration_duration.............: avg=1.52s min=608.9ms med=1.5s max=3.29s p(90)=1.96s p(95)=2.27s iterations.....................: 1998 64.859687/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5934 ✗ 0 data_received..................: 174 MB 5.6 MB/s data_sent......................: 2.3 MB 76 kB/s http_req_blocked...............: avg=172.49µs min=1.65µs med=3.49µs max=7.36ms p(90)=5.44µs p(95)=333.8µs http_req_connecting............: avg=155.69µs min=0s med=0s max=7.33ms p(90)=0s p(95)=157.74µs http_req_duration..............: avg=1.52s min=807.42ms med=1.44s max=9.67s p(90)=1.72s p(95)=1.88s { expected_response:true }...: avg=1.52s min=807.42ms med=1.44s max=9.67s p(90)=1.72s p(95)=1.88s http_req_failed................: 0.00% ✓ 0 ✗ 1978 http_req_receiving.............: avg=250.67µs min=47.9µs med=112.89µs max=60.66ms p(90)=183.03µs p(95)=280.6µs http_req_sending...............: avg=85.45µs min=8.98µs med=18.48µs max=38.87ms p(90)=34.2µs p(95)=124.32µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.52s min=807.29ms med=1.44s max=9.67s p(90)=1.72s p(95)=1.88s http_reqs......................: 1978 63.806547/s iteration_duration.............: avg=1.54s min=818.2ms med=1.45s max=9.68s p(90)=1.73s p(95)=1.89s iterations.....................: 1978 63.806547/s vus............................: 2 min=2 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1416 ✗ 0 data_received..................: 41 MB 1.1 MB/s data_sent......................: 560 kB 15 kB/s http_req_blocked...............: avg=172.22µs min=1.62µs med=3.81µs max=3.23ms p(90)=733.86µs p(95)=1.15ms http_req_connecting............: avg=140.62µs min=0s med=0s max=2.12ms p(90)=557.53µs p(95)=1.03ms http_req_duration..............: avg=7.19s min=3.04s med=7.48s max=8.64s p(90)=8.31s p(95)=8.45s { expected_response:true }...: avg=7.19s min=3.04s med=7.48s max=8.64s p(90)=8.31s p(95)=8.45s http_req_failed................: 0.00% ✓ 0 ✗ 472 http_req_receiving.............: avg=137.56µs min=63.38µs med=124.84µs max=2.34ms p(90)=182.68µs p(95)=206.93µs http_req_sending...............: avg=90.63µs min=9.83µs med=21.52µs max=844.7µs p(90)=368.94µs p(95)=680.55µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.19s min=3.04s med=7.48s max=8.64s p(90)=8.31s p(95)=8.45s http_reqs......................: 472 12.626617/s iteration_duration.............: avg=7.19s min=3.05s med=7.49s max=8.65s p(90)=8.32s p(95)=8.45s iterations.....................: 472 12.626617/s vus............................: 9 min=9 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 173 5282 total, 0 failed avg: 502ms, p95: 656ms ✅
apollo-router 170 5207 total, 0 failed avg: 517ms, p95: 691ms ✅
wundergraph 161 4890 total, 0 failed avg: 512ms, p95: 984ms ✅
mesh-supergraph-bun 97 2979 total, 0 failed avg: 993ms, p95: 1689ms ✅
apollo-server 45 1440 total, 0 failed avg: 2127ms, p95: 3408ms ✅
mercurius 31 951 total, 0 failed avg: 3180ms, p95: 4395ms ✅
mesh-supergraph 30 952 total, 0 failed avg: 3213ms, p95: 5282ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15846 ✗ 0 data_received..................: 463 MB 15 MB/s data_sent......................: 6.3 MB 206 kB/s http_req_blocked...............: avg=37.52µs min=1.48µs med=2.92µs max=5ms p(90)=4.62µs p(95)=5.75µs http_req_connecting............: avg=28.78µs min=0s med=0s max=4.67ms p(90)=0s p(95)=0s http_req_duration..............: avg=501.72ms min=16.69ms med=502.62ms max=1.98s p(90)=610.88ms p(95)=656.04ms { expected_response:true }...: avg=501.72ms min=16.69ms med=502.62ms max=1.98s p(90)=610.88ms p(95)=656.04ms http_req_failed................: 0.00% ✓ 0 ✗ 5282 http_req_receiving.............: avg=19.69ms min=37.89µs med=75.94µs max=1.01s p(90)=32.34ms p(95)=123.55ms http_req_sending...............: avg=2.33ms min=8.09µs med=14.06µs max=1.42s p(90)=36.94µs p(95)=791.43µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=479.69ms min=16.62ms med=490.94ms max=766.47ms p(90)=583.37ms p(95)=610.18ms http_reqs......................: 5282 173.756962/s iteration_duration.............: avg=572.02ms min=40.17ms med=545.45ms max=2.06s p(90)=740.64ms p(95)=863.48ms iterations.....................: 5282 173.756962/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15621 ✗ 0 data_received..................: 457 MB 15 MB/s data_sent......................: 6.2 MB 203 kB/s http_req_blocked...............: avg=29.77µs min=1.34µs med=2.63µs max=4.54ms p(90)=3.85µs p(95)=4.77µs http_req_connecting............: avg=23.12µs min=0s med=0s max=3.72ms p(90)=0s p(95)=0s http_req_duration..............: avg=517.38ms min=65.5ms med=515.34ms max=1.41s p(90)=647.53ms p(95)=691.06ms { expected_response:true }...: avg=517.38ms min=65.5ms med=515.34ms max=1.41s p(90)=647.53ms p(95)=691.06ms http_req_failed................: 0.00% ✓ 0 ✗ 5207 http_req_receiving.............: avg=15.48ms min=34.98µs med=63.23µs max=1.29s p(90)=23.05ms p(95)=91.91ms http_req_sending...............: avg=1.14ms min=8.17µs med=13.04µs max=282.5ms p(90)=29.34µs p(95)=153.22µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=500.75ms min=65.42ms med=505.46ms max=809.17ms p(90)=628.51ms p(95)=661.38ms http_reqs......................: 5207 170.938771/s iteration_duration.............: avg=580.86ms min=81.05ms med=560.79ms max=2.35s p(90)=744.84ms p(95)=855.21ms iterations.....................: 5207 170.938771/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14670 ✗ 0 data_received..................: 429 MB 14 MB/s data_sent......................: 5.8 MB 191 kB/s http_req_blocked...............: avg=26.8µs min=1.09µs med=2.72µs max=41.49ms p(90)=3.93µs p(95)=4.84µs http_req_connecting............: avg=14.12µs min=0s med=0s max=7.05ms p(90)=0s p(95)=0s http_req_duration..............: avg=512.4ms min=20.94ms med=479.06ms max=2.39s p(90)=854.33ms p(95)=983.86ms { expected_response:true }...: avg=512.4ms min=20.94ms med=479.06ms max=2.39s p(90)=854.33ms p(95)=983.86ms http_req_failed................: 0.00% ✓ 0 ✗ 4890 http_req_receiving.............: avg=57.22ms min=37.07µs med=86.86µs max=1.93s p(90)=182.74ms p(95)=383.12ms http_req_sending...............: avg=2.77ms min=7.51µs med=13.03µs max=1.21s p(90)=33.57µs p(95)=201.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=452.4ms min=13.19ms med=438.58ms max=1.19s p(90)=741.55ms p(95)=859ms http_reqs......................: 4890 161.224199/s iteration_duration.............: avg=617.17ms min=31.13ms med=551.18ms max=3.23s p(90)=1.02s p(95)=1.22s iterations.....................: 4890 161.224199/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 8937 ✗ 0 data_received..................: 261 MB 8.5 MB/s data_sent......................: 3.5 MB 115 kB/s http_req_blocked...............: avg=49.21µs min=1.36µs med=2.8µs max=3.34ms p(90)=4.23µs p(95)=8.97µs http_req_connecting............: avg=44.18µs min=0s med=0s max=3.31ms p(90)=0s p(95)=0s http_req_duration..............: avg=993.48ms min=104.66ms med=869.3ms max=2.93s p(90)=1.58s p(95)=1.68s { expected_response:true }...: avg=993.48ms min=104.66ms med=869.3ms max=2.93s p(90)=1.58s p(95)=1.68s http_req_failed................: 0.00% ✓ 0 ✗ 2979 http_req_receiving.............: avg=10.47ms min=37.11µs med=86.18µs max=497.59ms p(90)=1.11ms p(95)=41.06ms http_req_sending...............: avg=403.1µs min=8.06µs med=13.41µs max=67.67ms p(90)=36.43µs p(95)=182.95µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=982.6ms min=104.41ms med=863.51ms max=2.93s p(90)=1.57s p(95)=1.68s http_reqs......................: 2979 97.21094/s iteration_duration.............: avg=1.02s min=115.83ms med=893.89ms max=2.96s p(90)=1.6s p(95)=1.72s iterations.....................: 2979 97.21094/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4320 ✗ 0 data_received..................: 127 MB 4.0 MB/s data_sent......................: 1.7 MB 54 kB/s http_req_blocked...............: avg=61.76µs min=1.85µs med=4.59µs max=3.45ms p(90)=6.67µs p(95)=274.84µs http_req_connecting............: avg=46.2µs min=0s med=0s max=2.9ms p(90)=0s p(95)=175.5µs http_req_duration..............: avg=2.12s min=367.65ms med=1.7s max=22.85s p(90)=2.16s p(95)=3.4s { expected_response:true }...: avg=2.12s min=367.65ms med=1.7s max=22.85s p(90)=2.16s p(95)=3.4s http_req_failed................: 0.00% ✓ 0 ✗ 1440 http_req_receiving.............: avg=261.39µs min=60.39µs med=137.82µs max=58.19ms p(90)=196.6µs p(95)=229.88µs http_req_sending...............: avg=102.96µs min=10.65µs med=26µs max=18.44ms p(90)=42.65µs p(95)=178.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.12s min=367.37ms med=1.7s max=22.84s p(90)=2.16s p(95)=3.4s http_reqs......................: 1440 45.804645/s iteration_duration.............: avg=2.13s min=378.5ms med=1.71s max=22.87s p(90)=2.17s p(95)=3.41s iterations.....................: 1440 45.804645/s vus............................: 45 min=45 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2853 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 37 kB/s http_req_blocked...............: avg=75.59µs min=1.4µs med=3.62µs max=2.26ms p(90)=96.95µs p(95)=528.64µs http_req_connecting............: avg=62.9µs min=0s med=0s max=2.22ms p(90)=62.95µs p(95)=420.96µs http_req_duration..............: avg=3.17s min=596.33ms med=2.98s max=7.14s p(90)=4.09s p(95)=4.39s { expected_response:true }...: avg=3.17s min=596.33ms med=2.98s max=7.14s p(90)=4.09s p(95)=4.39s http_req_failed................: 0.00% ✓ 0 ✗ 951 http_req_receiving.............: avg=264.51µs min=42.11µs med=116.42µs max=65.28ms p(90)=183.01µs p(95)=257.52µs http_req_sending...............: avg=49.17µs min=7.76µs med=20.45µs max=680.53µs p(90)=49.15µs p(95)=279.51µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.17s min=596.13ms med=2.98s max=7.14s p(90)=4.09s p(95)=4.39s http_reqs......................: 951 31.084265/s iteration_duration.............: avg=3.19s min=604.85ms med=2.99s max=7.15s p(90)=4.1s p(95)=4.4s iterations.....................: 951 31.084265/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2856 ✗ 0 data_received..................: 84 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=150.01µs min=1.41µs med=3.71µs max=12ms p(90)=117.55µs p(95)=946.12µs http_req_connecting............: avg=120.89µs min=0s med=0s max=11.96ms p(90)=82.74µs p(95)=743.95µs http_req_duration..............: avg=3.21s min=1.21s med=2.98s max=6.98s p(90)=4.48s p(95)=5.28s { expected_response:true }...: avg=3.21s min=1.21s med=2.98s max=6.98s p(90)=4.48s p(95)=5.28s http_req_failed................: 0.00% ✓ 0 ✗ 952 http_req_receiving.............: avg=4.1ms min=36.18µs med=166.28µs max=496.22ms p(90)=2.98ms p(95)=18.98ms http_req_sending...............: avg=62.13µs min=8.41µs med=19.82µs max=8.38ms p(90)=59.56µs p(95)=181.96µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.2s min=1.2s med=2.98s max=6.98s p(90)=4.48s p(95)=5.28s http_reqs......................: 952 30.298492/s iteration_duration.............: avg=3.22s min=1.23s med=3s max=7s p(90)=4.5s p(95)=5.3s iterations.....................: 952 30.298492/s vus............................: 34 min=34 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 149 4550 total, 0 failed avg: 619ms, p95: 798ms ✅
wundergraph 103 3186 total, 0 failed avg: 917ms, p95: 1148ms ✅
mesh-supergraph-bun 84 2625 total, 0 failed avg: 1136ms, p95: 1636ms ✅
cosmo 80 2515 total, 0 failed avg: 1183ms, p95: 1440ms ✅
apollo-server 45 1438 total, 0 failed avg: 2115ms, p95: 2427ms ✅
mesh-supergraph 31 989 total, 0 failed avg: 3129ms, p95: 5046ms ✅
mercurius 11 449 total, 0 failed avg: 7567ms, p95: 9064ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13650 ✗ 0 data_received..................: 399 MB 13 MB/s data_sent......................: 5.4 MB 178 kB/s http_req_blocked...............: avg=30.52µs min=1.43µs med=2.91µs max=6.81ms p(90)=4.43µs p(95)=5.63µs http_req_connecting............: avg=24.58µs min=0s med=0s max=4.18ms p(90)=0s p(95)=0s http_req_duration..............: avg=619.3ms min=327.8ms med=612.47ms max=1.17s p(90)=742.99ms p(95)=797.65ms { expected_response:true }...: avg=619.3ms min=327.8ms med=612.47ms max=1.17s p(90)=742.99ms p(95)=797.65ms http_req_failed................: 0.00% ✓ 0 ✗ 4550 http_req_receiving.............: avg=7.77ms min=33.84µs med=69.3µs max=387.97ms p(90)=12.89ms p(95)=56.83ms http_req_sending...............: avg=1.12ms min=8.41µs med=13.91µs max=351.63ms p(90)=33.67µs p(95)=611.09µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=610.4ms min=327.69ms med=607.05ms max=961.04ms p(90)=727.31ms p(95)=771.14ms http_reqs......................: 4550 149.52142/s iteration_duration.............: avg=664.42ms min=336.33ms med=653.95ms max=1.23s p(90)=813.25ms p(95)=870.03ms iterations.....................: 4550 149.52142/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9558 ✗ 0 data_received..................: 280 MB 9.1 MB/s data_sent......................: 3.8 MB 123 kB/s http_req_blocked...............: avg=137.55µs min=1.39µs med=2.7µs max=119.68ms p(90)=4.24µs p(95)=8.49µs http_req_connecting............: avg=93.6µs min=0s med=0s max=7.85ms p(90)=0s p(95)=0s http_req_duration..............: avg=917.32ms min=554.45ms med=910.07ms max=1.46s p(90)=1.09s p(95)=1.14s { expected_response:true }...: avg=917.32ms min=554.45ms med=910.07ms max=1.46s p(90)=1.09s p(95)=1.14s http_req_failed................: 0.00% ✓ 0 ✗ 3186 http_req_receiving.............: avg=8.16ms min=39.7µs med=84.16µs max=321.02ms p(90)=25.9ms p(95)=59.12ms http_req_sending...............: avg=1.21ms min=7.88µs med=13.04µs max=196.44ms p(90)=40.35µs p(95)=226.71µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=907.94ms min=554.16ms med=901.87ms max=1.46s p(90)=1.07s p(95)=1.12s http_reqs......................: 3186 103.192781/s iteration_duration.............: avg=957.16ms min=565.31ms med=949.56ms max=1.47s p(90)=1.13s p(95)=1.21s iterations.....................: 3186 103.192781/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7875 ✗ 0 data_received..................: 230 MB 7.4 MB/s data_sent......................: 3.1 MB 101 kB/s http_req_blocked...............: avg=17.48µs min=1.39µs med=2.8µs max=22.32ms p(90)=4.36µs p(95)=9.78µs http_req_connecting............: avg=4.1µs min=0s med=0s max=1.01ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.13s min=525.83ms med=1.09s max=2.17s p(90)=1.47s p(95)=1.63s { expected_response:true }...: avg=1.13s min=525.83ms med=1.09s max=2.17s p(90)=1.47s p(95)=1.63s http_req_failed................: 0.00% ✓ 0 ✗ 2625 http_req_receiving.............: avg=14.4ms min=34.51µs med=87.37µs max=595.94ms p(90)=2.25ms p(95)=66.75ms http_req_sending...............: avg=349.14µs min=8.15µs med=13.81µs max=53.35ms p(90)=30.49µs p(95)=123.64µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.12s min=525.6ms med=1.08s max=2.13s p(90)=1.44s p(95)=1.61s http_reqs......................: 2625 84.852618/s iteration_duration.............: avg=1.16s min=533.15ms med=1.12s max=2.2s p(90)=1.52s p(95)=1.66s iterations.....................: 2625 84.852618/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7545 ✗ 0 data_received..................: 221 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=23.93µs min=1.31µs med=2.48µs max=6.28ms p(90)=3.85µs p(95)=9.55µs http_req_connecting............: avg=14.02µs min=0s med=0s max=1.08ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.18s min=813.76ms med=1.16s max=2s p(90)=1.34s p(95)=1.43s { expected_response:true }...: avg=1.18s min=813.76ms med=1.16s max=2s p(90)=1.34s p(95)=1.43s http_req_failed................: 0.00% ✓ 0 ✗ 2515 http_req_receiving.............: avg=12.07ms min=36.23µs med=79.75µs max=378.21ms p(90)=36.8ms p(95)=75.06ms http_req_sending...............: avg=1.18ms min=7.95µs med=12.33µs max=141.06ms p(90)=33.82µs p(95)=352.73µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.16s min=765.33ms med=1.15s max=1.62s p(90)=1.32s p(95)=1.4s http_reqs......................: 2515 80.990009/s iteration_duration.............: avg=1.21s min=823.82ms med=1.19s max=2.01s p(90)=1.38s p(95)=1.46s iterations.....................: 2515 80.990009/s vus............................: 17 min=17 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4314 ✗ 0 data_received..................: 126 MB 4.0 MB/s data_sent......................: 1.7 MB 54 kB/s http_req_blocked...............: avg=227.93µs min=1.59µs med=3.64µs max=7.17ms p(90)=5.66µs p(95)=1.34ms http_req_connecting............: avg=220.28µs min=0s med=0s max=7.06ms p(90)=0s p(95)=1.31ms http_req_duration..............: avg=2.11s min=1.09s med=1.92s max=14s p(90)=2.26s p(95)=2.42s { expected_response:true }...: avg=2.11s min=1.09s med=1.92s max=14s p(90)=2.26s p(95)=2.42s http_req_failed................: 0.00% ✓ 0 ✗ 1438 http_req_receiving.............: avg=205.55µs min=47.14µs med=119.01µs max=40.69ms p(90)=184.81µs p(95)=237.92µs http_req_sending...............: avg=51.52µs min=8.9µs med=18.71µs max=17.12ms p(90)=38.54µs p(95)=116.19µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.11s min=1.09s med=1.91s max=14s p(90)=2.26s p(95)=2.42s http_reqs......................: 1438 45.862258/s iteration_duration.............: avg=2.12s min=1.1s med=1.93s max=14.01s p(90)=2.28s p(95)=2.44s iterations.....................: 1438 45.862258/s vus............................: 6 min=6 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2967 ✗ 0 data_received..................: 87 MB 2.7 MB/s data_sent......................: 1.2 MB 37 kB/s http_req_blocked...............: avg=495.76µs min=1.38µs med=3.46µs max=23ms p(90)=110.98µs p(95)=2.6ms http_req_connecting............: avg=481.18µs min=0s med=0s max=22.96ms p(90)=80.65µs p(95)=2.43ms http_req_duration..............: avg=3.12s min=1.27s med=3.09s max=6.83s p(90)=4.46s p(95)=5.04s { expected_response:true }...: avg=3.12s min=1.27s med=3.09s max=6.83s p(90)=4.46s p(95)=5.04s http_req_failed................: 0.00% ✓ 0 ✗ 989 http_req_receiving.............: avg=3.35ms min=41.35µs med=144.4µs max=100.2ms p(90)=1.21ms p(95)=13.06ms http_req_sending...............: avg=156.88µs min=8.37µs med=18.57µs max=16.85ms p(90)=114.65µs p(95)=860.83µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.12s min=1.27s med=3.08s max=6.83s p(90)=4.46s p(95)=5.04s http_reqs......................: 989 31.041137/s iteration_duration.............: avg=3.14s min=1.28s med=3.11s max=6.84s p(90)=4.47s p(95)=5.06s iterations.....................: 989 31.041137/s vus............................: 53 min=53 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1347 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 533 kB 14 kB/s http_req_blocked...............: avg=572.39µs min=1.7µs med=3.91µs max=5.06ms p(90)=2.51ms p(95)=3.98ms http_req_connecting............: avg=518.86µs min=0s med=0s max=5.03ms p(90)=2.24ms p(95)=3.61ms http_req_duration..............: avg=7.56s min=3.05s med=7.66s max=9.29s p(90)=8.97s p(95)=9.06s { expected_response:true }...: avg=7.56s min=3.05s med=7.66s max=9.29s p(90)=8.97s p(95)=9.06s http_req_failed................: 0.00% ✓ 0 ✗ 449 http_req_receiving.............: avg=138.59µs min=70.99µs med=120.69µs max=3.04ms p(90)=188.62µs p(95)=208.45µs http_req_sending...............: avg=87.57µs min=8.39µs med=21.85µs max=666.18µs p(90)=328.55µs p(95)=524.78µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.56s min=3.05s med=7.66s max=9.29s p(90)=8.97s p(95)=9.06s http_reqs......................: 449 11.960622/s iteration_duration.............: avg=7.57s min=3.06s med=7.67s max=9.3s p(90)=8.97s p(95)=9.07s iterations.....................: 449 11.960622/s vus............................: 11 min=11 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
wundergraph 2153ms 166 11671 total, 0 failed avg: 734ms, p95: 2154ms, max: 5338ms, med: 525ms ✅
apollo-router 2351ms 170 11909 total, 0 failed avg: 807ms, p95: 2351ms, max: 6569ms, med: 569ms ✅
cosmo 2584ms 175 12293 total, 0 failed avg: 829ms, p95: 2584ms, max: 8050ms, med: 585ms ❌ 1 unexpected GraphQL errors, non-compatible response structure (1)
mesh-supergraph-bun 5424ms 118 8329 total, 0 failed avg: 2184ms, p95: 5425ms, max: 8306ms, med: 1995ms ✅
mesh-supergraph 6298ms 71 4997 total, 0 failed avg: 3784ms, p95: 6298ms, max: 8220ms, med: 3906ms ✅
apollo-server 23486ms 69 5056 total, 0 failed avg: 4125ms, p95: 23486ms, max: 44907ms, med: 2209ms ✅
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35013 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 198 kB/s http_req_blocked...............: avg=20.07ms min=1.38µs med=3.05µs max=2.85s p(90)=4.86µs p(95)=14.96µs http_req_connecting............: avg=19.16ms min=0s med=0s max=2.85s p(90)=0s p(95)=0s http_req_duration..............: avg=734.2ms min=6.08ms med=524.74ms max=5.33s p(90)=1.62s p(95)=2.15s { expected_response:true }...: avg=734.2ms min=6.08ms med=524.74ms max=5.33s p(90)=1.62s p(95)=2.15s http_req_failed................: 0.00% ✓ 0 ✗ 11671 http_req_receiving.............: avg=243.45ms min=33.88µs med=81.66µs max=4s p(90)=1.02s p(95)=1.43s http_req_sending...............: avg=41.97ms min=8.34µs med=14.17µs max=3.96s p(90)=365.11µs p(95)=98.9ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=448.78ms min=5.97ms med=349.61ms max=3.57s p(90)=961.4ms p(95)=1.19s http_reqs......................: 11671 166.716642/s iteration_duration.............: avg=1.56s min=12.12ms med=1.05s max=9.98s p(90)=3.73s p(95)=4.69s iterations.....................: 11671 166.716642/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35727 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 202 kB/s http_req_blocked...............: avg=17.98ms min=1.56µs med=3.31µs max=3.91s p(90)=5.62µs p(95)=13.58µs http_req_connecting............: avg=17.27ms min=0s med=0s max=3.91s p(90)=0s p(95)=0s http_req_duration..............: avg=807.44ms min=6.62ms med=569.46ms max=6.56s p(90)=1.87s p(95)=2.35s { expected_response:true }...: avg=807.44ms min=6.62ms med=569.46ms max=6.56s p(90)=1.87s p(95)=2.35s http_req_failed................: 0.00% ✓ 0 ✗ 11909 http_req_receiving.............: avg=249.65ms min=31.62µs med=83.11µs max=4.68s p(90)=994.17ms p(95)=1.49s http_req_sending...............: avg=32.28ms min=8.2µs med=15.6µs max=2.67s p(90)=3.53ms p(95)=94.31ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=525.5ms min=6.54ms med=432.38ms max=3.01s p(90)=1.02s p(95)=1.38s http_reqs......................: 11909 170.126025/s iteration_duration.............: avg=1.5s min=12.04ms med=1.01s max=11.48s p(90)=3.51s p(95)=4.51s iterations.....................: 11909 170.126025/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12292 / ✗ 1 ✗ valid response structure ↳ 99% — ✓ 12292 / ✗ 1 checks.........................: 99.99% ✓ 36877 ✗ 2 data_received..................: 1.1 GB 15 MB/s data_sent......................: 15 MB 208 kB/s http_req_blocked...............: avg=17.39ms min=1.27µs med=2.88µs max=4.75s p(90)=4.7µs p(95)=11.41µs http_req_connecting............: avg=16.49ms min=0s med=0s max=4.75s p(90)=0s p(95)=0s http_req_duration..............: avg=828.53ms min=6.64ms med=585.38ms max=8.05s p(90)=1.85s p(95)=2.58s { expected_response:true }...: avg=828.53ms min=6.64ms med=585.38ms max=8.05s p(90)=1.85s p(95)=2.58s http_req_failed................: 0.00% ✓ 0 ✗ 12293 http_req_receiving.............: avg=301.87ms min=26.54µs med=80.08µs max=6.37s p(90)=1.13s p(95)=1.83s http_req_sending...............: avg=39.44ms min=7.44µs med=13.48µs max=5.57s p(90)=280.99µs p(95)=79.87ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=487.2ms min=6.56ms med=398.77ms max=3.12s p(90)=977.91ms p(95)=1.18s http_reqs......................: 12293 175.551572/s iteration_duration.............: avg=1.5s min=12.29ms med=960.48ms max=11.15s p(90)=3.61s p(95)=4.86s iterations.....................: 12293 175.551572/s vus............................: 1 min=1 max=494 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24987 ✗ 0 data_received..................: 731 MB 10 MB/s data_sent......................: 9.9 MB 141 kB/s http_req_blocked...............: avg=2.22ms min=1.33µs med=3.01µs max=410.65ms p(90)=5.3µs p(95)=223.21µs http_req_connecting............: avg=2.15ms min=0s med=0s max=410.59ms p(90)=0s p(95)=149.25µs http_req_duration..............: avg=2.18s min=4.92ms med=1.99s max=8.3s p(90)=4.33s p(95)=5.42s { expected_response:true }...: avg=2.18s min=4.92ms med=1.99s max=8.3s p(90)=4.33s p(95)=5.42s http_req_failed................: 0.00% ✓ 0 ✗ 8329 http_req_receiving.............: avg=36.91ms min=37.15µs med=75.78µs max=1.52s p(90)=61.96ms p(95)=259.86ms http_req_sending...............: avg=3.45ms min=8.4µs med=14.14µs max=1.14s p(90)=127.57µs p(95)=11.14ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.14s min=4.72ms med=1.97s max=8.3s p(90)=4.27s p(95)=5.4s http_reqs......................: 8329 118.97514/s iteration_duration.............: avg=2.26s min=10.4ms med=2.05s max=8.48s p(90)=4.48s p(95)=5.49s iterations.....................: 8329 118.97514/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14991 ✗ 0 data_received..................: 438 MB 6.3 MB/s data_sent......................: 5.9 MB 85 kB/s http_req_blocked...............: avg=690.95µs min=1.29µs med=3.49µs max=366.43ms p(90)=62.18µs p(95)=415.85µs http_req_connecting............: avg=661.34µs min=0s med=0s max=366.37ms p(90)=23.81µs p(95)=353.1µs http_req_duration..............: avg=3.78s min=10.09ms med=3.9s max=8.21s p(90)=5.84s p(95)=6.29s { expected_response:true }...: avg=3.78s min=10.09ms med=3.9s max=8.21s p(90)=5.84s p(95)=6.29s http_req_failed................: 0.00% ✓ 0 ✗ 4997 http_req_receiving.............: avg=1.63ms min=37.51µs med=95.77µs max=270.57ms p(90)=1.34ms p(95)=7.43ms http_req_sending...............: avg=449.23µs min=7.62µs med=17.95µs max=99.38ms p(90)=46.43µs p(95)=98.48µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.78s min=10ms med=3.9s max=8.21s p(90)=5.84s p(95)=6.29s http_reqs......................: 4997 71.371282/s iteration_duration.............: avg=3.81s min=16.11ms med=3.94s max=8.34s p(90)=5.89s p(95)=6.34s iterations.....................: 4997 71.371282/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15168 ✗ 0 data_received..................: 444 MB 6.1 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=77.63µs min=1.34µs med=3.1µs max=33.39ms p(90)=28.46µs p(95)=300.54µs http_req_connecting............: avg=66.07µs min=0s med=0s max=33.33ms p(90)=0s p(95)=224.61µs http_req_duration..............: avg=4.12s min=80.61ms med=2.2s max=44.9s p(90)=3.37s p(95)=23.48s { expected_response:true }...: avg=4.12s min=80.61ms med=2.2s max=44.9s p(90)=3.37s p(95)=23.48s http_req_failed................: 0.00% ✓ 0 ✗ 5056 http_req_receiving.............: avg=309.01µs min=45.51µs med=115µs max=152.23ms p(90)=180.48µs p(95)=226.01µs http_req_sending...............: avg=61.73µs min=8.47µs med=15.64µs max=43.81ms p(90)=40.13µs p(95)=60.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.12s min=80.46ms med=2.2s max=44.9s p(90)=3.37s p(95)=23.48s http_reqs......................: 5056 69.135038/s iteration_duration.............: avg=4.13s min=91.8ms med=2.22s max=44.91s p(90)=3.39s p(95)=23.49s iterations.....................: 5056 69.135038/s vus............................: 15 min=15 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview