search

the-guild-org / gateways-benchmark

MIT License
43 stars 7 forks source link

Update ghcr.io/apollographql/router Docker tag to v1.42.0 #396

Closed renovate[bot] closed 6 months ago

renovate[bot] commented 6 months ago

Mend Renovate

This PR contains the following updates:

Package Update Change
ghcr.io/apollographql/router minor v1.41.1 -> v1.42.0

Release Notes

apollographql/router (ghcr.io/apollographql/router) ### [`v1.42.0`](https://togithub.com/apollographql/router/releases/tag/v1.42.0) [Compare Source](https://togithub.com/apollographql/router/compare/v1.41.1...v1.42.0) ##### 🚀 Features ##### Add headers to the JWKS download request ([Issue #​4651](https://togithub.com/apollographql/router/issues/4651)) The router supports the new `authentication.router.jwt.jwks.headers` option for setting static headers on HTTP requests to download a JWKS from an identity provider. For details, see the [JWKS configuration option](https://www.apollographql.com/docs/router/configuration/authn-jwt#jwks). By [@​Geal](https://togithub.com/Geal) in [https://github.com/apollographql/router/pull/4688](https://togithub.com/apollographql/router/pull/4688) ##### Support loading JWT from other sources ([PR #​4711](https://togithub.com/apollographql/router/pull/4711)) The router supports the new `authentication.router.jwt.sources` option. It enables cookies as an alternative source for tokens and allows multiple alternative sources. For details, see the [sources configuration option](https://www.apollographql.com/docs/router/configuration/authn-jwt#sources). By [@​Geal](https://togithub.com/Geal) in [https://github.com/apollographql/router/pull/4711](https://togithub.com/apollographql/router/pull/4711) ##### 🐛 Fixes ##### Attach `dd.trace_id` to JSON formatted log messages ([PR #​4764](https://togithub.com/apollographql/router/pull/4764)) To enable correlation between DataDog tracing and logs, `dd.trace_id` must appear as a span attribute on the root of each JSON formatted log message. Once you configure the `dd.trace_id` attribute in router.yaml, it will automatically be extracted from the root span and attached to the logs: ```yaml title="router.yaml" telemetry: instrumentation: spans: mode: spec_compliant router: attributes: dd.trace_id: true ``` By [@​BrynCooke](https://togithub.com/BrynCooke) in [https://github.com/apollographql/router/pull/4764](https://togithub.com/apollographql/router/pull/4764)

Configuration

📅 Schedule: Branch creation - At any time (no schedule defined), Automerge - At any time (no schedule defined).

🚦 Automerge: Enabled.

♻ Rebasing: Whenever PR becomes conflicted, or you tick the rebase/retry checkbox.

🔕 Ignore: Close this PR and you won't be reminded about this update again.

This PR has been generated by Mend Renovate. View repository job log here.

github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 149 4569 total, 0 failed avg: 616ms, p95: 800ms ✅
wundergraph 102 3157 total, 0 failed avg: 922ms, p95: 1163ms ✅
mesh-supergraph-bun 83 2566 total, 0 failed avg: 1157ms, p95: 1732ms ✅
cosmo 80 2511 total, 0 failed avg: 1186ms, p95: 1421ms ✅
apollo-server 45 1421 total, 0 failed avg: 2138ms, p95: 2508ms ✅
mesh-supergraph 27 882 total, 0 failed avg: 3531ms, p95: 5692ms ✅
mercurius 11 449 total, 0 failed avg: 7581ms, p95: 8957ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 13707 ✗ 0 data_received..................: 401 MB 13 MB/s data_sent......................: 5.4 MB 178 kB/s http_req_blocked...............: avg=31.37µs min=1.57µs med=2.92µs max=8.35ms p(90)=4.44µs p(95)=5.92µs http_req_connecting............: avg=22.86µs min=0s med=0s max=4.45ms p(90)=0s p(95)=0s http_req_duration..............: avg=615.88ms min=320.02ms med=606.79ms max=1.39s p(90)=737.66ms p(95)=799.85ms { expected_response:true }...: avg=615.88ms min=320.02ms med=606.79ms max=1.39s p(90)=737.66ms p(95)=799.85ms http_req_failed................: 0.00% ✓ 0 ✗ 4569 http_req_receiving.............: avg=12.59ms min=37.7µs med=73.84µs max=752.69ms p(90)=39.67ms p(95)=82.32ms http_req_sending...............: avg=1.07ms min=8.08µs med=13.79µs max=468.05ms p(90)=33.61µs p(95)=150.3µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=602.21ms min=319.92ms med=598.52ms max=966ms p(90)=720.09ms p(95)=765.03ms http_reqs......................: 4569 149.687966/s iteration_duration.............: avg=662.13ms min=326.92ms med=645.28ms max=1.57s p(90)=816.37ms p(95)=887.12ms iterations.....................: 4569 149.687966/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9471 ✗ 0 data_received..................: 277 MB 9.0 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=19.39µs min=1.57µs med=2.67µs max=17.09ms p(90)=3.85µs p(95)=7.82µs http_req_connecting............: avg=9.54µs min=0s med=0s max=1.02ms p(90)=0s p(95)=0s http_req_duration..............: avg=921.69ms min=530.25ms med=909.64ms max=1.68s p(90)=1.07s p(95)=1.16s { expected_response:true }...: avg=921.69ms min=530.25ms med=909.64ms max=1.68s p(90)=1.07s p(95)=1.16s http_req_failed................: 0.00% ✓ 0 ✗ 3157 http_req_receiving.............: avg=7.76ms min=37.47µs med=76.54µs max=234.57ms p(90)=24.56ms p(95)=60.41ms http_req_sending...............: avg=1.2ms min=8.86µs med=13.06µs max=276.03ms p(90)=34.55µs p(95)=178.03µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=912.73ms min=530.19ms med=903.08ms max=1.66s p(90)=1.06s p(95)=1.15s http_reqs......................: 3157 102.103579/s iteration_duration.............: avg=962.64ms min=540.01ms med=948.38ms max=1.78s p(90)=1.12s p(95)=1.2s iterations.....................: 3157 102.103579/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7698 ✗ 0 data_received..................: 225 MB 7.3 MB/s data_sent......................: 3.0 MB 99 kB/s http_req_blocked...............: avg=15.34µs min=1.59µs med=3.26µs max=1.74ms p(90)=5.31µs p(95)=11.31µs http_req_connecting............: avg=6.51µs min=0s med=0s max=667.36µs p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=594.35ms med=1.11s max=2.51s p(90)=1.5s p(95)=1.73s { expected_response:true }...: avg=1.15s min=594.35ms med=1.11s max=2.51s p(90)=1.5s p(95)=1.73s http_req_failed................: 0.00% ✓ 0 ✗ 2566 http_req_receiving.............: avg=15.57ms min=39.33µs med=97.93µs max=646.62ms p(90)=998.63µs p(95)=66.24ms http_req_sending...............: avg=420.87µs min=7.49µs med=16.05µs max=78.97ms p(90)=43.52µs p(95)=133.15µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=578.37ms med=1.09s max=2.34s p(90)=1.45s p(95)=1.71s http_reqs......................: 2566 83.332351/s iteration_duration.............: avg=1.18s min=605.25ms med=1.13s max=2.53s p(90)=1.53s p(95)=1.75s iterations.....................: 2566 83.332351/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7533 ✗ 0 data_received..................: 220 MB 7.1 MB/s data_sent......................: 3.0 MB 96 kB/s http_req_blocked...............: avg=32.5µs min=1.23µs med=2.52µs max=4.41ms p(90)=3.91µs p(95)=9.28µs http_req_connecting............: avg=24.83µs min=0s med=0s max=4.34ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.18s min=753.54ms med=1.18s max=1.62s p(90)=1.36s p(95)=1.42s { expected_response:true }...: avg=1.18s min=753.54ms med=1.18s max=1.62s p(90)=1.36s p(95)=1.42s http_req_failed................: 0.00% ✓ 0 ✗ 2511 http_req_receiving.............: avg=10.48ms min=38.83µs med=77.9µs max=364.04ms p(90)=40.12ms p(95)=73.81ms http_req_sending...............: avg=1.29ms min=7.9µs med=12.49µs max=291.45ms p(90)=46.01µs p(95)=422.7µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.17s min=748.19ms med=1.17s max=1.55s p(90)=1.34s p(95)=1.39s http_reqs......................: 2511 80.812623/s iteration_duration.............: avg=1.22s min=763.31ms med=1.22s max=1.68s p(90)=1.42s p(95)=1.49s iterations.....................: 2511 80.812623/s vus............................: 35 min=35 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4263 ✗ 0 data_received..................: 125 MB 4.0 MB/s data_sent......................: 1.7 MB 54 kB/s http_req_blocked...............: avg=209.26µs min=1.63µs med=3.91µs max=6.73ms p(90)=5.81µs p(95)=1.46ms http_req_connecting............: avg=192.98µs min=0s med=0s max=6.7ms p(90)=0s p(95)=1.42ms http_req_duration..............: avg=2.13s min=998.21ms med=1.94s max=14.3s p(90)=2.29s p(95)=2.5s { expected_response:true }...: avg=2.13s min=998.21ms med=1.94s max=14.3s p(90)=2.29s p(95)=2.5s http_req_failed................: 0.00% ✓ 0 ✗ 1421 http_req_receiving.............: avg=188.81µs min=52.89µs med=124µs max=17.89ms p(90)=196.64µs p(95)=249.01µs http_req_sending...............: avg=61.31µs min=9.5µs med=20.77µs max=16.93ms p(90)=39.84µs p(95)=140.18µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.13s min=997.91ms med=1.94s max=14.3s p(90)=2.29s p(95)=2.5s http_reqs......................: 1421 45.630161/s iteration_duration.............: avg=2.14s min=1s med=1.95s max=14.32s p(90)=2.3s p(95)=2.51s iterations.....................: 1421 45.630161/s vus............................: 23 min=23 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2646 ✗ 0 data_received..................: 77 MB 2.4 MB/s data_sent......................: 1.0 MB 33 kB/s http_req_blocked...............: avg=97.83µs min=1.7µs med=4.57µs max=9.46ms p(90)=157.98µs p(95)=632.17µs http_req_connecting............: avg=86.8µs min=0s med=0s max=9.43ms p(90)=103.36µs p(95)=547.91µs http_req_duration..............: avg=3.53s min=1.3s med=3.39s max=7.8s p(90)=4.9s p(95)=5.69s { expected_response:true }...: avg=3.53s min=1.3s med=3.39s max=7.8s p(90)=4.9s p(95)=5.69s http_req_failed................: 0.00% ✓ 0 ✗ 882 http_req_receiving.............: avg=3.44ms min=47.6µs med=215.13µs max=389.6ms p(90)=2.27ms p(95)=10.22ms http_req_sending...............: avg=76.1µs min=9.19µs med=25.93µs max=4.97ms p(90)=104.28µs p(95)=305.65µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.52s min=1.3s med=3.39s max=7.8s p(90)=4.9s p(95)=5.69s http_reqs......................: 882 27.474289/s iteration_duration.............: avg=3.54s min=1.31s med=3.41s max=7.81s p(90)=4.91s p(95)=5.7s iterations.....................: 882 27.474289/s vus............................: 4 min=4 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1347 ✗ 0 data_received..................: 39 MB 1.0 MB/s data_sent......................: 533 kB 14 kB/s http_req_blocked...............: avg=1.26ms min=1.7µs med=4.09µs max=15.3ms p(90)=5.46ms p(95)=10.27ms http_req_connecting............: avg=1.2ms min=0s med=0s max=15.14ms p(90)=5.14ms p(95)=10.2ms http_req_duration..............: avg=7.58s min=3.15s med=7.81s max=9.32s p(90)=8.84s p(95)=8.95s { expected_response:true }...: avg=7.58s min=3.15s med=7.81s max=9.32s p(90)=8.84s p(95)=8.95s http_req_failed................: 0.00% ✓ 0 ✗ 449 http_req_receiving.............: avg=137.1µs min=56.58µs med=122.31µs max=866.94µs p(90)=185.67µs p(95)=218.6µs http_req_sending...............: avg=497.65µs min=8.83µs med=21.72µs max=6.42ms p(90)=500.73µs p(95)=5.9ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.57s min=3.15s med=7.81s max=9.32s p(90)=8.84s p(95)=8.95s http_reqs......................: 449 11.932022/s iteration_duration.............: avg=7.58s min=3.16s med=7.82s max=9.33s p(90)=8.85s p(95)=8.96s iterations.....................: 449 11.932022/s vus............................: 12 min=12 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-over-time

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
cosmo 176 5357 total, 0 failed avg: 496ms, p95: 741ms ✅
apollo-router 166 5087 total, 0 failed avg: 523ms, p95: 716ms ✅
wundergraph 157 4801 total, 0 failed avg: 554ms, p95: 923ms ✅
mesh-supergraph-bun 98 3012 total, 0 failed avg: 983ms, p95: 1705ms ✅
apollo-server 49 1570 total, 0 failed avg: 1958ms, p95: 2187ms ✅
mercurius 32 993 total, 0 failed avg: 3086ms, p95: 4245ms ✅
mesh-supergraph 30 967 total, 0 failed avg: 3193ms, p95: 5173ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 16071 ✗ 0 data_received..................: 470 MB 16 MB/s data_sent......................: 6.4 MB 209 kB/s http_req_blocked...............: avg=25.34µs min=1.32µs med=2.64µs max=29.27ms p(90)=4.1µs p(95)=5.25µs http_req_connecting............: avg=12.2µs min=0s med=0s max=2.3ms p(90)=0s p(95)=0s http_req_duration..............: avg=496.07ms min=29.21ms med=490.53ms max=1.27s p(90)=610.93ms p(95)=741.02ms { expected_response:true }...: avg=496.07ms min=29.21ms med=490.53ms max=1.27s p(90)=610.93ms p(95)=741.02ms http_req_failed................: 0.00% ✓ 0 ✗ 5357 http_req_receiving.............: avg=33.64ms min=38.17µs med=74.58µs max=820.31ms p(90)=95.8ms p(95)=292.85ms http_req_sending...............: avg=1.9ms min=7.49µs med=12.69µs max=762.82ms p(90)=31.27µs p(95)=159.92µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=460.52ms min=26.31ms med=476.32ms max=789.77ms p(90)=555.14ms p(95)=581.04ms http_reqs......................: 5357 176.27444/s iteration_duration.............: avg=564.05ms min=44.45ms med=527.5ms max=1.64s p(90)=779.07ms p(95)=943.12ms iterations.....................: 5357 176.27444/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15261 ✗ 0 data_received..................: 446 MB 15 MB/s data_sent......................: 6.0 MB 198 kB/s http_req_blocked...............: avg=38µs min=1.4µs med=2.81µs max=72.35ms p(90)=4.52µs p(95)=5.73µs http_req_connecting............: avg=13.41µs min=0s med=0s max=6.23ms p(90)=0s p(95)=0s http_req_duration..............: avg=522.96ms min=21.62ms med=529.63ms max=2.16s p(90)=666.66ms p(95)=716.31ms { expected_response:true }...: avg=522.96ms min=21.62ms med=529.63ms max=2.16s p(90)=666.66ms p(95)=716.31ms http_req_failed................: 0.00% ✓ 0 ✗ 5087 http_req_receiving.............: avg=27.49ms min=34.52µs med=68.17µs max=1.65s p(90)=32.18ms p(95)=111.75ms http_req_sending...............: avg=1.8ms min=8.35µs med=13.73µs max=1.02s p(90)=36.21µs p(95)=155.4µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=493.66ms min=21.43ms med=518.82ms max=911.3ms p(90)=635.56ms p(95)=672.17ms http_reqs......................: 5087 166.686664/s iteration_duration.............: avg=595.25ms min=33.58ms med=569.7ms max=2.88s p(90)=764.8ms p(95)=947.67ms iterations.....................: 5087 166.686664/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14403 ✗ 0 data_received..................: 421 MB 14 MB/s data_sent......................: 5.7 MB 187 kB/s http_req_blocked...............: avg=35.75µs min=1.23µs med=2.91µs max=40.25ms p(90)=4.84µs p(95)=6.22µs http_req_connecting............: avg=15.59µs min=0s med=0s max=8.29ms p(90)=0s p(95)=0s http_req_duration..............: avg=554.45ms min=13.99ms med=538.26ms max=1.6s p(90)=824.45ms p(95)=923.45ms { expected_response:true }...: avg=554.45ms min=13.99ms med=538.26ms max=1.6s p(90)=824.45ms p(95)=923.45ms http_req_failed................: 0.00% ✓ 0 ✗ 4801 http_req_receiving.............: avg=37.34ms min=39.84µs med=88.26µs max=1.46s p(90)=92.48ms p(95)=246.03ms http_req_sending...............: avg=2.29ms min=7.83µs med=13.89µs max=1.04s p(90)=40.78µs p(95)=517.06µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=514.82ms min=13.92ms med=503.36ms max=1.28s p(90)=775.8ms p(95)=843.32ms http_reqs......................: 4801 157.900063/s iteration_duration.............: avg=629.98ms min=24.44ms med=598.76ms max=2.77s p(90)=926.59ms p(95)=1.08s iterations.....................: 4801 157.900063/s vus............................: 98 min=98 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9036 ✗ 0 data_received..................: 264 MB 8.6 MB/s data_sent......................: 3.6 MB 117 kB/s http_req_blocked...............: avg=73.06µs min=1.31µs med=2.8µs max=20.42ms p(90)=4.4µs p(95)=7.12µs http_req_connecting............: avg=56.84µs min=0s med=0s max=4.43ms p(90)=0s p(95)=0s http_req_duration..............: avg=982.65ms min=436.33ms med=866.07ms max=2.46s p(90)=1.59s p(95)=1.7s { expected_response:true }...: avg=982.65ms min=436.33ms med=866.07ms max=2.46s p(90)=1.59s p(95)=1.7s http_req_failed................: 0.00% ✓ 0 ✗ 3012 http_req_receiving.............: avg=9.32ms min=36.98µs med=90.5µs max=658.62ms p(90)=705.32µs p(95)=29.84ms http_req_sending...............: avg=329.65µs min=7.82µs med=13.53µs max=46.82ms p(90)=37.67µs p(95)=190.06µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=972.99ms min=435.9ms med=860.38ms max=2.46s p(90)=1.58s p(95)=1.69s http_reqs......................: 3012 98.30388/s iteration_duration.............: avg=1s min=452.1ms med=888.98ms max=2.55s p(90)=1.6s p(95)=1.73s iterations.....................: 3012 98.30388/s vus............................: 92 min=92 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 4710 ✗ 0 data_received..................: 138 MB 4.4 MB/s data_sent......................: 1.9 MB 59 kB/s http_req_blocked...............: avg=38.59µs min=1.43µs med=2.94µs max=3.27ms p(90)=4.82µs p(95)=175.38µs http_req_connecting............: avg=27.96µs min=0s med=0s max=3.22ms p(90)=0s p(95)=104.07µs http_req_duration..............: avg=1.95s min=626.68ms med=1.67s max=20.52s p(90)=1.93s p(95)=2.18s { expected_response:true }...: avg=1.95s min=626.68ms med=1.67s max=20.52s p(90)=1.93s p(95)=2.18s http_req_failed................: 0.00% ✓ 0 ✗ 1570 http_req_receiving.............: avg=273.96µs min=46.64µs med=121.39µs max=67.34ms p(90)=180.7µs p(95)=215.83µs http_req_sending...............: avg=67.4µs min=8.04µs med=15.68µs max=13.74ms p(90)=32.23µs p(95)=107.2µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.95s min=626.59ms med=1.67s max=20.52s p(90)=1.93s p(95)=2.18s http_reqs......................: 1570 49.853569/s iteration_duration.............: avg=1.96s min=637.38ms med=1.69s max=20.53s p(90)=1.94s p(95)=2.2s iterations.....................: 1570 49.853569/s vus............................: 51 min=51 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2979 ✗ 0 data_received..................: 87 MB 2.8 MB/s data_sent......................: 1.2 MB 38 kB/s http_req_blocked...............: avg=83.82µs min=1.66µs med=3.58µs max=7.71ms p(90)=69.46µs p(95)=379.7µs http_req_connecting............: avg=55.89µs min=0s med=0s max=7.42ms p(90)=45.19µs p(95)=329.44µs http_req_duration..............: avg=3.08s min=415.55ms med=2.9s max=7.33s p(90)=3.94s p(95)=4.24s { expected_response:true }...: avg=3.08s min=415.55ms med=2.9s max=7.33s p(90)=3.94s p(95)=4.24s http_req_failed................: 0.00% ✓ 0 ✗ 993 http_req_receiving.............: avg=364.26µs min=42.54µs med=121.64µs max=38.41ms p(90)=195.15µs p(95)=255.23µs http_req_sending...............: avg=60.11µs min=8.57µs med=19.17µs max=21.41ms p(90)=40.77µs p(95)=162.37µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.08s min=415.06ms med=2.9s max=7.33s p(90)=3.94s p(95)=4.24s http_reqs......................: 993 32.016862/s iteration_duration.............: avg=3.09s min=424.52ms med=2.91s max=7.34s p(90)=3.95s p(95)=4.25s iterations.....................: 993 32.016862/s vus............................: 7 min=7 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 2901 ✗ 0 data_received..................: 85 MB 2.7 MB/s data_sent......................: 1.1 MB 36 kB/s http_req_blocked...............: avg=106.07µs min=1.46µs med=3.63µs max=3.14ms p(90)=95.52µs p(95)=788.57µs http_req_connecting............: avg=98.19µs min=0s med=0s max=3.04ms p(90)=67.01µs p(95)=759.42µs http_req_duration..............: avg=3.19s min=1.57s med=2.99s max=6.89s p(90)=4.54s p(95)=5.17s { expected_response:true }...: avg=3.19s min=1.57s med=2.99s max=6.89s p(90)=4.54s p(95)=5.17s http_req_failed................: 0.00% ✓ 0 ✗ 967 http_req_receiving.............: avg=3.41ms min=42.96µs med=185.47µs max=77.07ms p(90)=3.29ms p(95)=14.14ms http_req_sending...............: avg=70.82µs min=8.76µs med=21.02µs max=17.53ms p(90)=48.26µs p(95)=137.94µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.18s min=1.56s med=2.99s max=6.89s p(90)=4.52s p(95)=5.13s http_reqs......................: 967 30.571607/s iteration_duration.............: avg=3.2s min=1.58s med=3s max=6.9s p(90)=4.55s p(95)=5.18s iterations.....................: 967 30.571607/s vus............................: 53 min=53 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/constant-vus-subgraphs-delay-resources

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. It's being executed with a constant amount of VUs over a fixed amount of time. It measure things like memory usage, CPU usage, average RPS. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was running 100 VUs over 30s

Comparison

Comparison
Gateway RPS ⬇️ Requests Duration Notes
apollo-router 165 5050 total, 0 failed avg: 535ms, p95: 725ms ✅
wundergraph 103 3187 total, 0 failed avg: 916ms, p95: 1126ms ✅
mesh-supergraph-bun 102 3144 total, 0 failed avg: 932ms, p95: 1303ms ✅
cosmo 82 2583 total, 0 failed avg: 1154ms, p95: 1417ms ✅
apollo-server 61 1915 total, 0 failed avg: 1590ms, p95: 2028ms ✅
mesh-supergraph 60 1866 total, 0 failed avg: 1617ms, p95: 2485ms ✅
mercurius 12 476 total, 0 failed avg: 7105ms, p95: 8344ms ✅
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15150 ✗ 0 data_received..................: 443 MB 15 MB/s data_sent......................: 6.0 MB 196 kB/s http_req_blocked...............: avg=122.24µs min=1.41µs med=2.89µs max=99.16ms p(90)=4.47µs p(95)=5.51µs http_req_connecting............: avg=96.64µs min=0s med=0s max=9.75ms p(90)=0s p(95)=0s http_req_duration..............: avg=534.53ms min=254.63ms med=522.58ms max=1.15s p(90)=676.43ms p(95)=725.36ms { expected_response:true }...: avg=534.53ms min=254.63ms med=522.58ms max=1.15s p(90)=676.43ms p(95)=725.36ms http_req_failed................: 0.00% ✓ 0 ✗ 5050 http_req_receiving.............: avg=14.23ms min=37.62µs med=76.91µs max=355.36ms p(90)=54.85ms p(95)=101.52ms http_req_sending...............: avg=1.46ms min=8.11µs med=13.84µs max=415.65ms p(90)=42.93µs p(95)=444.11µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=518.84ms min=252.92ms med=510.74ms max=933.75ms p(90)=644.83ms p(95)=689.09ms http_reqs......................: 5050 165.332399/s iteration_duration.............: avg=597.53ms min=270.38ms med=581.83ms max=1.18s p(90)=764.6ms p(95)=836.89ms iterations.....................: 5050 165.332399/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9561 ✗ 0 data_received..................: 280 MB 9.0 MB/s data_sent......................: 3.8 MB 122 kB/s http_req_blocked...............: avg=61.92µs min=1.28µs med=2.65µs max=10.16ms p(90)=4.2µs p(95)=8.2µs http_req_connecting............: avg=48.9µs min=0s med=0s max=5.32ms p(90)=0s p(95)=0s http_req_duration..............: avg=916ms min=551.99ms med=910.65ms max=1.42s p(90)=1.07s p(95)=1.12s { expected_response:true }...: avg=916ms min=551.99ms med=910.65ms max=1.42s p(90)=1.07s p(95)=1.12s http_req_failed................: 0.00% ✓ 0 ✗ 3187 http_req_receiving.............: avg=12.76ms min=40.02µs med=99.33µs max=314.05ms p(90)=47.23ms p(95)=87.39ms http_req_sending...............: avg=1.43ms min=7.85µs med=13.07µs max=157.98ms p(90)=55.6µs p(95)=1.02ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=901.8ms min=551.88ms med=900.39ms max=1.33s p(90)=1.04s p(95)=1.09s http_reqs......................: 3187 103.058112/s iteration_duration.............: avg=956.14ms min=572.21ms med=948.94ms max=1.5s p(90)=1.12s p(95)=1.18s iterations.....................: 3187 103.058112/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 9432 ✗ 0 data_received..................: 276 MB 9.0 MB/s data_sent......................: 3.7 MB 121 kB/s http_req_blocked...............: avg=161.09µs min=1.36µs med=2.98µs max=130.28ms p(90)=4.67µs p(95)=9.37µs http_req_connecting............: avg=110.56µs min=0s med=0s max=7.56ms p(90)=0s p(95)=0s http_req_duration..............: avg=931.8ms min=382.71ms med=911.02ms max=1.88s p(90)=1.2s p(95)=1.3s { expected_response:true }...: avg=931.8ms min=382.71ms med=911.02ms max=1.88s p(90)=1.2s p(95)=1.3s http_req_failed................: 0.00% ✓ 0 ✗ 3144 http_req_receiving.............: avg=14.58ms min=38.7µs med=90.7µs max=588.14ms p(90)=5.12ms p(95)=80.86ms http_req_sending...............: avg=686.78µs min=8.28µs med=14.24µs max=339.68ms p(90)=45.42µs p(95)=225.08µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=916.53ms min=382.39ms med=903.27ms max=1.62s p(90)=1.17s p(95)=1.27s http_reqs......................: 3144 102.249098/s iteration_duration.............: avg=965.69ms min=393.56ms med=941.24ms max=1.91s p(90)=1.26s p(95)=1.36s iterations.....................: 3144 102.249098/s vus............................: 100 min=100 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 7749 ✗ 0 data_received..................: 227 MB 7.3 MB/s data_sent......................: 3.1 MB 98 kB/s http_req_blocked...............: avg=73.53µs min=1.76µs med=3.2µs max=31.03ms p(90)=5.2µs p(95)=10.98µs http_req_connecting............: avg=41.97µs min=0s med=0s max=3.78ms p(90)=0s p(95)=0s http_req_duration..............: avg=1.15s min=727.63ms med=1.14s max=1.72s p(90)=1.34s p(95)=1.41s { expected_response:true }...: avg=1.15s min=727.63ms med=1.14s max=1.72s p(90)=1.34s p(95)=1.41s http_req_failed................: 0.00% ✓ 0 ✗ 2583 http_req_receiving.............: avg=9.99ms min=40.33µs med=90.24µs max=357.71ms p(90)=28.73ms p(95)=72.75ms http_req_sending...............: avg=1.58ms min=8.41µs med=15.16µs max=247.1ms p(90)=46.63µs p(95)=682.99µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.14s min=727.43ms med=1.13s max=1.6s p(90)=1.33s p(95)=1.4s http_reqs......................: 2583 82.751064/s iteration_duration.............: avg=1.19s min=739.19ms med=1.18s max=1.76s p(90)=1.39s p(95)=1.47s iterations.....................: 2583 82.751064/s vus............................: 28 min=28 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5745 ✗ 0 data_received..................: 168 MB 5.4 MB/s data_sent......................: 2.3 MB 73 kB/s http_req_blocked...............: avg=55.76µs min=1.81µs med=4.34µs max=3.71ms p(90)=5.93µs p(95)=107.18µs http_req_connecting............: avg=49.06µs min=0s med=0s max=3.67ms p(90)=0s p(95)=71.6µs http_req_duration..............: avg=1.58s min=741.6ms med=1.51s max=9.98s p(90)=1.8s p(95)=2.02s { expected_response:true }...: avg=1.58s min=741.6ms med=1.51s max=9.98s p(90)=1.8s p(95)=2.02s http_req_failed................: 0.00% ✓ 0 ✗ 1915 http_req_receiving.............: avg=236.76µs min=52.07µs med=125.24µs max=53.95ms p(90)=194.03µs p(95)=297.1µs http_req_sending...............: avg=63.19µs min=9.54µs med=24.08µs max=15.02ms p(90)=38.23µs p(95)=119.76µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.58s min=741.28ms med=1.51s max=9.98s p(90)=1.8s p(95)=2.02s http_reqs......................: 1915 61.661114/s iteration_duration.............: avg=1.6s min=748.42ms med=1.52s max=9.99s p(90)=1.82s p(95)=2.04s iterations.....................: 1915 61.661114/s vus............................: 16 min=16 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 5598 ✗ 0 data_received..................: 164 MB 5.3 MB/s data_sent......................: 2.2 MB 71 kB/s http_req_blocked...............: avg=57.58µs min=1.52µs med=4.2µs max=3.43ms p(90)=6.09µs p(95)=95.99µs http_req_connecting............: avg=45.53µs min=0s med=0s max=3.4ms p(90)=0s p(95)=65.94µs http_req_duration..............: avg=1.61s min=677.5ms med=1.5s max=4.34s p(90)=2.23s p(95)=2.48s { expected_response:true }...: avg=1.61s min=677.5ms med=1.5s max=4.34s p(90)=2.23s p(95)=2.48s http_req_failed................: 0.00% ✓ 0 ✗ 1866 http_req_receiving.............: avg=1.45ms min=45.33µs med=128.7µs max=108.05ms p(90)=1.26ms p(95)=7.84ms http_req_sending...............: avg=140.83µs min=8.84µs med=23.51µs max=29.16ms p(90)=42.41µs p(95)=146.46µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=1.61s min=677.38ms med=1.5s max=4.34s p(90)=2.23s p(95)=2.47s http_reqs......................: 1866 60.100276/s iteration_duration.............: avg=1.63s min=687.86ms med=1.53s max=4.35s p(90)=2.26s p(95)=2.51s iterations.....................: 1866 60.100276/s vus............................: 1 min=1 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mercurius` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 1428 ✗ 0 data_received..................: 42 MB 1.1 MB/s data_sent......................: 565 kB 15 kB/s http_req_blocked...............: avg=262.66µs min=1.55µs med=3.76µs max=4.7ms p(90)=836.91µs p(95)=1.79ms http_req_connecting............: avg=206.29µs min=0s med=0s max=3.29ms p(90)=697µs p(95)=1.38ms http_req_duration..............: avg=7.1s min=3.13s med=7.41s max=8.75s p(90)=8.14s p(95)=8.34s { expected_response:true }...: avg=7.1s min=3.13s med=7.41s max=8.75s p(90)=8.14s p(95)=8.34s http_req_failed................: 0.00% ✓ 0 ✗ 476 http_req_receiving.............: avg=139.87µs min=66µs med=125.88µs max=673.24µs p(90)=186.03µs p(95)=221.5µs http_req_sending...............: avg=161.34µs min=9.2µs med=20.89µs max=2.5ms p(90)=377.85µs p(95)=1.28ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=7.1s min=3.13s med=7.41s max=8.75s p(90)=8.14s p(95)=8.34s http_reqs......................: 476 12.729695/s iteration_duration.............: avg=7.11s min=3.13s med=7.42s max=8.76s p(90)=8.15s p(95)=8.35s iterations.....................: 476 12.729695/s vus............................: 10 min=10 max=100 vus_max........................: 100 min=100 max=100 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
github-actions[bot] commented 6 months ago

Overview for: federation-v1/ramping-vus

This scenario runs 4 subgraphs and a GraphQL gateway with Federation v1 spec, and runs a heavy query. We are running a heavy load of concurrent VUs to measure response time and other stats, during stress. It measure things like memory usage, CPU usage, response times. It also includes a summary of the entire execution, and metrics information about HTTP execution times.

This scenario was trying to reach 500 concurrent VUs over 60s

Comparison

Comparison
Gateway duration(p95)⬇️ RPS Requests Durations Notes
cosmo 2207ms 176 12363 total, 0 failed avg: 756ms, p95: 2207ms, max: 6897ms, med: 538ms ❌ 3 unexpected GraphQL errors, non-compatible response structure (3)
apollo-router 2491ms 172 12070 total, 0 failed avg: 835ms, p95: 2492ms, max: 7062ms, med: 523ms ✅
wundergraph 2507ms 167 11702 total, 0 failed avg: 792ms, p95: 2508ms, max: 5282ms, med: 519ms ✅
mesh-supergraph-bun 5365ms 114 8039 total, 0 failed avg: 2283ms, p95: 5366ms, max: 9126ms, med: 2079ms ✅
mesh-supergraph 6518ms 69 4871 total, 0 failed avg: 3924ms, p95: 6519ms, max: 7842ms, med: 3995ms ✅
apollo-server 23411ms 68 5043 total, 0 failed avg: 4138ms, p95: 23411ms, max: 44918ms, med: 2212ms ✅
Summary for: `cosmo` **K6 Output** ``` ✓ response code was 200 ✗ no graphql errors ↳ 99% — ✓ 12360 / ✗ 3 ✗ valid response structure ↳ 99% — ✓ 12360 / ✗ 3 checks.........................: 99.98% ✓ 37083 ✗ 6 data_received..................: 1.1 GB 16 MB/s data_sent......................: 15 MB 210 kB/s http_req_blocked...............: avg=16.5ms min=1.49µs med=2.82µs max=3.03s p(90)=4.21µs p(95)=10.93µs http_req_connecting............: avg=15.51ms min=0s med=0s max=3.03s p(90)=0s p(95)=0s http_req_duration..............: avg=756.16ms min=6.76ms med=537.57ms max=6.89s p(90)=1.71s p(95)=2.2s { expected_response:true }...: avg=756.16ms min=6.76ms med=537.57ms max=6.89s p(90)=1.71s p(95)=2.2s http_req_failed................: 0.00% ✓ 0 ✗ 12363 http_req_receiving.............: avg=251.62ms min=23.78µs med=72.22µs max=6.16s p(90)=1.02s p(95)=1.54s http_req_sending...............: avg=33.26ms min=7.67µs med=13.31µs max=4.03s p(90)=215.24µs p(95)=102.03ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=471.27ms min=6.68ms med=364.2ms max=3.08s p(90)=1s p(95)=1.25s http_reqs......................: 12363 176.6061/s iteration_duration.............: avg=1.47s min=13.47ms med=1.03s max=13.59s p(90)=3.38s p(95)=4.43s iterations.....................: 12363 176.6061/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-router` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 36210 ✗ 0 data_received..................: 1.1 GB 15 MB/s data_sent......................: 14 MB 205 kB/s http_req_blocked...............: avg=14.35ms min=1.39µs med=3.14µs max=4.75s p(90)=5.17µs p(95)=12.73µs http_req_connecting............: avg=13.59ms min=0s med=0s max=4.55s p(90)=0s p(95)=0s http_req_duration..............: avg=835.44ms min=6.38ms med=522.71ms max=7.06s p(90)=1.95s p(95)=2.49s { expected_response:true }...: avg=835.44ms min=6.38ms med=522.71ms max=7.06s p(90)=1.95s p(95)=2.49s http_req_failed................: 0.00% ✓ 0 ✗ 12070 http_req_receiving.............: avg=301.03ms min=30.13µs med=79.01µs max=5.59s p(90)=1.15s p(95)=1.77s http_req_sending...............: avg=32.55ms min=7.77µs med=14.92µs max=4.31s p(90)=307.5µs p(95)=65.72ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=501.84ms min=6.29ms med=370.49ms max=3.35s p(90)=1.07s p(95)=1.4s http_reqs......................: 12070 172.421911/s iteration_duration.............: avg=1.48s min=11.92ms med=927.66ms max=11.27s p(90)=3.68s p(95)=4.73s iterations.....................: 12070 172.421911/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `wundergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 35106 ✗ 0 data_received..................: 1.0 GB 15 MB/s data_sent......................: 14 MB 198 kB/s http_req_blocked...............: avg=19.75ms min=1.24µs med=2.95µs max=3.77s p(90)=4.44µs p(95)=12.06µs http_req_connecting............: avg=18.48ms min=0s med=0s max=3.77s p(90)=0s p(95)=0s http_req_duration..............: avg=792.11ms min=5.97ms med=518.94ms max=5.28s p(90)=1.96s p(95)=2.5s { expected_response:true }...: avg=792.11ms min=5.97ms med=518.94ms max=5.28s p(90)=1.96s p(95)=2.5s http_req_failed................: 0.00% ✓ 0 ✗ 11702 http_req_receiving.............: avg=319.39ms min=26.37µs med=78.98µs max=4.62s p(90)=1.28s p(95)=1.92s http_req_sending...............: avg=35.26ms min=7.96µs med=13.69µs max=4.46s p(90)=1.41ms p(95)=87.55ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=437.45ms min=5.85ms med=313.74ms max=2.29s p(90)=950.07ms p(95)=1.15s http_reqs......................: 11702 167.164556/s iteration_duration.............: avg=1.59s min=11.35ms med=1.09s max=14.15s p(90)=3.72s p(95)=4.73s iterations.....................: 11702 167.164556/s vus............................: 1 min=1 max=498 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph-bun` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 24117 ✗ 0 data_received..................: 705 MB 10 MB/s data_sent......................: 9.5 MB 136 kB/s http_req_blocked...............: avg=2.1ms min=1.52µs med=3.54µs max=446.09ms p(90)=6.39µs p(95)=227.39µs http_req_connecting............: avg=2.05ms min=0s med=0s max=445.98ms p(90)=0s p(95)=152µs http_req_duration..............: avg=2.28s min=5.36ms med=2.07s max=9.12s p(90)=4.47s p(95)=5.36s { expected_response:true }...: avg=2.28s min=5.36ms med=2.07s max=9.12s p(90)=4.47s p(95)=5.36s http_req_failed................: 0.00% ✓ 0 ✗ 8039 http_req_receiving.............: avg=30.72ms min=36.97µs med=84.09µs max=1.49s p(90)=60.7ms p(95)=230.38ms http_req_sending...............: avg=3.03ms min=8.77µs med=16.53µs max=597.75ms p(90)=76.89µs p(95)=9.61ms http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=2.24s min=5.14ms med=2.04s max=9.08s p(90)=4.38s p(95)=5.22s http_reqs......................: 8039 114.827834/s iteration_duration.............: avg=2.35s min=10.98ms med=2.13s max=9.7s p(90)=4.61s p(95)=5.51s iterations.....................: 8039 114.827834/s vus............................: 1 min=1 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `mesh-supergraph` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 14613 ✗ 0 data_received..................: 427 MB 6.1 MB/s data_sent......................: 5.8 MB 83 kB/s http_req_blocked...............: avg=448.04µs min=1.35µs med=4.1µs max=116.26ms p(90)=166.97µs p(95)=404.67µs http_req_connecting............: avg=428.27µs min=0s med=0s max=116.19ms p(90)=106.24µs p(95)=335.23µs http_req_duration..............: avg=3.92s min=15.06ms med=3.99s max=7.84s p(90)=6.3s p(95)=6.51s { expected_response:true }...: avg=3.92s min=15.06ms med=3.99s max=7.84s p(90)=6.3s p(95)=6.51s http_req_failed................: 0.00% ✓ 0 ✗ 4871 http_req_receiving.............: avg=3.75ms min=39.19µs med=104.88µs max=430ms p(90)=993.59µs p(95)=9.76ms http_req_sending...............: avg=447.96µs min=7.92µs med=22.46µs max=64.66ms p(90)=53.79µs p(95)=135.9µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=3.91s min=14.96ms med=3.99s max=7.84s p(90)=6.29s p(95)=6.5s http_reqs......................: 4871 69.554244/s iteration_duration.............: avg=3.95s min=23.87ms med=4.03s max=7.97s p(90)=6.34s p(95)=6.58s iterations.....................: 4871 69.554244/s vus............................: 1 min=1 max=499 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview
Summary for: `apollo-server` **K6 Output** ``` ✓ response code was 200 ✓ no graphql errors ✓ valid response structure checks.........................: 100.00% ✓ 15129 ✗ 0 data_received..................: 443 MB 6.1 MB/s data_sent......................: 6.0 MB 82 kB/s http_req_blocked...............: avg=102.72µs min=1.48µs med=3.51µs max=47.05ms p(90)=41.07µs p(95)=312.66µs http_req_connecting............: avg=92.32µs min=0s med=0s max=46.98ms p(90)=0s p(95)=239.76µs http_req_duration..............: avg=4.13s min=91.61ms med=2.21s max=44.91s p(90)=3.47s p(95)=23.41s { expected_response:true }...: avg=4.13s min=91.61ms med=2.21s max=44.91s p(90)=3.47s p(95)=23.41s http_req_failed................: 0.00% ✓ 0 ✗ 5043 http_req_receiving.............: avg=366.13µs min=47.61µs med=118.18µs max=238.76ms p(90)=183.45µs p(95)=232.08µs http_req_sending...............: avg=47.48µs min=8.42µs med=18.27µs max=20.2ms p(90)=43.21µs p(95)=64.61µs http_req_tls_handshaking.......: avg=0s min=0s med=0s max=0s p(90)=0s p(95)=0s http_req_waiting...............: avg=4.13s min=91.5ms med=2.21s max=44.91s p(90)=3.47s p(95)=23.41s http_reqs......................: 5043 68.859562/s iteration_duration.............: avg=4.15s min=99.57ms med=2.22s max=44.92s p(90)=3.48s p(95)=23.42s iterations.....................: 5043 68.859562/s vus............................: 22 min=22 max=500 vus_max........................: 500 min=500 max=500 ``` **Performance Overview** Performance Overview **Subgraphs Overview** Subgraphs Overview **HTTP Overview** HTTP Overview