n1ru4l / envelop

Envelop is a lightweight library allowing developers to easily develop, share, collaborate and extend their GraphQL execution layer. Envelop is the missing GraphQL plugin system.
https://envelop.dev
MIT License
785 stars 127 forks source link

fix benchmarks #2220

Closed EmrysMyrddin closed 5 months ago

EmrysMyrddin commented 5 months ago

fix benchmark because of breaking changes in K6

changeset-bot[bot] commented 5 months ago

⚠️ No Changeset found

Latest commit: decb5339a3b11e534839b71058cc90f056271238

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

github-actions[bot] commented 5 months ago
### 💻 Website Preview The latest changes are available as preview in: [https://adc47226.envelop.pages.dev](https://adc47226.envelop.pages.dev)
theguild-bot commented 5 months ago

✅ Benchmark Results

     ✓ no_errors
     ✓ expected_result

     checks.............................................: 100.00% ✓ 862988      ✗ 0     
     ✓ { mode:envelop-cache-and-no-internal-tracing }...: 100.00% ✓ 207722      ✗ 0     
     ✓ { mode:envelop-cache-jit }.......................: 100.00% ✓ 335078      ✗ 0     
     ✓ { mode:envelop-just-cache }......................: 100.00% ✓ 206062      ✗ 0     
     ✓ { mode:graphql-js }..............................: 100.00% ✓ 114126      ✗ 0     
     data_received......................................: 3.3 GB  28 MB/s
     data_sent..........................................: 188 MB  1.6 MB/s
     envelop_init.......................................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-cache-jit }.......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-just-cache }......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:graphql-js }..............................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     envelop_total......................................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-cache-jit }.......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-just-cache }......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:graphql-js }..............................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     event_loop_lag.....................................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-cache-and-no-internal-tracing }...: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-cache-jit }.......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-just-cache }......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:graphql-js }..............................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     graphql_context....................................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-cache-jit }.......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-just-cache }......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:graphql-js }..............................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     graphql_execute....................................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-cache-jit }.......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-just-cache }......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:graphql-js }..............................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     graphql_parse......................................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-cache-jit }.......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-just-cache }......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:graphql-js }..............................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     graphql_validate...................................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-cache-jit }.......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:envelop-just-cache }......................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     ✓ { mode:graphql-js }..............................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     http_req_blocked...................................: avg=1.89µs  min=691ns    med=1.69µs  max=4.72ms  p(90)=2.24µs  p(95)=2.42µs 
     http_req_connecting................................: avg=13ns    min=0s       med=0s      max=1.05ms  p(90)=0s      p(95)=0s     
     http_req_duration..................................: avg=2.5ms   min=163.62µs med=2.18ms  max=84.13ms p(90)=4.55ms  p(95)=5.01ms 
       { expected_response:true }.......................: avg=2.5ms   min=163.62µs med=2.18ms  max=84.13ms p(90)=4.55ms  p(95)=5.01ms 
     ✓ { mode:envelop-cache-and-no-internal-tracing }...: avg=2.61ms  min=386.8µs  med=2.3ms   max=15.22ms p(90)=4.52ms  p(95)=4.92ms 
     ✓ { mode:envelop-cache-jit }.......................: avg=1.5ms   min=163.62µs med=1.2ms   max=15.53ms p(90)=2.45ms  p(95)=2.62ms 
     ✓ { mode:envelop-just-cache }......................: avg=2.63ms  min=367.45µs med=2.31ms  max=39.63ms p(90)=4.53ms  p(95)=4.93ms 
     ✓ { mode:graphql-js }..............................: avg=4.99ms  min=591.61µs med=4.22ms  max=84.13ms p(90)=8.38ms  p(95)=9.06ms 
     http_req_failed....................................: 0.00%   ✓ 0           ✗ 431494
     http_req_receiving.................................: avg=31.37µs min=12.77µs  med=28.17µs max=12.35ms p(90)=41.99µs p(95)=46.73µs
     http_req_sending...................................: avg=11.8µs  min=4.44µs   med=9.99µs  max=9.57ms  p(90)=14.01µs p(95)=17.79µs
     http_req_tls_handshaking...........................: avg=0s      min=0s       med=0s      max=0s      p(90)=0s      p(95)=0s     
     http_req_waiting...................................: avg=2.46ms  min=132.68µs med=2.13ms  max=84.04ms p(90)=4.5ms   p(95)=4.96ms 
     http_reqs..........................................: 431494  3595.729474/s
     iteration_duration.................................: avg=2.77ms  min=347.15µs med=2.44ms  max=84.76ms p(90)=4.81ms  p(95)=5.31ms 
     iterations.........................................: 431494  3595.729474/s
     vus................................................: 10      min=10        max=10  
     vus_max............................................: 20      min=20        max=20