DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Update to develocity 3.18 (resource usage) #7547

Closed smola closed 2 months ago

smola commented 2 months ago

What Does This Do

Update to develocity 3.18. Includes CPU, memory and network usage graph in build scans.

Motivation

Additional Notes

Contributor Checklist

pr-commenter[bot] commented 2 months ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/develocity-3.18
git_commit_date 1725355046 1725355347
git_commit_sha 7b95d60956 302de49f77
release_version 1.40.0-SNAPSHOT~7b95d60956 1.40.0-SNAPSHOT~302de49f77
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725357812 |1725357812 | |ci_job_id |625140694 |625140694 | |ci_pipeline_id|43391886 |43391886 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~302de49f77, baseline=1.40.0-SNAPSHOT~7b95d60956 dateFormat X axisFormat %s section tracing Agent [baseline] (1.048 s) : 0, 1047644 Total [baseline] (10.365 s) : 0, 10364749 Agent [candidate] (1.05 s) : 0, 1049791 Total [candidate] (10.335 s) : 0, 10334674 section appsec Agent [baseline] (1.179 s) : 0, 1179026 Total [baseline] (10.588 s) : 0, 10587784 Agent [candidate] (1.181 s) : 0, 1180626 Total [candidate] (10.533 s) : 0, 10532754 section iast Agent [baseline] (1.172 s) : 0, 1172360 Total [baseline] (10.754 s) : 0, 10753770 Agent [candidate] (1.184 s) : 0, 1184064 Total [candidate] (10.944 s) : 0, 10944114 section profiling Agent [baseline] (1.246 s) : 0, 1245806 Total [baseline] (10.674 s) : 0, 10673918 Agent [candidate] (1.243 s) : 0, 1242750 Total [candidate] (10.496 s) : 0, 10495790 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.048 s |-| |Agent|appsec|1.179 s |131.383 ms (12.5%)| |Agent|iast|1.172 s |124.716 ms (11.9%)| |Agent|profiling|1.246 s |198.162 ms (18.9%)| |Total|tracing|10.365 s |-| |Total|appsec|10.588 s |223.035 ms (2.2%)| |Total|iast|10.754 s |389.021 ms (3.8%)| |Total|profiling|10.674 s |309.17 ms (3.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.05 s |-| |Agent|appsec|1.181 s |130.835 ms (12.5%)| |Agent|iast|1.184 s |134.273 ms (12.8%)| |Agent|profiling|1.243 s |192.959 ms (18.4%)| |Total|tracing|10.335 s |-| |Total|appsec|10.533 s |198.081 ms (1.9%)| |Total|iast|10.944 s |609.44 ms (5.9%)| |Total|profiling|10.496 s |161.117 ms (1.6%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~302de49f77, baseline=1.40.0-SNAPSHOT~7b95d60956 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (668.658 ms) : 0, 668658 BytebuddyAgent [candidate] (669.614 ms) : 0, 669614 GlobalTracer [baseline] (306.252 ms) : 0, 306252 GlobalTracer [candidate] (306.926 ms) : 0, 306926 AppSec [baseline] (51.128 ms) : 0, 51128 AppSec [candidate] (51.487 ms) : 0, 51487 Remote Config [baseline] (671.625 µs) : 0, 672 Remote Config [candidate] (689.057 µs) : 0, 689 Telemetry [baseline] (7.379 ms) : 0, 7379 Telemetry [candidate] (7.468 ms) : 0, 7468 section appsec BytebuddyAgent [baseline] (686.894 ms) : 0, 686894 BytebuddyAgent [candidate] (687.799 ms) : 0, 687799 GlobalTracer [baseline] (299.751 ms) : 0, 299751 GlobalTracer [candidate] (299.755 ms) : 0, 299755 AppSec [baseline] (158.723 ms) : 0, 158723 AppSec [candidate] (160.979 ms) : 0, 160979 IAST [baseline] (19.853 ms) : 0, 19853 IAST [candidate] (20.206 ms) : 0, 20206 Remote Config [baseline] (613.325 µs) : 0, 613 Remote Config [candidate] (609.828 µs) : 0, 610 Telemetry [baseline] (9.589 ms) : 0, 9589 Telemetry [candidate] (7.831 ms) : 0, 7831 section iast BytebuddyAgent [baseline] (779.655 ms) : 0, 779655 BytebuddyAgent [candidate] (786.951 ms) : 0, 786951 GlobalTracer [baseline] (295.592 ms) : 0, 295592 GlobalTracer [candidate] (298.584 ms) : 0, 298584 AppSec [baseline] (53.594 ms) : 0, 53594 AppSec [candidate] (53.761 ms) : 0, 53761 IAST [baseline] (21.916 ms) : 0, 21916 IAST [candidate] (23.03 ms) : 0, 23030 Remote Config [baseline] (600.264 µs) : 0, 600 Remote Config [candidate] (592.897 µs) : 0, 593 Telemetry [baseline] (7.412 ms) : 0, 7412 Telemetry [candidate] (7.425 ms) : 0, 7425 section profiling BytebuddyAgent [baseline] (663.549 ms) : 0, 663549 BytebuddyAgent [candidate] (661.684 ms) : 0, 661684 GlobalTracer [baseline] (388.506 ms) : 0, 388506 GlobalTracer [candidate] (388.009 ms) : 0, 388009 AppSec [baseline] (51.771 ms) : 0, 51771 AppSec [candidate] (51.847 ms) : 0, 51847 Remote Config [baseline] (674.915 µs) : 0, 675 Remote Config [candidate] (688.145 µs) : 0, 688 Telemetry [baseline] (7.392 ms) : 0, 7392 Telemetry [candidate] (7.317 ms) : 0, 7317 ProfilingAgent [baseline] (96.104 ms) : 0, 96104 ProfilingAgent [candidate] (95.553 ms) : 0, 95553 Profiling [baseline] (96.127 ms) : 0, 96127 Profiling [candidate] (95.576 ms) : 0, 95576 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~302de49f77, baseline=1.40.0-SNAPSHOT~7b95d60956 dateFormat X axisFormat %s section tracing Agent [baseline] (1.053 s) : 0, 1053464 Total [baseline] (8.49 s) : 0, 8490339 Agent [candidate] (1.049 s) : 0, 1048657 Total [candidate] (8.485 s) : 0, 8485316 section iast Agent [baseline] (1.172 s) : 0, 1172035 Total [baseline] (8.953 s) : 0, 8952517 Agent [candidate] (1.174 s) : 0, 1173927 Total [candidate] (8.982 s) : 0, 8981902 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.174 s) : 0, 1173697 Total [baseline] (8.95 s) : 0, 8949813 Agent [candidate] (1.174 s) : 0, 1173993 Total [candidate] (8.939 s) : 0, 8938865 section iast_TELEMETRY_OFF Agent [baseline] (1.179 s) : 0, 1178525 Total [baseline] (8.948 s) : 0, 8948405 Agent [candidate] (1.169 s) : 0, 1169463 Total [candidate] (8.937 s) : 0, 8936689 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.053 s |-| |Agent|iast|1.172 s |118.571 ms (11.3%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.174 s |120.233 ms (11.4%)| |Agent|iast_TELEMETRY_OFF|1.179 s |125.061 ms (11.9%)| |Total|tracing|8.49 s |-| |Total|iast|8.953 s |462.178 ms (5.4%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.95 s |459.475 ms (5.4%)| |Total|iast_TELEMETRY_OFF|8.948 s |458.066 ms (5.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.049 s |-| |Agent|iast|1.174 s |125.27 ms (11.9%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.174 s |125.336 ms (12.0%)| |Agent|iast_TELEMETRY_OFF|1.169 s |120.807 ms (11.5%)| |Total|tracing|8.485 s |-| |Total|iast|8.982 s |496.586 ms (5.9%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.939 s |453.549 ms (5.3%)| |Total|iast_TELEMETRY_OFF|8.937 s |451.373 ms (5.3%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~302de49f77, baseline=1.40.0-SNAPSHOT~7b95d60956 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (673.206 ms) : 0, 673206 BytebuddyAgent [candidate] (668.838 ms) : 0, 668838 GlobalTracer [baseline] (307.203 ms) : 0, 307203 GlobalTracer [candidate] (306.325 ms) : 0, 306325 AppSec [baseline] (51.334 ms) : 0, 51334 AppSec [candidate] (51.734 ms) : 0, 51734 Remote Config [baseline] (666.39 µs) : 0, 666 Remote Config [candidate] (683.5 µs) : 0, 684 Telemetry [baseline] (7.437 ms) : 0, 7437 Telemetry [candidate] (7.483 ms) : 0, 7483 section iast BytebuddyAgent [baseline] (779.087 ms) : 0, 779087 BytebuddyAgent [candidate] (780.287 ms) : 0, 780287 GlobalTracer [baseline] (295.476 ms) : 0, 295476 GlobalTracer [candidate] (295.698 ms) : 0, 295698 AppSec [baseline] (52.597 ms) : 0, 52597 AppSec [candidate] (54.496 ms) : 0, 54496 IAST [baseline] (22.655 ms) : 0, 22655 IAST [candidate] (21.075 ms) : 0, 21075 Remote Config [baseline] (584.647 µs) : 0, 585 Remote Config [candidate] (596.403 µs) : 0, 596 Telemetry [baseline] (8.037 ms) : 0, 8037 Telemetry [candidate] (8.132 ms) : 0, 8132 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (779.927 ms) : 0, 779927 BytebuddyAgent [candidate] (780.72 ms) : 0, 780720 GlobalTracer [baseline] (295.737 ms) : 0, 295737 GlobalTracer [candidate] (296.434 ms) : 0, 296434 AppSec [baseline] (53.687 ms) : 0, 53687 AppSec [candidate] (53.391 ms) : 0, 53391 IAST [baseline] (22.716 ms) : 0, 22716 IAST [candidate] (21.039 ms) : 0, 21039 Remote Config [baseline] (588.088 µs) : 0, 588 Remote Config [candidate] (587.534 µs) : 0, 588 Telemetry [baseline] (7.402 ms) : 0, 7402 Telemetry [candidate] (8.158 ms) : 0, 8158 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (782.822 ms) : 0, 782822 BytebuddyAgent [candidate] (777.135 ms) : 0, 777135 GlobalTracer [baseline] (298.427 ms) : 0, 298427 GlobalTracer [candidate] (295.603 ms) : 0, 295603 AppSec [baseline] (51.814 ms) : 0, 51814 AppSec [candidate] (51.527 ms) : 0, 51527 IAST [baseline] (23.238 ms) : 0, 23238 IAST [candidate] (22.294 ms) : 0, 22294 Remote Config [baseline] (573.936 µs) : 0, 574 Remote Config [candidate] (575.274 µs) : 0, 575 Telemetry [baseline] (7.913 ms) : 0, 7913 Telemetry [candidate] (8.721 ms) : 0, 8721 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-03T09:34:14 2024-09-03T09:41:03
git_branch master smola/develocity-3.18
git_commit_date 1725355046 1725355347
git_commit_sha 7b95d60956 302de49f77
release_version 1.40.0-SNAPSHOT~7b95d60956 1.40.0-SNAPSHOT~302de49f77
start_time 2024-09-03T09:34:01 2024-09-03T09:40:50
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725356809 |1725356809 | |ci_job_id |625140696 |625140696 | |ci_pipeline_id|43391886 |43391886 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 9 metrics, 19 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~302de49f77, baseline=1.40.0-SNAPSHOT~7b95d60956 dateFormat X axisFormat %s section baseline no_agent (370.933 µs) : 349, 392 . : milestone, 371, iast (480.132 µs) : 457, 503 . : milestone, 480, iast_FULL (554.469 µs) : 533, 576 . : milestone, 554, iast_GLOBAL (513.596 µs) : 492, 535 . : milestone, 514, iast_HARDCODED_SECRET_DISABLED (484.255 µs) : 462, 506 . : milestone, 484, iast_INACTIVE (454.02 µs) : 432, 476 . : milestone, 454, iast_TELEMETRY_OFF (474.736 µs) : 452, 497 . : milestone, 475, tracing (443.327 µs) : 422, 464 . : milestone, 443, section candidate no_agent (363.416 µs) : 344, 383 . : milestone, 363, iast (483.261 µs) : 461, 505 . : milestone, 483, iast_FULL (558.115 µs) : 537, 579 . : milestone, 558, iast_GLOBAL (506.533 µs) : 484, 529 . : milestone, 507, iast_HARDCODED_SECRET_DISABLED (483.935 µs) : 462, 506 . : milestone, 484, iast_INACTIVE (451.466 µs) : 431, 472 . : milestone, 451, iast_TELEMETRY_OFF (476.479 µs) : 454, 499 . : milestone, 476, tracing (440.014 µs) : 420, 460 . : milestone, 440, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|370.933 µs [349.37 µs, 392.496 µs]|-| |iast|480.132 µs [457.46 µs, 502.804 µs]|109.199 µs (29.4%)| |iast_FULL|554.469 µs [533.069 µs, 575.87 µs]|183.536 µs (49.5%)| |iast_GLOBAL|513.596 µs [492.478 µs, 534.714 µs]|142.663 µs (38.5%)| |iast_HARDCODED_SECRET_DISABLED|484.255 µs [462.393 µs, 506.116 µs]|113.322 µs (30.6%)| |iast_INACTIVE|454.02 µs [432.404 µs, 475.637 µs]|83.087 µs (22.4%)| |iast_TELEMETRY_OFF|474.736 µs [452.123 µs, 497.349 µs]|103.803 µs (28.0%)| |tracing|443.327 µs [422.256 µs, 464.399 µs]|72.394 µs (19.5%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|363.416 µs [343.644 µs, 383.189 µs]|-| |iast|483.261 µs [461.26 µs, 505.261 µs]|119.845 µs (33.0%)| |iast_FULL|558.115 µs [536.92 µs, 579.311 µs]|194.699 µs (53.6%)| |iast_GLOBAL|506.533 µs [484.445 µs, 528.622 µs]|143.117 µs (39.4%)| |iast_HARDCODED_SECRET_DISABLED|483.935 µs [461.578 µs, 506.291 µs]|120.519 µs (33.2%)| |iast_INACTIVE|451.466 µs [430.661 µs, 472.271 µs]|88.049 µs (24.2%)| |iast_TELEMETRY_OFF|476.479 µs [453.527 µs, 499.432 µs]|113.063 µs (31.1%)| |tracing|440.014 µs [419.792 µs, 460.236 µs]|76.598 µs (21.1%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~302de49f77, baseline=1.40.0-SNAPSHOT~7b95d60956 dateFormat X axisFormat %s section baseline no_agent (1.367 ms) : 1347, 1387 . : milestone, 1367, appsec (1.715 ms) : 1692, 1739 . : milestone, 1715, appsec_no_iast (1.733 ms) : 1710, 1757 . : milestone, 1733, iast (1.466 ms) : 1444, 1489 . : milestone, 1466, profiling (1.469 ms) : 1446, 1492 . : milestone, 1469, tracing (1.484 ms) : 1458, 1511 . : milestone, 1484, section candidate no_agent (1.34 ms) : 1320, 1359 . : milestone, 1340, appsec (1.717 ms) : 1692, 1742 . : milestone, 1717, appsec_no_iast (1.734 ms) : 1710, 1758 . : milestone, 1734, iast (1.479 ms) : 1456, 1502 . : milestone, 1479, profiling (1.488 ms) : 1464, 1512 . : milestone, 1488, tracing (1.488 ms) : 1463, 1513 . : milestone, 1488, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.367 ms [1.347 ms, 1.387 ms]|-| |appsec|1.715 ms [1.692 ms, 1.739 ms]|348.438 µs (25.5%)| |appsec_no_iast|1.733 ms [1.71 ms, 1.757 ms]|366.163 µs (26.8%)| |iast|1.466 ms [1.444 ms, 1.489 ms]|99.253 µs (7.3%)| |profiling|1.469 ms [1.446 ms, 1.492 ms]|102.294 µs (7.5%)| |tracing|1.484 ms [1.458 ms, 1.511 ms]|117.51 µs (8.6%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.34 ms [1.32 ms, 1.359 ms]|-| |appsec|1.717 ms [1.692 ms, 1.742 ms]|377.17 µs (28.2%)| |appsec_no_iast|1.734 ms [1.71 ms, 1.758 ms]|394.853 µs (29.5%)| |iast|1.479 ms [1.456 ms, 1.502 ms]|139.627 µs (10.4%)| |profiling|1.488 ms [1.464 ms, 1.512 ms]|148.614 µs (11.1%)| |tracing|1.488 ms [1.463 ms, 1.513 ms]|148.294 µs (11.1%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/develocity-3.18
git_commit_date 1725355046 1725355347
git_commit_sha 7b95d60956 302de49f77
release_version 1.40.0-SNAPSHOT~7b95d60956 1.40.0-SNAPSHOT~302de49f77
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1725357315 |1725357315 | |ci_job_id |625140698 |625140698 | |ci_pipeline_id|43391886 |43391886 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~302de49f77, baseline=1.40.0-SNAPSHOT~7b95d60956 dateFormat X axisFormat %s section baseline no_agent (14.995 s) : 14995000, 14995000 . : milestone, 14995000, appsec (15.123 s) : 15123000, 15123000 . : milestone, 15123000, iast (18.857 s) : 18857000, 18857000 . : milestone, 18857000, iast_GLOBAL (17.874 s) : 17874000, 17874000 . : milestone, 17874000, profiling (15.312 s) : 15312000, 15312000 . : milestone, 15312000, tracing (14.788 s) : 14788000, 14788000 . : milestone, 14788000, section candidate no_agent (14.949 s) : 14949000, 14949000 . : milestone, 14949000, appsec (15.263 s) : 15263000, 15263000 . : milestone, 15263000, iast (19.008 s) : 19008000, 19008000 . : milestone, 19008000, iast_GLOBAL (17.928 s) : 17928000, 17928000 . : milestone, 17928000, profiling (15.397 s) : 15397000, 15397000 . : milestone, 15397000, tracing (14.885 s) : 14885000, 14885000 . : milestone, 14885000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.995 s [14.995 s, 14.995 s]|-| |appsec|15.123 s [15.123 s, 15.123 s]|128.0 ms (0.9%)| |iast|18.857 s [18.857 s, 18.857 s]|3.862 s (25.8%)| |iast_GLOBAL|17.874 s [17.874 s, 17.874 s]|2.879 s (19.2%)| |profiling|15.312 s [15.312 s, 15.312 s]|317.0 ms (2.1%)| |tracing|14.788 s [14.788 s, 14.788 s]|-207.0 ms (-1.4%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.949 s [14.949 s, 14.949 s]|-| |appsec|15.263 s [15.263 s, 15.263 s]|314.0 ms (2.1%)| |iast|19.008 s [19.008 s, 19.008 s]|4.059 s (27.2%)| |iast_GLOBAL|17.928 s [17.928 s, 17.928 s]|2.979 s (19.9%)| |profiling|15.397 s [15.397 s, 15.397 s]|448.0 ms (3.0%)| |tracing|14.885 s [14.885 s, 14.885 s]|-64.0 ms (-0.4%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~302de49f77, baseline=1.40.0-SNAPSHOT~7b95d60956 dateFormat X axisFormat %s section baseline no_agent (1.456 ms) : 1445, 1468 . : milestone, 1456, appsec (2.222 ms) : 2186, 2257 . : milestone, 2222, iast (1.972 ms) : 1930, 2014 . : milestone, 1972, iast_GLOBAL (2.028 ms) : 1984, 2073 . : milestone, 2028, profiling (1.855 ms) : 1821, 1889 . : milestone, 1855, tracing (1.831 ms) : 1799, 1864 . : milestone, 1831, section candidate no_agent (1.463 ms) : 1452, 1475 . : milestone, 1463, appsec (2.236 ms) : 2200, 2272 . : milestone, 2236, iast (1.975 ms) : 1932, 2018 . : milestone, 1975, iast_GLOBAL (2.02 ms) : 1977, 2064 . : milestone, 2020, profiling (1.856 ms) : 1821, 1891 . : milestone, 1856, tracing (1.84 ms) : 1807, 1873 . : milestone, 1840, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.456 ms [1.445 ms, 1.468 ms]|-| |appsec|2.222 ms [2.186 ms, 2.257 ms]|765.396 µs (52.6%)| |iast|1.972 ms [1.93 ms, 2.014 ms]|515.885 µs (35.4%)| |iast_GLOBAL|2.028 ms [1.984 ms, 2.073 ms]|571.967 µs (39.3%)| |profiling|1.855 ms [1.821 ms, 1.889 ms]|399.029 µs (27.4%)| |tracing|1.831 ms [1.799 ms, 1.864 ms]|374.925 µs (25.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.463 ms [1.452 ms, 1.475 ms]|-| |appsec|2.236 ms [2.2 ms, 2.272 ms]|772.974 µs (52.8%)| |iast|1.975 ms [1.932 ms, 2.018 ms]|512.268 µs (35.0%)| |iast_GLOBAL|2.02 ms [1.977 ms, 2.064 ms]|557.404 µs (38.1%)| |profiling|1.856 ms [1.821 ms, 1.891 ms]|393.138 µs (26.9%)| |tracing|1.84 ms [1.807 ms, 1.873 ms]|376.968 µs (25.8%)|