search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Update system-tests to 53d9b2c43876a39e5c0426f4df4dd5fd79d062e8 #7819

Closed smola closed 3 weeks ago

smola commented 3 weeks ago

What Does This Do

Update system-tests, including https://github.com/DataDog/system-tests/pull/3274 which was blocking parametric upgrades.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 3 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-20241021
git_commit_date 1729523359 1729523998
git_commit_sha 3fd69de6f1 89124cf61f
release_version 1.42.0-SNAPSHOT~3fd69de6f1 1.42.0-SNAPSHOT~89124cf61f
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729526257 |1729526257 | |ci_job_id |678626285 |678626285 | |ci_pipeline_id|47052647 |47052647 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 9 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~89124cf61f, baseline=1.42.0-SNAPSHOT~3fd69de6f1 dateFormat X axisFormat %s section tracing Agent [baseline] (1.087 s) : 0, 1086668 Total [baseline] (10.44 s) : 0, 10439518 Agent [candidate] (1.082 s) : 0, 1082427 Total [candidate] (10.464 s) : 0, 10463845 section appsec Agent [baseline] (1.215 s) : 0, 1215155 Total [baseline] (10.634 s) : 0, 10634061 Agent [candidate] (1.216 s) : 0, 1215800 Total [candidate] (10.627 s) : 0, 10627351 section iast Agent [baseline] (1.204 s) : 0, 1204434 Total [baseline] (10.849 s) : 0, 10849206 Agent [candidate] (1.206 s) : 0, 1206496 Total [candidate] (10.942 s) : 0, 10941508 section profiling Agent [baseline] (1.286 s) : 0, 1286282 Total [baseline] (10.744 s) : 0, 10744227 Agent [candidate] (1.276 s) : 0, 1276193 Total [candidate] (10.732 s) : 0, 10732264 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.087 s |-| |Agent|appsec|1.215 s |128.487 ms (11.8%)| |Agent|iast|1.204 s |117.766 ms (10.8%)| |Agent|profiling|1.286 s |199.614 ms (18.4%)| |Total|tracing|10.44 s |-| |Total|appsec|10.634 s |194.543 ms (1.9%)| |Total|iast|10.849 s |409.688 ms (3.9%)| |Total|profiling|10.744 s |304.709 ms (2.9%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.082 s |-| |Agent|appsec|1.216 s |133.374 ms (12.3%)| |Agent|iast|1.206 s |124.069 ms (11.5%)| |Agent|profiling|1.276 s |193.766 ms (17.9%)| |Total|tracing|10.464 s |-| |Total|appsec|10.627 s |163.506 ms (1.6%)| |Total|iast|10.942 s |477.663 ms (4.6%)| |Total|profiling|10.732 s |268.419 ms (2.6%)| ```mermaid gantt title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~89124cf61f, baseline=1.42.0-SNAPSHOT~3fd69de6f1 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (692.698 ms) : 0, 692698 BytebuddyAgent [candidate] (689.04 ms) : 0, 689040 GlobalTracer [baseline] (315.811 ms) : 0, 315811 GlobalTracer [candidate] (314.284 ms) : 0, 314284 AppSec [baseline] (54.528 ms) : 0, 54528 AppSec [candidate] (54.247 ms) : 0, 54247 Remote Config [baseline] (667.375 µs) : 0, 667 Remote Config [candidate] (664.613 µs) : 0, 665 Telemetry [baseline] (9.111 ms) : 0, 9111 Telemetry [candidate] (10.394 ms) : 0, 10394 section appsec BytebuddyAgent [baseline] (706.282 ms) : 0, 706282 BytebuddyAgent [candidate] (706.602 ms) : 0, 706602 GlobalTracer [baseline] (310.368 ms) : 0, 310368 GlobalTracer [candidate] (311.179 ms) : 0, 311179 AppSec [baseline] (165.525 ms) : 0, 165525 AppSec [candidate] (165.803 ms) : 0, 165803 IAST [baseline] (19.321 ms) : 0, 19321 IAST [candidate] (19.305 ms) : 0, 19305 Remote Config [baseline] (640.51 µs) : 0, 641 Remote Config [candidate] (637.712 µs) : 0, 638 Telemetry [baseline] (8.894 ms) : 0, 8894 Telemetry [candidate] (8.141 ms) : 0, 8141 section iast BytebuddyAgent [baseline] (802.587 ms) : 0, 802587 BytebuddyAgent [candidate] (803.994 ms) : 0, 803994 GlobalTracer [baseline] (302.271 ms) : 0, 302271 GlobalTracer [candidate] (302.528 ms) : 0, 302528 AppSec [baseline] (56.937 ms) : 0, 56937 AppSec [candidate] (57.28 ms) : 0, 57280 IAST [baseline] (21.199 ms) : 0, 21199 IAST [candidate] (21.163 ms) : 0, 21163 Remote Config [baseline] (583.175 µs) : 0, 583 Remote Config [candidate] (600.647 µs) : 0, 601 Telemetry [baseline] (7.088 ms) : 0, 7088 Telemetry [candidate] (7.1 ms) : 0, 7100 section profiling BytebuddyAgent [baseline] (685.56 ms) : 0, 685560 BytebuddyAgent [candidate] (680.993 ms) : 0, 680993 GlobalTracer [baseline] (399.541 ms) : 0, 399541 GlobalTracer [candidate] (397.114 ms) : 0, 397114 AppSec [baseline] (55.209 ms) : 0, 55209 AppSec [candidate] (54.688 ms) : 0, 54688 Remote Config [baseline] (658.13 µs) : 0, 658 Remote Config [candidate] (651.726 µs) : 0, 652 Telemetry [baseline] (14.027 ms) : 0, 14027 Telemetry [candidate] (11.763 ms) : 0, 11763 ProfilingAgent [baseline] (92.09 ms) : 0, 92090 ProfilingAgent [candidate] (92.044 ms) : 0, 92044 Profiling [baseline] (92.114 ms) : 0, 92114 Profiling [candidate] (92.067 ms) : 0, 92067 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~89124cf61f, baseline=1.42.0-SNAPSHOT~3fd69de6f1 dateFormat X axisFormat %s section tracing Agent [baseline] (1.08 s) : 0, 1080091 Total [baseline] (8.596 s) : 0, 8595887 Agent [candidate] (1.078 s) : 0, 1077893 Total [candidate] (8.581 s) : 0, 8580650 section iast Agent [baseline] (1.208 s) : 0, 1208252 Total [baseline] (9.144 s) : 0, 9144127 Agent [candidate] (1.206 s) : 0, 1206432 Total [candidate] (9.126 s) : 0, 9126176 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.204 s) : 0, 1203542 Total [baseline] (9.061 s) : 0, 9061023 Agent [candidate] (1.214 s) : 0, 1213673 Total [candidate] (9.109 s) : 0, 9109201 section iast_TELEMETRY_OFF Agent [baseline] (1.201 s) : 0, 1200612 Total [baseline] (9.114 s) : 0, 9114073 Agent [candidate] (1.221 s) : 0, 1221350 Total [candidate] (9.169 s) : 0, 9169242 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.08 s |-| |Agent|iast|1.208 s |128.161 ms (11.9%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.204 s |123.451 ms (11.4%)| |Agent|iast_TELEMETRY_OFF|1.201 s |120.52 ms (11.2%)| |Total|tracing|8.596 s |-| |Total|iast|9.144 s |548.24 ms (6.4%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.061 s |465.136 ms (5.4%)| |Total|iast_TELEMETRY_OFF|9.114 s |518.186 ms (6.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.078 s |-| |Agent|iast|1.206 s |128.539 ms (11.9%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.214 s |135.78 ms (12.6%)| |Agent|iast_TELEMETRY_OFF|1.221 s |143.457 ms (13.3%)| |Total|tracing|8.581 s |-| |Total|iast|9.126 s |545.526 ms (6.4%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.109 s |528.551 ms (6.2%)| |Total|iast_TELEMETRY_OFF|9.169 s |588.591 ms (6.9%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~89124cf61f, baseline=1.42.0-SNAPSHOT~3fd69de6f1 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (687.949 ms) : 0, 687949 BytebuddyAgent [candidate] (687.038 ms) : 0, 687038 GlobalTracer [baseline] (314.133 ms) : 0, 314133 GlobalTracer [candidate] (313.421 ms) : 0, 313421 AppSec [baseline] (54.014 ms) : 0, 54014 AppSec [candidate] (53.975 ms) : 0, 53975 Remote Config [baseline] (673.345 µs) : 0, 673 Remote Config [candidate] (678.086 µs) : 0, 678 Telemetry [baseline] (9.565 ms) : 0, 9565 Telemetry [candidate] (8.987 ms) : 0, 8987 section iast BytebuddyAgent [baseline] (804.987 ms) : 0, 804987 BytebuddyAgent [candidate] (803.529 ms) : 0, 803529 GlobalTracer [baseline] (302.684 ms) : 0, 302684 GlobalTracer [candidate] (302.653 ms) : 0, 302653 AppSec [baseline] (58.299 ms) : 0, 58299 AppSec [candidate] (58.211 ms) : 0, 58211 IAST [baseline] (20.675 ms) : 0, 20675 IAST [candidate] (20.542 ms) : 0, 20542 Remote Config [baseline] (612.701 µs) : 0, 613 Remote Config [candidate] (592.961 µs) : 0, 593 Telemetry [baseline] (7.154 ms) : 0, 7154 Telemetry [candidate] (7.093 ms) : 0, 7093 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (801.504 ms) : 0, 801504 BytebuddyAgent [candidate] (808.558 ms) : 0, 808558 GlobalTracer [baseline] (302.256 ms) : 0, 302256 GlobalTracer [candidate] (304.662 ms) : 0, 304662 AppSec [baseline] (57.029 ms) : 0, 57029 AppSec [candidate] (56.703 ms) : 0, 56703 IAST [baseline] (20.54 ms) : 0, 20540 IAST [candidate] (21.309 ms) : 0, 21309 Remote Config [baseline] (605.537 µs) : 0, 606 Remote Config [candidate] (595.437 µs) : 0, 595 Telemetry [baseline] (7.854 ms) : 0, 7854 Telemetry [candidate] (7.933 ms) : 0, 7933 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (798.668 ms) : 0, 798668 BytebuddyAgent [candidate] (813.689 ms) : 0, 813689 GlobalTracer [baseline] (302.502 ms) : 0, 302502 GlobalTracer [candidate] (307.002 ms) : 0, 307002 AppSec [baseline] (57.915 ms) : 0, 57915 AppSec [candidate] (58.463 ms) : 0, 58463 IAST [baseline] (20.129 ms) : 0, 20129 IAST [candidate] (20.422 ms) : 0, 20422 Remote Config [baseline] (602.743 µs) : 0, 603 Remote Config [candidate] (626.27 µs) : 0, 626 Telemetry [baseline] (7.013 ms) : 0, 7013 Telemetry [candidate] (7.118 ms) : 0, 7118 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-21T15:30:17 2024-10-21T15:37:12
git_branch master smola/system-tests-20241021
git_commit_date 1729523359 1729523998
git_commit_sha 3fd69de6f1 89124cf61f
release_version 1.42.0-SNAPSHOT~3fd69de6f1 1.42.0-SNAPSHOT~89124cf61f
start_time 2024-10-21T15:30:03 2024-10-21T15:36:58
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729525381 |1729525381 | |ci_job_id |678626288 |678626288 | |ci_pipeline_id|47052647 |47052647 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~89124cf61f, baseline=1.42.0-SNAPSHOT~3fd69de6f1 dateFormat X axisFormat %s section baseline no_agent (373.839 µs) : 354, 394 . : milestone, 374, iast (490.84 µs) : 469, 512 . : milestone, 491, iast_FULL (569.132 µs) : 548, 590 . : milestone, 569, iast_GLOBAL (515.962 µs) : 495, 537 . : milestone, 516, iast_HARDCODED_SECRET_DISABLED (500.799 µs) : 479, 522 . : milestone, 501, iast_INACTIVE (454.778 µs) : 434, 476 . : milestone, 455, iast_TELEMETRY_OFF (486.203 µs) : 465, 508 . : milestone, 486, tracing (451.281 µs) : 431, 472 . : milestone, 451, section candidate no_agent (377.696 µs) : 358, 397 . : milestone, 378, iast (485.958 µs) : 465, 507 . : milestone, 486, iast_FULL (569.388 µs) : 548, 591 . : milestone, 569, iast_GLOBAL (523.273 µs) : 502, 545 . : milestone, 523, iast_HARDCODED_SECRET_DISABLED (492.767 µs) : 471, 514 . : milestone, 493, iast_INACTIVE (453.691 µs) : 433, 474 . : milestone, 454, iast_TELEMETRY_OFF (485.271 µs) : 464, 507 . : milestone, 485, tracing (455.581 µs) : 434, 477 . : milestone, 456, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|373.839 µs [353.66 µs, 394.019 µs]|-| |iast|490.84 µs [469.386 µs, 512.294 µs]|117.001 µs (31.3%)| |iast_FULL|569.132 µs [547.837 µs, 590.427 µs]|195.292 µs (52.2%)| |iast_GLOBAL|515.962 µs [494.846 µs, 537.077 µs]|142.122 µs (38.0%)| |iast_HARDCODED_SECRET_DISABLED|500.799 µs [479.378 µs, 522.221 µs]|126.96 µs (34.0%)| |iast_INACTIVE|454.778 µs [434.001 µs, 475.555 µs]|80.939 µs (21.7%)| |iast_TELEMETRY_OFF|486.203 µs [464.612 µs, 507.793 µs]|112.363 µs (30.1%)| |tracing|451.281 µs [430.573 µs, 471.989 µs]|77.441 µs (20.7%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|377.696 µs [357.94 µs, 397.452 µs]|-| |iast|485.958 µs [464.827 µs, 507.089 µs]|108.262 µs (28.7%)| |iast_FULL|569.388 µs [548.028 µs, 590.749 µs]|191.692 µs (50.8%)| |iast_GLOBAL|523.273 µs [501.735 µs, 544.812 µs]|145.577 µs (38.5%)| |iast_HARDCODED_SECRET_DISABLED|492.767 µs [471.376 µs, 514.157 µs]|115.07 µs (30.5%)| |iast_INACTIVE|453.691 µs [432.903 µs, 474.478 µs]|75.994 µs (20.1%)| |iast_TELEMETRY_OFF|485.271 µs [463.821 µs, 506.72 µs]|107.574 µs (28.5%)| |tracing|455.581 µs [434.38 µs, 476.782 µs]|77.885 µs (20.6%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~89124cf61f, baseline=1.42.0-SNAPSHOT~3fd69de6f1 dateFormat X axisFormat %s section baseline no_agent (1.37 ms) : 1350, 1389 . : milestone, 1370, appsec (1.727 ms) : 1702, 1751 . : milestone, 1727, appsec_no_iast (1.707 ms) : 1683, 1732 . : milestone, 1707, iast (1.48 ms) : 1457, 1503 . : milestone, 1480, profiling (1.539 ms) : 1513, 1564 . : milestone, 1539, tracing (1.489 ms) : 1465, 1513 . : milestone, 1489, section candidate no_agent (1.343 ms) : 1323, 1362 . : milestone, 1343, appsec (1.713 ms) : 1688, 1738 . : milestone, 1713, appsec_no_iast (1.746 ms) : 1722, 1770 . : milestone, 1746, iast (1.493 ms) : 1470, 1516 . : milestone, 1493, profiling (1.506 ms) : 1482, 1530 . : milestone, 1506, tracing (1.489 ms) : 1465, 1513 . : milestone, 1489, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.37 ms [1.35 ms, 1.389 ms]|-| |appsec|1.727 ms [1.702 ms, 1.751 ms]|356.868 µs (26.1%)| |appsec_no_iast|1.707 ms [1.683 ms, 1.732 ms]|337.462 µs (24.6%)| |iast|1.48 ms [1.457 ms, 1.503 ms]|109.708 µs (8.0%)| |profiling|1.539 ms [1.513 ms, 1.564 ms]|168.691 µs (12.3%)| |tracing|1.489 ms [1.465 ms, 1.513 ms]|119.123 µs (8.7%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.343 ms [1.323 ms, 1.362 ms]|-| |appsec|1.713 ms [1.688 ms, 1.738 ms]|370.391 µs (27.6%)| |appsec_no_iast|1.746 ms [1.722 ms, 1.77 ms]|403.074 µs (30.0%)| |iast|1.493 ms [1.47 ms, 1.516 ms]|150.184 µs (11.2%)| |profiling|1.506 ms [1.482 ms, 1.53 ms]|163.594 µs (12.2%)| |tracing|1.489 ms [1.465 ms, 1.513 ms]|146.678 µs (10.9%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-20241021
git_commit_date 1729523359 1729523998
git_commit_sha 3fd69de6f1 89124cf61f
release_version 1.42.0-SNAPSHOT~3fd69de6f1 1.42.0-SNAPSHOT~89124cf61f
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1729525922 |1729525922 | |ci_job_id |678626290 |678626290 | |ci_pipeline_id|47052647 |47052647 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~89124cf61f, baseline=1.42.0-SNAPSHOT~3fd69de6f1 dateFormat X axisFormat %s section baseline no_agent (15.133 s) : 15133000, 15133000 . : milestone, 15133000, appsec (15.256 s) : 15256000, 15256000 . : milestone, 15256000, iast (18.874 s) : 18874000, 18874000 . : milestone, 18874000, iast_GLOBAL (17.959 s) : 17959000, 17959000 . : milestone, 17959000, profiling (14.704 s) : 14704000, 14704000 . : milestone, 14704000, tracing (15.382 s) : 15382000, 15382000 . : milestone, 15382000, section candidate no_agent (15.109 s) : 15109000, 15109000 . : milestone, 15109000, appsec (15.207 s) : 15207000, 15207000 . : milestone, 15207000, iast (18.904 s) : 18904000, 18904000 . : milestone, 18904000, iast_GLOBAL (18.141 s) : 18141000, 18141000 . : milestone, 18141000, profiling (15.116 s) : 15116000, 15116000 . : milestone, 15116000, tracing (14.691 s) : 14691000, 14691000 . : milestone, 14691000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.133 s [15.133 s, 15.133 s]|-| |appsec|15.256 s [15.256 s, 15.256 s]|123.0 ms (0.8%)| |iast|18.874 s [18.874 s, 18.874 s]|3.741 s (24.7%)| |iast_GLOBAL|17.959 s [17.959 s, 17.959 s]|2.826 s (18.7%)| |profiling|14.704 s [14.704 s, 14.704 s]|-429.0 ms (-2.8%)| |tracing|15.382 s [15.382 s, 15.382 s]|249.0 ms (1.6%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.109 s [15.109 s, 15.109 s]|-| |appsec|15.207 s [15.207 s, 15.207 s]|98.0 ms (0.6%)| |iast|18.904 s [18.904 s, 18.904 s]|3.795 s (25.1%)| |iast_GLOBAL|18.141 s [18.141 s, 18.141 s]|3.032 s (20.1%)| |profiling|15.116 s [15.116 s, 15.116 s]|7.0 ms (0.0%)| |tracing|14.691 s [14.691 s, 14.691 s]|-418.0 ms (-2.8%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~89124cf61f, baseline=1.42.0-SNAPSHOT~3fd69de6f1 dateFormat X axisFormat %s section baseline no_agent (1.472 ms) : 1460, 1483 . : milestone, 1472, appsec (2.325 ms) : 2284, 2366 . : milestone, 2325, iast (2.079 ms) : 2027, 2131 . : milestone, 2079, iast_GLOBAL (2.123 ms) : 2070, 2176 . : milestone, 2123, profiling (1.95 ms) : 1908, 1993 . : milestone, 1950, tracing (1.908 ms) : 1869, 1947 . : milestone, 1908, section candidate no_agent (1.476 ms) : 1464, 1487 . : milestone, 1476, appsec (2.33 ms) : 2289, 2371 . : milestone, 2330, iast (2.071 ms) : 2019, 2123 . : milestone, 2071, iast_GLOBAL (2.128 ms) : 2075, 2181 . : milestone, 2128, profiling (1.956 ms) : 1914, 1998 . : milestone, 1956, tracing (1.919 ms) : 1879, 1959 . : milestone, 1919, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.472 ms [1.46 ms, 1.483 ms]|-| |appsec|2.325 ms [2.284 ms, 2.366 ms]|853.376 µs (58.0%)| |iast|2.079 ms [2.027 ms, 2.131 ms]|607.452 µs (41.3%)| |iast_GLOBAL|2.123 ms [2.07 ms, 2.176 ms]|651.382 µs (44.3%)| |profiling|1.95 ms [1.908 ms, 1.993 ms]|478.612 µs (32.5%)| |tracing|1.908 ms [1.869 ms, 1.947 ms]|436.526 µs (29.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.476 ms [1.464 ms, 1.487 ms]|-| |appsec|2.33 ms [2.289 ms, 2.371 ms]|854.157 µs (57.9%)| |iast|2.071 ms [2.019 ms, 2.123 ms]|594.988 µs (40.3%)| |iast_GLOBAL|2.128 ms [2.075 ms, 2.181 ms]|652.228 µs (44.2%)| |profiling|1.956 ms [1.914 ms, 1.998 ms]|480.255 µs (32.5%)| |tracing|1.919 ms [1.879 ms, 1.959 ms]|443.323 µs (30.0%)|