search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Update system-tests to 39bf65e0d94278c60fdd6ff85ba668cb436467f0 #7562

Closed PerfectSlayer closed 2 months ago

PerfectSlayer commented 2 months ago

What Does This Do

This PR updates the system tests

Motivation

Ship this fix: https://github.com/DataDog/system-tests/pull/2973

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 2 months ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/system-tests
git_commit_date 1725443852 1725455025
git_commit_sha bda1e478f9 7484d3a52d
release_version 1.40.0-SNAPSHOT~bda1e478f9 1.40.0-SNAPSHOT~7484d3a52d
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725457461 |1725457461 | |ci_job_id |627073790 |627073790 | |ci_pipeline_id|43507995 |43507995 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 47 metrics, 16 unstable metrics.

Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~7484d3a52d, baseline=1.40.0-SNAPSHOT~bda1e478f9 dateFormat X axisFormat %s section tracing Agent [baseline] (1.05 s) : 0, 1049810 Total [baseline] (8.52 s) : 0, 8520150 Agent [candidate] (1.06 s) : 0, 1060347 Total [candidate] (8.511 s) : 0, 8511101 section iast Agent [baseline] (1.176 s) : 0, 1176236 Total [baseline] (8.98 s) : 0, 8979996 Agent [candidate] (1.174 s) : 0, 1173897 Total [candidate] (8.957 s) : 0, 8956747 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.177 s) : 0, 1176814 Total [baseline] (9.031 s) : 0, 9030706 Agent [candidate] (1.173 s) : 0, 1173451 Total [candidate] (8.932 s) : 0, 8931780 section iast_TELEMETRY_OFF Agent [baseline] (1.179 s) : 0, 1178611 Total [baseline] (9.018 s) : 0, 9017847 Agent [candidate] (1.182 s) : 0, 1181967 Total [candidate] (9.011 s) : 0, 9011164 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.05 s |-| |Agent|iast|1.176 s |126.426 ms (12.0%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.177 s |127.004 ms (12.1%)| |Agent|iast_TELEMETRY_OFF|1.179 s |128.8 ms (12.3%)| |Total|tracing|8.52 s |-| |Total|iast|8.98 s |459.846 ms (5.4%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.031 s |510.556 ms (6.0%)| |Total|iast_TELEMETRY_OFF|9.018 s |497.697 ms (5.8%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.06 s |-| |Agent|iast|1.174 s |113.55 ms (10.7%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.173 s |113.104 ms (10.7%)| |Agent|iast_TELEMETRY_OFF|1.182 s |121.62 ms (11.5%)| |Total|tracing|8.511 s |-| |Total|iast|8.957 s |445.646 ms (5.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.932 s |420.679 ms (4.9%)| |Total|iast_TELEMETRY_OFF|9.011 s |500.062 ms (5.9%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~7484d3a52d, baseline=1.40.0-SNAPSHOT~bda1e478f9 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (669.452 ms) : 0, 669452 BytebuddyAgent [candidate] (677.838 ms) : 0, 677838 GlobalTracer [baseline] (307.397 ms) : 0, 307397 GlobalTracer [candidate] (309.143 ms) : 0, 309143 AppSec [baseline] (51.279 ms) : 0, 51279 AppSec [candidate] (51.46 ms) : 0, 51460 Remote Config [baseline] (667.789 µs) : 0, 668 Remote Config [candidate] (684.405 µs) : 0, 684 Telemetry [baseline] (7.452 ms) : 0, 7452 Telemetry [candidate] (7.496 ms) : 0, 7496 section iast BytebuddyAgent [baseline] (781.706 ms) : 0, 781706 BytebuddyAgent [candidate] (780.895 ms) : 0, 780895 GlobalTracer [baseline] (296.689 ms) : 0, 296689 GlobalTracer [candidate] (296.389 ms) : 0, 296389 AppSec [baseline] (54.984 ms) : 0, 54984 AppSec [candidate] (53.091 ms) : 0, 53091 IAST [baseline] (20.558 ms) : 0, 20558 IAST [candidate] (22.016 ms) : 0, 22016 Remote Config [baseline] (596.486 µs) : 0, 596 Remote Config [candidate] (585.02 µs) : 0, 585 Telemetry [baseline] (8.116 ms) : 0, 8116 Telemetry [candidate] (7.323 ms) : 0, 7323 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (780.912 ms) : 0, 780912 BytebuddyAgent [candidate] (780.135 ms) : 0, 780135 GlobalTracer [baseline] (298.341 ms) : 0, 298341 GlobalTracer [candidate] (295.869 ms) : 0, 295869 AppSec [baseline] (53.075 ms) : 0, 53075 AppSec [candidate] (52.526 ms) : 0, 52526 IAST [baseline] (20.578 ms) : 0, 20578 IAST [candidate] (21.864 ms) : 0, 21864 Remote Config [baseline] (596.827 µs) : 0, 597 Remote Config [candidate] (582.797 µs) : 0, 583 Telemetry [baseline] (9.677 ms) : 0, 9677 Telemetry [candidate] (8.868 ms) : 0, 8868 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (783.141 ms) : 0, 783141 BytebuddyAgent [candidate] (785.392 ms) : 0, 785392 GlobalTracer [baseline] (297.862 ms) : 0, 297862 GlobalTracer [candidate] (299.47 ms) : 0, 299470 AppSec [baseline] (51.215 ms) : 0, 51215 AppSec [candidate] (51.694 ms) : 0, 51694 IAST [baseline] (24.829 ms) : 0, 24829 IAST [candidate] (23.085 ms) : 0, 23085 Remote Config [baseline] (580.783 µs) : 0, 581 Remote Config [candidate] (577.837 µs) : 0, 578 Telemetry [baseline] (7.274 ms) : 0, 7274 Telemetry [candidate] (7.975 ms) : 0, 7975 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~7484d3a52d, baseline=1.40.0-SNAPSHOT~bda1e478f9 dateFormat X axisFormat %s section tracing Agent [baseline] (1.05 s) : 0, 1050254 Total [baseline] (10.297 s) : 0, 10296561 Agent [candidate] (1.058 s) : 0, 1058375 Total [candidate] (10.38 s) : 0, 10379844 section appsec Agent [baseline] (1.181 s) : 0, 1181360 Total [baseline] (10.537 s) : 0, 10537425 Agent [candidate] (1.18 s) : 0, 1180289 Total [candidate] (10.538 s) : 0, 10537835 section iast Agent [baseline] (1.173 s) : 0, 1173406 Total [baseline] (10.836 s) : 0, 10836450 Agent [candidate] (1.175 s) : 0, 1174942 Total [candidate] (10.775 s) : 0, 10774517 section profiling Agent [baseline] (1.249 s) : 0, 1249039 Total [baseline] (10.582 s) : 0, 10581755 Agent [candidate] (1.247 s) : 0, 1247385 Total [candidate] (10.687 s) : 0, 10687196 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.05 s |-| |Agent|appsec|1.181 s |131.106 ms (12.5%)| |Agent|iast|1.173 s |123.151 ms (11.7%)| |Agent|profiling|1.249 s |198.785 ms (18.9%)| |Total|tracing|10.297 s |-| |Total|appsec|10.537 s |240.864 ms (2.3%)| |Total|iast|10.836 s |539.889 ms (5.2%)| |Total|profiling|10.582 s |285.194 ms (2.8%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.058 s |-| |Agent|appsec|1.18 s |121.915 ms (11.5%)| |Agent|iast|1.175 s |116.567 ms (11.0%)| |Agent|profiling|1.247 s |189.01 ms (17.9%)| |Total|tracing|10.38 s |-| |Total|appsec|10.538 s |157.991 ms (1.5%)| |Total|iast|10.775 s |394.673 ms (3.8%)| |Total|profiling|10.687 s |307.352 ms (3.0%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~7484d3a52d, baseline=1.40.0-SNAPSHOT~bda1e478f9 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (670.106 ms) : 0, 670106 BytebuddyAgent [candidate] (675.117 ms) : 0, 675117 GlobalTracer [baseline] (307.275 ms) : 0, 307275 GlobalTracer [candidate] (309.481 ms) : 0, 309481 AppSec [baseline] (51.17 ms) : 0, 51170 AppSec [candidate] (51.915 ms) : 0, 51915 Remote Config [baseline] (664.322 µs) : 0, 664 Remote Config [candidate] (671.633 µs) : 0, 672 Telemetry [baseline] (7.494 ms) : 0, 7494 Telemetry [candidate] (7.495 ms) : 0, 7495 section appsec BytebuddyAgent [baseline] (688.932 ms) : 0, 688932 BytebuddyAgent [candidate] (688.935 ms) : 0, 688935 GlobalTracer [baseline] (299.767 ms) : 0, 299767 GlobalTracer [candidate] (299.813 ms) : 0, 299813 AppSec [baseline] (160.169 ms) : 0, 160169 AppSec [candidate] (159.311 ms) : 0, 159311 IAST [baseline] (20.333 ms) : 0, 20333 IAST [candidate] (19.667 ms) : 0, 19667 Remote Config [baseline] (616.068 µs) : 0, 616 Remote Config [candidate] (616.086 µs) : 0, 616 Telemetry [baseline] (8.187 ms) : 0, 8187 Telemetry [candidate] (8.231 ms) : 0, 8231 section iast BytebuddyAgent [baseline] (779.891 ms) : 0, 779891 BytebuddyAgent [candidate] (781.08 ms) : 0, 781080 GlobalTracer [baseline] (296.474 ms) : 0, 296474 GlobalTracer [candidate] (296.743 ms) : 0, 296743 AppSec [baseline] (53.063 ms) : 0, 53063 AppSec [candidate] (53.816 ms) : 0, 53816 IAST [baseline] (21.051 ms) : 0, 21051 IAST [candidate] (21.778 ms) : 0, 21778 Remote Config [baseline] (600.756 µs) : 0, 601 Remote Config [candidate] (585.689 µs) : 0, 586 Telemetry [baseline] (8.778 ms) : 0, 8778 Telemetry [candidate] (7.344 ms) : 0, 7344 section profiling BytebuddyAgent [baseline] (665.401 ms) : 0, 665401 BytebuddyAgent [candidate] (664.393 ms) : 0, 664393 GlobalTracer [baseline] (389.484 ms) : 0, 389484 GlobalTracer [candidate] (389.11 ms) : 0, 389110 AppSec [baseline] (52.314 ms) : 0, 52314 AppSec [candidate] (52.155 ms) : 0, 52155 Remote Config [baseline] (677.197 µs) : 0, 677 Remote Config [candidate] (677.111 µs) : 0, 677 Telemetry [baseline] (7.384 ms) : 0, 7384 Telemetry [candidate] (7.372 ms) : 0, 7372 ProfilingAgent [baseline] (95.947 ms) : 0, 95947 ProfilingAgent [candidate] (95.814 ms) : 0, 95814 Profiling [baseline] (95.971 ms) : 0, 95971 Profiling [candidate] (95.837 ms) : 0, 95837 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-04T13:15:04 2024-09-04T13:21:50
git_branch master bbujon/system-tests
git_commit_date 1725443852 1725455025
git_commit_sha bda1e478f9 7484d3a52d
release_version 1.40.0-SNAPSHOT~bda1e478f9 1.40.0-SNAPSHOT~7484d3a52d
start_time 2024-09-04T13:14:51 2024-09-04T13:21:37
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725456454 |1725456454 | |ci_job_id |627073793 |627073793 | |ci_pipeline_id|43507995 |43507995 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~7484d3a52d, baseline=1.40.0-SNAPSHOT~bda1e478f9 dateFormat X axisFormat %s section baseline no_agent (364.952 µs) : 345, 385 . : milestone, 365, iast (478.225 µs) : 456, 500 . : milestone, 478, iast_FULL (544.154 µs) : 523, 565 . : milestone, 544, iast_GLOBAL (505.955 µs) : 484, 528 . : milestone, 506, iast_HARDCODED_SECRET_DISABLED (473.033 µs) : 451, 495 . : milestone, 473, iast_INACTIVE (445.053 µs) : 424, 466 . : milestone, 445, iast_TELEMETRY_OFF (465.405 µs) : 443, 488 . : milestone, 465, tracing (439.341 µs) : 418, 461 . : milestone, 439, section candidate no_agent (366.784 µs) : 347, 387 . : milestone, 367, iast (484.691 µs) : 463, 507 . : milestone, 485, iast_FULL (547.633 µs) : 527, 569 . : milestone, 548, iast_GLOBAL (501.583 µs) : 480, 523 . : milestone, 502, iast_HARDCODED_SECRET_DISABLED (481.062 µs) : 460, 503 . : milestone, 481, iast_INACTIVE (447.626 µs) : 426, 470 . : milestone, 448, iast_TELEMETRY_OFF (473.206 µs) : 451, 496 . : milestone, 473, tracing (437.226 µs) : 417, 458 . : milestone, 437, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|364.952 µs [344.888 µs, 385.016 µs]|-| |iast|478.225 µs [456.27 µs, 500.179 µs]|113.273 µs (31.0%)| |iast_FULL|544.154 µs [523.162 µs, 565.146 µs]|179.202 µs (49.1%)| |iast_GLOBAL|505.955 µs [483.993 µs, 527.918 µs]|141.003 µs (38.6%)| |iast_HARDCODED_SECRET_DISABLED|473.033 µs [451.022 µs, 495.043 µs]|108.081 µs (29.6%)| |iast_INACTIVE|445.053 µs [423.614 µs, 466.492 µs]|80.101 µs (21.9%)| |iast_TELEMETRY_OFF|465.405 µs [443.198 µs, 487.613 µs]|100.453 µs (27.5%)| |tracing|439.341 µs [418.156 µs, 460.526 µs]|74.389 µs (20.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|366.784 µs [346.687 µs, 386.882 µs]|-| |iast|484.691 µs [462.871 µs, 506.512 µs]|117.907 µs (32.1%)| |iast_FULL|547.633 µs [526.639 µs, 568.627 µs]|180.849 µs (49.3%)| |iast_GLOBAL|501.583 µs [480.104 µs, 523.062 µs]|134.799 µs (36.8%)| |iast_HARDCODED_SECRET_DISABLED|481.062 µs [459.52 µs, 502.603 µs]|114.277 µs (31.2%)| |iast_INACTIVE|447.626 µs [425.551 µs, 469.7 µs]|80.841 µs (22.0%)| |iast_TELEMETRY_OFF|473.206 µs [450.522 µs, 495.891 µs]|106.422 µs (29.0%)| |tracing|437.226 µs [416.747 µs, 457.705 µs]|70.442 µs (19.2%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~7484d3a52d, baseline=1.40.0-SNAPSHOT~bda1e478f9 dateFormat X axisFormat %s section baseline no_agent (1.334 ms) : 1315, 1354 . : milestone, 1334, appsec (1.719 ms) : 1695, 1743 . : milestone, 1719, appsec_no_iast (1.728 ms) : 1704, 1751 . : milestone, 1728, iast (1.483 ms) : 1461, 1505 . : milestone, 1483, profiling (1.488 ms) : 1465, 1512 . : milestone, 1488, tracing (1.45 ms) : 1425, 1475 . : milestone, 1450, section candidate no_agent (1.341 ms) : 1323, 1360 . : milestone, 1341, appsec (1.728 ms) : 1703, 1752 . : milestone, 1728, appsec_no_iast (1.713 ms) : 1689, 1737 . : milestone, 1713, iast (1.475 ms) : 1452, 1497 . : milestone, 1475, profiling (1.505 ms) : 1480, 1530 . : milestone, 1505, tracing (1.441 ms) : 1416, 1465 . : milestone, 1441, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.334 ms [1.315 ms, 1.354 ms]|-| |appsec|1.719 ms [1.695 ms, 1.743 ms]|384.877 µs (28.8%)| |appsec_no_iast|1.728 ms [1.704 ms, 1.751 ms]|393.611 µs (29.5%)| |iast|1.483 ms [1.461 ms, 1.505 ms]|148.949 µs (11.2%)| |profiling|1.488 ms [1.465 ms, 1.512 ms]|153.986 µs (11.5%)| |tracing|1.45 ms [1.425 ms, 1.475 ms]|115.59 µs (8.7%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.341 ms [1.323 ms, 1.36 ms]|-| |appsec|1.728 ms [1.703 ms, 1.752 ms]|386.429 µs (28.8%)| |appsec_no_iast|1.713 ms [1.689 ms, 1.737 ms]|371.734 µs (27.7%)| |iast|1.475 ms [1.452 ms, 1.497 ms]|133.215 µs (9.9%)| |profiling|1.505 ms [1.48 ms, 1.53 ms]|163.537 µs (12.2%)| |tracing|1.441 ms [1.416 ms, 1.465 ms]|99.201 µs (7.4%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/system-tests
git_commit_date 1725443852 1725455025
git_commit_sha bda1e478f9 7484d3a52d
release_version 1.40.0-SNAPSHOT~bda1e478f9 1.40.0-SNAPSHOT~7484d3a52d
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1725456979 |1725456979 | |ci_job_id |627073795 |627073795 | |ci_pipeline_id|43507995 |43507995 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~7484d3a52d, baseline=1.40.0-SNAPSHOT~bda1e478f9 dateFormat X axisFormat %s section baseline no_agent (15.377 s) : 15377000, 15377000 . : milestone, 15377000, appsec (15.431 s) : 15431000, 15431000 . : milestone, 15431000, iast (18.709 s) : 18709000, 18709000 . : milestone, 18709000, iast_GLOBAL (17.802 s) : 17802000, 17802000 . : milestone, 17802000, profiling (15.299 s) : 15299000, 15299000 . : milestone, 15299000, tracing (14.969 s) : 14969000, 14969000 . : milestone, 14969000, section candidate no_agent (15.353 s) : 15353000, 15353000 . : milestone, 15353000, appsec (15.225 s) : 15225000, 15225000 . : milestone, 15225000, iast (18.749 s) : 18749000, 18749000 . : milestone, 18749000, iast_GLOBAL (18.063 s) : 18063000, 18063000 . : milestone, 18063000, profiling (15.14 s) : 15140000, 15140000 . : milestone, 15140000, tracing (14.899 s) : 14899000, 14899000 . : milestone, 14899000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.377 s [15.377 s, 15.377 s]|-| |appsec|15.431 s [15.431 s, 15.431 s]|54.0 ms (0.4%)| |iast|18.709 s [18.709 s, 18.709 s]|3.332 s (21.7%)| |iast_GLOBAL|17.802 s [17.802 s, 17.802 s]|2.425 s (15.8%)| |profiling|15.299 s [15.299 s, 15.299 s]|-78.0 ms (-0.5%)| |tracing|14.969 s [14.969 s, 14.969 s]|-408.0 ms (-2.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.353 s [15.353 s, 15.353 s]|-| |appsec|15.225 s [15.225 s, 15.225 s]|-128.0 ms (-0.8%)| |iast|18.749 s [18.749 s, 18.749 s]|3.396 s (22.1%)| |iast_GLOBAL|18.063 s [18.063 s, 18.063 s]|2.71 s (17.7%)| |profiling|15.14 s [15.14 s, 15.14 s]|-213.0 ms (-1.4%)| |tracing|14.899 s [14.899 s, 14.899 s]|-454.0 ms (-3.0%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~7484d3a52d, baseline=1.40.0-SNAPSHOT~bda1e478f9 dateFormat X axisFormat %s section baseline no_agent (1.459 ms) : 1448, 1471 . : milestone, 1459, appsec (2.232 ms) : 2196, 2267 . : milestone, 2232, iast (1.975 ms) : 1932, 2017 . : milestone, 1975, iast_GLOBAL (2.023 ms) : 1979, 2067 . : milestone, 2023, profiling (2.337 ms) : 2088, 2585 . : milestone, 2337, tracing (1.84 ms) : 1807, 1874 . : milestone, 1840, section candidate no_agent (1.458 ms) : 1447, 1470 . : milestone, 1458, appsec (2.228 ms) : 2192, 2263 . : milestone, 2228, iast (1.977 ms) : 1933, 2020 . : milestone, 1977, iast_GLOBAL (2.028 ms) : 1985, 2072 . : milestone, 2028, profiling (1.877 ms) : 1841, 1914 . : milestone, 1877, tracing (1.844 ms) : 1810, 1877 . : milestone, 1844, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.459 ms [1.448 ms, 1.471 ms]|-| |appsec|2.232 ms [2.196 ms, 2.267 ms]|772.543 µs (52.9%)| |iast|1.975 ms [1.932 ms, 2.017 ms]|515.416 µs (35.3%)| |iast_GLOBAL|2.023 ms [1.979 ms, 2.067 ms]|564.057 µs (38.7%)| |profiling|2.337 ms [2.088 ms, 2.585 ms]|877.404 µs (60.1%)| |tracing|1.84 ms [1.807 ms, 1.874 ms]|381.141 µs (26.1%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.458 ms [1.447 ms, 1.47 ms]|-| |appsec|2.228 ms [2.192 ms, 2.263 ms]|769.43 µs (52.8%)| |iast|1.977 ms [1.933 ms, 2.02 ms]|518.143 µs (35.5%)| |iast_GLOBAL|2.028 ms [1.985 ms, 2.072 ms]|569.747 µs (39.1%)| |profiling|1.877 ms [1.841 ms, 1.914 ms]|419.003 µs (28.7%)| |tracing|1.844 ms [1.81 ms, 1.877 ms]|385.158 µs (26.4%)|