search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
573 stars 284 forks source link

Add test case names to CI spec tests #7693

Open nikita-tkachenko-datadog opened 2 hours ago

nikita-tkachenko-datadog commented 2 hours ago

What Does This Do

Updates CI spec tests to have human-readable test names.

Motivation

CI spec tests are based on test fixtures that are generated automatically. When a test case fails, it is not always easy to determine which exact test fixture failed. Adding human readable names makes debugging test failures easier.

Contributor Checklist

Jira ticket: SDTEST-958

pr-commenter[bot] commented 2 hours ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/ci-spec-tests-update
git_commit_date 1727691229 1727703592
git_commit_sha 70ac474684 d0c45a80cd
release_version 1.40.0-SNAPSHOT~70ac474684 1.41.0-SNAPSHOT~d0c45a80cd
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727706360 |1727706360 | |ci_job_id |655559126 |655559126 | |ci_pipeline_id|45417420 |45417420 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section tracing Agent [baseline] (1.065 s) : 0, 1064641 Total [baseline] (10.361 s) : 0, 10361149 Agent [candidate] (1.068 s) : 0, 1067756 Total [candidate] (10.335 s) : 0, 10334985 section appsec Agent [baseline] (1.198 s) : 0, 1198013 Total [baseline] (10.572 s) : 0, 10572421 Agent [candidate] (1.212 s) : 0, 1212301 Total [candidate] (10.554 s) : 0, 10554076 section iast Agent [baseline] (1.195 s) : 0, 1195012 Total [baseline] (10.829 s) : 0, 10828713 Agent [candidate] (1.193 s) : 0, 1193007 Total [candidate] (10.808 s) : 0, 10807855 section profiling Agent [baseline] (1.275 s) : 0, 1274553 Total [baseline] (10.731 s) : 0, 10731117 Agent [candidate] (1.265 s) : 0, 1265277 Total [candidate] (10.577 s) : 0, 10576932 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.065 s |-| |Agent|appsec|1.198 s |133.372 ms (12.5%)| |Agent|iast|1.195 s |130.371 ms (12.2%)| |Agent|profiling|1.275 s |209.912 ms (19.7%)| |Total|tracing|10.361 s |-| |Total|appsec|10.572 s |211.272 ms (2.0%)| |Total|iast|10.829 s |467.564 ms (4.5%)| |Total|profiling|10.731 s |369.968 ms (3.6%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.068 s |-| |Agent|appsec|1.212 s |144.545 ms (13.5%)| |Agent|iast|1.193 s |125.251 ms (11.7%)| |Agent|profiling|1.265 s |197.52 ms (18.5%)| |Total|tracing|10.335 s |-| |Total|appsec|10.554 s |219.091 ms (2.1%)| |Total|iast|10.808 s |472.87 ms (4.6%)| |Total|profiling|10.577 s |241.947 ms (2.3%)| ```mermaid gantt title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (679.853 ms) : 0, 679853 BytebuddyAgent [candidate] (681.929 ms) : 0, 681929 GlobalTracer [baseline] (309.209 ms) : 0, 309209 GlobalTracer [candidate] (310.167 ms) : 0, 310167 AppSec [baseline] (53.799 ms) : 0, 53799 AppSec [candidate] (53.712 ms) : 0, 53712 Remote Config [baseline] (655.011 µs) : 0, 655 Remote Config [candidate] (662.291 µs) : 0, 662 Telemetry [baseline] (7.544 ms) : 0, 7544 Telemetry [candidate] (7.64 ms) : 0, 7640 section appsec BytebuddyAgent [baseline] (696.927 ms) : 0, 696927 BytebuddyAgent [candidate] (704.483 ms) : 0, 704483 GlobalTracer [baseline] (306.116 ms) : 0, 306116 GlobalTracer [candidate] (309.439 ms) : 0, 309439 AppSec [baseline] (161.809 ms) : 0, 161809 AppSec [candidate] (163.684 ms) : 0, 163684 Remote Config [baseline] (634.184 µs) : 0, 634 Remote Config [candidate] (645.53 µs) : 0, 646 Telemetry [baseline] (8.173 ms) : 0, 8173 Telemetry [candidate] (9.312 ms) : 0, 9312 IAST [baseline] (21.511 ms) : 0, 21511 IAST [candidate] (21.981 ms) : 0, 21981 section iast BytebuddyAgent [baseline] (796.456 ms) : 0, 796456 BytebuddyAgent [candidate] (794.873 ms) : 0, 794873 GlobalTracer [baseline] (299.247 ms) : 0, 299247 GlobalTracer [candidate] (299.034 ms) : 0, 299034 AppSec [baseline] (55.283 ms) : 0, 55283 AppSec [candidate] (54.228 ms) : 0, 54228 Remote Config [baseline] (608.872 µs) : 0, 609 Remote Config [candidate] (609.99 µs) : 0, 610 Telemetry [baseline] (7.024 ms) : 0, 7024 Telemetry [candidate] (7.009 ms) : 0, 7009 IAST [baseline] (22.729 ms) : 0, 22729 IAST [candidate] (23.6 ms) : 0, 23600 section profiling BytebuddyAgent [baseline] (679.961 ms) : 0, 679961 BytebuddyAgent [candidate] (674.906 ms) : 0, 674906 GlobalTracer [baseline] (395.163 ms) : 0, 395163 GlobalTracer [candidate] (392.756 ms) : 0, 392756 AppSec [baseline] (54.899 ms) : 0, 54899 AppSec [candidate] (54.301 ms) : 0, 54301 Remote Config [baseline] (664.291 µs) : 0, 664 Remote Config [candidate] (660.08 µs) : 0, 660 Telemetry [baseline] (7.537 ms) : 0, 7537 Telemetry [candidate] (7.37 ms) : 0, 7370 ProfilingAgent [baseline] (97.501 ms) : 0, 97501 ProfilingAgent [candidate] (96.743 ms) : 0, 96743 Profiling [baseline] (97.525 ms) : 0, 97525 Profiling [candidate] (96.766 ms) : 0, 96766 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section tracing Agent [baseline] (1.066 s) : 0, 1065535 Total [baseline] (8.526 s) : 0, 8525955 Agent [candidate] (1.067 s) : 0, 1066726 Total [candidate] (8.541 s) : 0, 8541378 section iast Agent [baseline] (1.193 s) : 0, 1193442 Total [baseline] (9.057 s) : 0, 9056804 Agent [candidate] (1.21 s) : 0, 1210221 Total [candidate] (9.109 s) : 0, 9108520 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.202 s) : 0, 1201778 Total [baseline] (9.078 s) : 0, 9077764 Agent [candidate] (1.192 s) : 0, 1192394 Total [candidate] (9.04 s) : 0, 9039915 section iast_TELEMETRY_OFF Agent [baseline] (1.189 s) : 0, 1188507 Total [baseline] (9.039 s) : 0, 9039316 Agent [candidate] (1.193 s) : 0, 1192572 Total [candidate] (9.09 s) : 0, 9090049 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.066 s |-| |Agent|iast|1.193 s |127.907 ms (12.0%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.202 s |136.243 ms (12.8%)| |Agent|iast_TELEMETRY_OFF|1.189 s |122.971 ms (11.5%)| |Total|tracing|8.526 s |-| |Total|iast|9.057 s |530.849 ms (6.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.078 s |551.809 ms (6.5%)| |Total|iast_TELEMETRY_OFF|9.039 s |513.361 ms (6.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.067 s |-| |Agent|iast|1.21 s |143.495 ms (13.5%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.192 s |125.668 ms (11.8%)| |Agent|iast_TELEMETRY_OFF|1.193 s |125.846 ms (11.8%)| |Total|tracing|8.541 s |-| |Total|iast|9.109 s |567.142 ms (6.6%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.04 s |498.537 ms (5.8%)| |Total|iast_TELEMETRY_OFF|9.09 s |548.671 ms (6.4%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (680.998 ms) : 0, 680998 BytebuddyAgent [candidate] (681.429 ms) : 0, 681429 GlobalTracer [baseline] (308.946 ms) : 0, 308946 GlobalTracer [candidate] (309.76 ms) : 0, 309760 AppSec [baseline] (53.7 ms) : 0, 53700 AppSec [candidate] (53.668 ms) : 0, 53668 Remote Config [baseline] (659.025 µs) : 0, 659 Remote Config [candidate] (658.68 µs) : 0, 659 Telemetry [baseline] (7.595 ms) : 0, 7595 Telemetry [candidate] (7.589 ms) : 0, 7589 section iast BytebuddyAgent [baseline] (795.245 ms) : 0, 795245 BytebuddyAgent [candidate] (807.513 ms) : 0, 807513 GlobalTracer [baseline] (299.132 ms) : 0, 299132 GlobalTracer [candidate] (302.652 ms) : 0, 302652 AppSec [baseline] (53.724 ms) : 0, 53724 AppSec [candidate] (55.572 ms) : 0, 55572 Remote Config [baseline] (611.81 µs) : 0, 612 Remote Config [candidate] (628.947 µs) : 0, 629 Telemetry [baseline] (6.972 ms) : 0, 6972 Telemetry [candidate] (7.08 ms) : 0, 7080 IAST [baseline] (24.073 ms) : 0, 24073 IAST [candidate] (22.885 ms) : 0, 22885 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (801.899 ms) : 0, 801899 BytebuddyAgent [candidate] (794.077 ms) : 0, 794077 GlobalTracer [baseline] (300.509 ms) : 0, 300509 GlobalTracer [candidate] (298.766 ms) : 0, 298766 AppSec [baseline] (56.073 ms) : 0, 56073 AppSec [candidate] (54.713 ms) : 0, 54713 Remote Config [baseline] (615.713 µs) : 0, 616 Remote Config [candidate] (614.778 µs) : 0, 615 Telemetry [baseline] (7.048 ms) : 0, 7048 Telemetry [candidate] (7.001 ms) : 0, 7001 IAST [baseline] (21.797 ms) : 0, 21797 IAST [candidate] (23.533 ms) : 0, 23533 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (790.716 ms) : 0, 790716 BytebuddyAgent [candidate] (792.751 ms) : 0, 792751 GlobalTracer [baseline] (298.919 ms) : 0, 298919 GlobalTracer [candidate] (300.054 ms) : 0, 300054 AppSec [baseline] (56.11 ms) : 0, 56110 AppSec [candidate] (56.563 ms) : 0, 56563 Remote Config [baseline] (614.612 µs) : 0, 615 Remote Config [candidate] (633.98 µs) : 0, 634 Telemetry [baseline] (6.914 ms) : 0, 6914 Telemetry [candidate] (7.006 ms) : 0, 7006 IAST [baseline] (21.542 ms) : 0, 21542 IAST [candidate] (21.866 ms) : 0, 21866 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-30T13:54:31 2024-09-30T14:01:24
git_branch master nikita-tkachenko/ci-spec-tests-update
git_commit_date 1727691229 1727703592
git_commit_sha 70ac474684 d0c45a80cd
release_version 1.40.0-SNAPSHOT~70ac474684 1.41.0-SNAPSHOT~d0c45a80cd
start_time 2024-09-30T13:54:18 2024-09-30T14:01:10
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727705231 |1727705231 | |ci_job_id |655559127 |655559127 | |ci_pipeline_id|45417420 |45417420 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section baseline no_agent (1.359 ms) : 1340, 1378 . : milestone, 1359, appsec (1.728 ms) : 1704, 1753 . : milestone, 1728, appsec_no_iast (1.701 ms) : 1677, 1726 . : milestone, 1701, iast (1.472 ms) : 1449, 1494 . : milestone, 1472, profiling (1.505 ms) : 1479, 1530 . : milestone, 1505, tracing (1.45 ms) : 1426, 1474 . : milestone, 1450, section candidate no_agent (1.335 ms) : 1315, 1354 . : milestone, 1335, appsec (1.735 ms) : 1709, 1760 . : milestone, 1735, appsec_no_iast (1.713 ms) : 1689, 1738 . : milestone, 1713, iast (1.472 ms) : 1449, 1495 . : milestone, 1472, profiling (1.55 ms) : 1525, 1574 . : milestone, 1550, tracing (1.453 ms) : 1428, 1478 . : milestone, 1453, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.359 ms [1.34 ms, 1.378 ms]|-| |appsec|1.728 ms [1.704 ms, 1.753 ms]|369.656 µs (27.2%)| |appsec_no_iast|1.701 ms [1.677 ms, 1.726 ms]|342.573 µs (25.2%)| |iast|1.472 ms [1.449 ms, 1.494 ms]|113.173 µs (8.3%)| |profiling|1.505 ms [1.479 ms, 1.53 ms]|146.11 µs (10.8%)| |tracing|1.45 ms [1.426 ms, 1.474 ms]|91.334 µs (6.7%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.335 ms [1.315 ms, 1.354 ms]|-| |appsec|1.735 ms [1.709 ms, 1.76 ms]|399.803 µs (30.0%)| |appsec_no_iast|1.713 ms [1.689 ms, 1.738 ms]|378.486 µs (28.4%)| |iast|1.472 ms [1.449 ms, 1.495 ms]|137.502 µs (10.3%)| |profiling|1.55 ms [1.525 ms, 1.574 ms]|214.845 µs (16.1%)| |tracing|1.453 ms [1.428 ms, 1.478 ms]|118.15 µs (8.9%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section baseline no_agent (372.483 µs) : 352, 393 . : milestone, 372, iast (483.201 µs) : 462, 504 . : milestone, 483, iast_FULL (550.924 µs) : 530, 572 . : milestone, 551, iast_GLOBAL (508.6 µs) : 486, 531 . : milestone, 509, iast_HARDCODED_SECRET_DISABLED (486.208 µs) : 465, 507 . : milestone, 486, iast_INACTIVE (449.304 µs) : 428, 471 . : milestone, 449, iast_TELEMETRY_OFF (472.987 µs) : 452, 494 . : milestone, 473, tracing (444.776 µs) : 424, 466 . : milestone, 445, section candidate no_agent (371.692 µs) : 352, 391 . : milestone, 372, iast (477.808 µs) : 457, 499 . : milestone, 478, iast_FULL (553.874 µs) : 533, 575 . : milestone, 554, iast_GLOBAL (497.694 µs) : 477, 519 . : milestone, 498, iast_HARDCODED_SECRET_DISABLED (481.58 µs) : 460, 503 . : milestone, 482, iast_INACTIVE (450.527 µs) : 429, 472 . : milestone, 451, iast_TELEMETRY_OFF (469.003 µs) : 448, 490 . : milestone, 469, tracing (436.462 µs) : 416, 457 . : milestone, 436, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|372.483 µs [351.944 µs, 393.023 µs]|-| |iast|483.201 µs [461.965 µs, 504.437 µs]|110.717 µs (29.7%)| |iast_FULL|550.924 µs [529.864 µs, 571.984 µs]|178.441 µs (47.9%)| |iast_GLOBAL|508.6 µs [486.184 µs, 531.016 µs]|136.116 µs (36.5%)| |iast_HARDCODED_SECRET_DISABLED|486.208 µs [465.201 µs, 507.215 µs]|113.725 µs (30.5%)| |iast_INACTIVE|449.304 µs [427.95 µs, 470.657 µs]|76.82 µs (20.6%)| |iast_TELEMETRY_OFF|472.987 µs [451.589 µs, 494.386 µs]|100.504 µs (27.0%)| |tracing|444.776 µs [423.655 µs, 465.898 µs]|72.293 µs (19.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|371.692 µs [352.156 µs, 391.229 µs]|-| |iast|477.808 µs [456.792 µs, 498.823 µs]|106.116 µs (28.5%)| |iast_FULL|553.874 µs [532.711 µs, 575.038 µs]|182.182 µs (49.0%)| |iast_GLOBAL|497.694 µs [476.582 µs, 518.807 µs]|126.002 µs (33.9%)| |iast_HARDCODED_SECRET_DISABLED|481.58 µs [460.354 µs, 502.806 µs]|109.888 µs (29.6%)| |iast_INACTIVE|450.527 µs [428.827 µs, 472.227 µs]|78.835 µs (21.2%)| |iast_TELEMETRY_OFF|469.003 µs [448.043 µs, 489.964 µs]|97.311 µs (26.2%)| |tracing|436.462 µs [416.308 µs, 456.616 µs]|64.77 µs (17.4%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/ci-spec-tests-update
git_commit_date 1727691229 1727703592
git_commit_sha 70ac474684 d0c45a80cd
release_version 1.40.0-SNAPSHOT~70ac474684 1.41.0-SNAPSHOT~d0c45a80cd
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1727705786 |1727705786 | |ci_job_id |655559128 |655559128 | |ci_pipeline_id|45417420 |45417420 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section baseline no_agent (15.03 s) : 15030000, 15030000 . : milestone, 15030000, appsec (15.455 s) : 15455000, 15455000 . : milestone, 15455000, iast (18.772 s) : 18772000, 18772000 . : milestone, 18772000, iast_GLOBAL (18.198 s) : 18198000, 18198000 . : milestone, 18198000, profiling (15.224 s) : 15224000, 15224000 . : milestone, 15224000, tracing (15.316 s) : 15316000, 15316000 . : milestone, 15316000, section candidate no_agent (15.18 s) : 15180000, 15180000 . : milestone, 15180000, appsec (15.291 s) : 15291000, 15291000 . : milestone, 15291000, iast (18.846 s) : 18846000, 18846000 . : milestone, 18846000, iast_GLOBAL (17.934 s) : 17934000, 17934000 . : milestone, 17934000, profiling (14.791 s) : 14791000, 14791000 . : milestone, 14791000, tracing (15.01 s) : 15010000, 15010000 . : milestone, 15010000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.03 s [15.03 s, 15.03 s]|-| |appsec|15.455 s [15.455 s, 15.455 s]|425.0 ms (2.8%)| |iast|18.772 s [18.772 s, 18.772 s]|3.742 s (24.9%)| |iast_GLOBAL|18.198 s [18.198 s, 18.198 s]|3.168 s (21.1%)| |profiling|15.224 s [15.224 s, 15.224 s]|194.0 ms (1.3%)| |tracing|15.316 s [15.316 s, 15.316 s]|286.0 ms (1.9%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.18 s [15.18 s, 15.18 s]|-| |appsec|15.291 s [15.291 s, 15.291 s]|111.0 ms (0.7%)| |iast|18.846 s [18.846 s, 18.846 s]|3.666 s (24.2%)| |iast_GLOBAL|17.934 s [17.934 s, 17.934 s]|2.754 s (18.1%)| |profiling|14.791 s [14.791 s, 14.791 s]|-389.0 ms (-2.6%)| |tracing|15.01 s [15.01 s, 15.01 s]|-170.0 ms (-1.1%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~d0c45a80cd, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section baseline no_agent (1.468 ms) : 1456, 1479 . : milestone, 1468, appsec (2.323 ms) : 2283, 2363 . : milestone, 2323, iast (2.067 ms) : 2016, 2119 . : milestone, 2067, iast_GLOBAL (2.108 ms) : 2056, 2160 . : milestone, 2108, profiling (1.942 ms) : 1900, 1985 . : milestone, 1942, tracing (1.912 ms) : 1873, 1951 . : milestone, 1912, section candidate no_agent (1.462 ms) : 1451, 1474 . : milestone, 1462, appsec (2.325 ms) : 2285, 2366 . : milestone, 2325, iast (2.077 ms) : 2026, 2129 . : milestone, 2077, iast_GLOBAL (2.113 ms) : 2062, 2165 . : milestone, 2113, profiling (1.922 ms) : 1881, 1962 . : milestone, 1922, tracing (1.909 ms) : 1870, 1948 . : milestone, 1909, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.468 ms [1.456 ms, 1.479 ms]|-| |appsec|2.323 ms [2.283 ms, 2.363 ms]|854.986 µs (58.2%)| |iast|2.067 ms [2.016 ms, 2.119 ms]|599.263 µs (40.8%)| |iast_GLOBAL|2.108 ms [2.056 ms, 2.16 ms]|639.945 µs (43.6%)| |profiling|1.942 ms [1.9 ms, 1.985 ms]|474.581 µs (32.3%)| |tracing|1.912 ms [1.873 ms, 1.951 ms]|443.703 µs (30.2%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.462 ms [1.451 ms, 1.474 ms]|-| |appsec|2.325 ms [2.285 ms, 2.366 ms]|863.177 µs (59.0%)| |iast|2.077 ms [2.026 ms, 2.129 ms]|614.896 µs (42.1%)| |iast_GLOBAL|2.113 ms [2.062 ms, 2.165 ms]|651.189 µs (44.5%)| |profiling|1.922 ms [1.881 ms, 1.962 ms]|459.251 µs (31.4%)| |tracing|1.909 ms [1.87 ms, 1.948 ms]|446.462 µs (30.5%)|