search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Fix module name detection for headless sessions #7802

Closed nikita-tkachenko-datadog closed 1 month ago

nikita-tkachenko-datadog commented 1 month ago

Duplicates #7779, merged by mistake

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7779
git_commit_date 1729245368 1729254284
git_commit_sha 52cdab0c9c 19f44666b2
release_version 1.42.0-SNAPSHOT~52cdab0c9c 1.42.0-SNAPSHOT~19f44666b2
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729256811 |1729256811 | |ci_job_id |676763462 |676763462 | |ci_pipeline_id|46908632 |46908632 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 1 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 11 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast_TELEMETRY_OFF:AppSec better
[-6.236ms; -1.680ms] or [-10.809%; -2.912%]		 53.731ms 57.689ms
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section tracing Agent [baseline] (1.087 s) : 0, 1087104 Total [baseline] (10.448 s) : 0, 10448286 Agent [candidate] (1.076 s) : 0, 1076178 Total [candidate] (10.452 s) : 0, 10452116 section appsec Agent [baseline] (1.217 s) : 0, 1216555 Total [baseline] (10.688 s) : 0, 10688199 Agent [candidate] (1.218 s) : 0, 1218320 Total [candidate] (10.725 s) : 0, 10725169 section iast Agent [baseline] (1.213 s) : 0, 1212865 Total [baseline] (10.927 s) : 0, 10927149 Agent [candidate] (1.22 s) : 0, 1219879 Total [candidate] (10.991 s) : 0, 10990878 section profiling Agent [baseline] (1.286 s) : 0, 1286259 Total [baseline] (10.849 s) : 0, 10849305 Agent [candidate] (1.276 s) : 0, 1275670 Total [candidate] (10.684 s) : 0, 10683890 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.087 s |-| |Agent|appsec|1.217 s |129.451 ms (11.9%)| |Agent|iast|1.213 s |125.761 ms (11.6%)| |Agent|profiling|1.286 s |199.155 ms (18.3%)| |Total|tracing|10.448 s |-| |Total|appsec|10.688 s |239.913 ms (2.3%)| |Total|iast|10.927 s |478.863 ms (4.6%)| |Total|profiling|10.849 s |401.018 ms (3.8%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.076 s |-| |Agent|appsec|1.218 s |142.141 ms (13.2%)| |Agent|iast|1.22 s |143.7 ms (13.4%)| |Agent|profiling|1.276 s |199.492 ms (18.5%)| |Total|tracing|10.452 s |-| |Total|appsec|10.725 s |273.053 ms (2.6%)| |Total|iast|10.991 s |538.762 ms (5.2%)| |Total|profiling|10.684 s |231.773 ms (2.2%)| ```mermaid gantt title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (692.949 ms) : 0, 692949 BytebuddyAgent [candidate] (686.099 ms) : 0, 686099 GlobalTracer [baseline] (315.487 ms) : 0, 315487 GlobalTracer [candidate] (313.734 ms) : 0, 313734 AppSec [baseline] (54.414 ms) : 0, 54414 AppSec [candidate] (54.463 ms) : 0, 54463 Remote Config [baseline] (669.695 µs) : 0, 670 Remote Config [candidate] (657.506 µs) : 0, 658 Telemetry [baseline] (9.758 ms) : 0, 9758 Telemetry [candidate] (7.48 ms) : 0, 7480 section appsec BytebuddyAgent [baseline] (706.446 ms) : 0, 706446 BytebuddyAgent [candidate] (707.278 ms) : 0, 707278 GlobalTracer [baseline] (311.318 ms) : 0, 311318 GlobalTracer [candidate] (312.81 ms) : 0, 312810 AppSec [baseline] (165.687 ms) : 0, 165687 AppSec [candidate] (163.074 ms) : 0, 163074 IAST [baseline] (21.793 ms) : 0, 21793 IAST [candidate] (20.105 ms) : 0, 20105 Remote Config [baseline] (635.063 µs) : 0, 635 Remote Config [candidate] (644.465 µs) : 0, 644 Telemetry [baseline] (7.803 ms) : 0, 7803 Telemetry [candidate] (10.603 ms) : 0, 10603 section iast BytebuddyAgent [baseline] (809.276 ms) : 0, 809276 BytebuddyAgent [candidate] (812.063 ms) : 0, 812063 GlobalTracer [baseline] (303.495 ms) : 0, 303495 GlobalTracer [candidate] (306.129 ms) : 0, 306129 AppSec [baseline] (57.064 ms) : 0, 57064 AppSec [candidate] (57.224 ms) : 0, 57224 IAST [baseline] (20.568 ms) : 0, 20568 IAST [candidate] (22.683 ms) : 0, 22683 Remote Config [baseline] (605.255 µs) : 0, 605 Remote Config [candidate] (614.35 µs) : 0, 614 Telemetry [baseline] (8.007 ms) : 0, 8007 Telemetry [candidate] (7.202 ms) : 0, 7202 section profiling BytebuddyAgent [baseline] (685.956 ms) : 0, 685956 BytebuddyAgent [candidate] (679.306 ms) : 0, 679306 GlobalTracer [baseline] (399.276 ms) : 0, 399276 GlobalTracer [candidate] (397.622 ms) : 0, 397622 AppSec [baseline] (55.134 ms) : 0, 55134 AppSec [candidate] (54.685 ms) : 0, 54685 Remote Config [baseline] (656.467 µs) : 0, 656 Remote Config [candidate] (653.028 µs) : 0, 653 Telemetry [baseline] (12.438 ms) : 0, 12438 Telemetry [candidate] (7.499 ms) : 0, 7499 ProfilingAgent [baseline] (93.72 ms) : 0, 93720 ProfilingAgent [candidate] (97.057 ms) : 0, 97057 Profiling [baseline] (93.744 ms) : 0, 93744 Profiling [candidate] (97.081 ms) : 0, 97081 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section tracing Agent [baseline] (1.086 s) : 0, 1086447 Total [baseline] (8.631 s) : 0, 8631297 Agent [candidate] (1.083 s) : 0, 1082651 Total [candidate] (8.625 s) : 0, 8624661 section iast Agent [baseline] (1.212 s) : 0, 1211742 Total [baseline] (9.169 s) : 0, 9168551 Agent [candidate] (1.213 s) : 0, 1213395 Total [candidate] (9.178 s) : 0, 9178329 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.217 s) : 0, 1216548 Total [baseline] (9.131 s) : 0, 9130829 Agent [candidate] (1.204 s) : 0, 1204259 Total [candidate] (9.1 s) : 0, 9100104 section iast_TELEMETRY_OFF Agent [baseline] (1.211 s) : 0, 1211279 Total [baseline] (9.145 s) : 0, 9144831 Agent [candidate] (1.2 s) : 0, 1199730 Total [candidate] (9.121 s) : 0, 9120764 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.086 s |-| |Agent|iast|1.212 s |125.295 ms (11.5%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.217 s |130.1 ms (12.0%)| |Agent|iast_TELEMETRY_OFF|1.211 s |124.831 ms (11.5%)| |Total|tracing|8.631 s |-| |Total|iast|9.169 s |537.254 ms (6.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.131 s |499.532 ms (5.8%)| |Total|iast_TELEMETRY_OFF|9.145 s |513.534 ms (5.9%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.083 s |-| |Agent|iast|1.213 s |130.744 ms (12.1%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.204 s |121.607 ms (11.2%)| |Agent|iast_TELEMETRY_OFF|1.2 s |117.078 ms (10.8%)| |Total|tracing|8.625 s |-| |Total|iast|9.178 s |553.668 ms (6.4%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.1 s |475.443 ms (5.5%)| |Total|iast_TELEMETRY_OFF|9.121 s |496.103 ms (5.8%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (693.252 ms) : 0, 693252 BytebuddyAgent [candidate] (689.701 ms) : 0, 689701 GlobalTracer [baseline] (315.512 ms) : 0, 315512 GlobalTracer [candidate] (316.058 ms) : 0, 316058 AppSec [baseline] (54.36 ms) : 0, 54360 AppSec [candidate] (54.795 ms) : 0, 54795 Remote Config [baseline] (672.268 µs) : 0, 672 Remote Config [candidate] (670.422 µs) : 0, 670 Telemetry [baseline] (8.863 ms) : 0, 8863 Telemetry [candidate] (7.607 ms) : 0, 7607 section iast BytebuddyAgent [baseline] (808.337 ms) : 0, 808337 BytebuddyAgent [candidate] (807.53 ms) : 0, 807530 GlobalTracer [baseline] (303.89 ms) : 0, 303890 GlobalTracer [candidate] (304.891 ms) : 0, 304891 AppSec [baseline] (57.523 ms) : 0, 57523 AppSec [candidate] (56.949 ms) : 0, 56949 IAST [baseline] (20.442 ms) : 0, 20442 IAST [candidate] (22.269 ms) : 0, 22269 Remote Config [baseline] (614.535 µs) : 0, 615 Remote Config [candidate] (614.863 µs) : 0, 615 Telemetry [baseline] (7.124 ms) : 0, 7124 Telemetry [candidate] (7.196 ms) : 0, 7196 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (810.284 ms) : 0, 810284 BytebuddyAgent [candidate] (801.392 ms) : 0, 801392 GlobalTracer [baseline] (306.032 ms) : 0, 306032 GlobalTracer [candidate] (302.742 ms) : 0, 302742 AppSec [baseline] (57.177 ms) : 0, 57177 AppSec [candidate] (58.175 ms) : 0, 58175 IAST [baseline] (21.437 ms) : 0, 21437 IAST [candidate] (20.403 ms) : 0, 20403 Remote Config [baseline] (618.798 µs) : 0, 619 Remote Config [candidate] (601.921 µs) : 0, 602 Telemetry [baseline] (7.138 ms) : 0, 7138 Telemetry [candidate] (7.118 ms) : 0, 7118 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (806.577 ms) : 0, 806577 BytebuddyAgent [candidate] (797.171 ms) : 0, 797171 GlobalTracer [baseline] (305.065 ms) : 0, 305065 GlobalTracer [candidate] (302.538 ms) : 0, 302538 AppSec [baseline] (57.689 ms) : 0, 57689 AppSec [candidate] (53.731 ms) : 0, 53731 IAST [baseline] (20.378 ms) : 0, 20378 IAST [candidate] (24.912 ms) : 0, 24912 Remote Config [baseline] (616.902 µs) : 0, 617 Remote Config [candidate] (609.766 µs) : 0, 610 Telemetry [baseline] (7.083 ms) : 0, 7083 Telemetry [candidate] (6.956 ms) : 0, 6956 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-18T12:37:06 2024-10-18T12:43:57
git_branch master nikita-tkachenko/backport-pr-7779
git_commit_date 1729245368 1729254284
git_commit_sha 52cdab0c9c 19f44666b2
release_version 1.42.0-SNAPSHOT~52cdab0c9c 1.42.0-SNAPSHOT~19f44666b2
start_time 2024-10-18T12:36:53 2024-10-18T12:43:44
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729255783 |1729255783 | |ci_job_id |676763463 |676763463 | |ci_pipeline_id|46908632 |46908632 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section baseline no_agent (367.419 µs) : 347, 387 . : milestone, 367, iast (485.294 µs) : 464, 507 . : milestone, 485, iast_FULL (547.833 µs) : 527, 569 . : milestone, 548, iast_GLOBAL (510.156 µs) : 488, 533 . : milestone, 510, iast_HARDCODED_SECRET_DISABLED (480.508 µs) : 459, 502 . : milestone, 481, iast_INACTIVE (447.313 µs) : 426, 469 . : milestone, 447, iast_TELEMETRY_OFF (474.275 µs) : 453, 496 . : milestone, 474, tracing (446.548 µs) : 425, 468 . : milestone, 447, section candidate no_agent (364.997 µs) : 345, 385 . : milestone, 365, iast (482.236 µs) : 461, 504 . : milestone, 482, iast_FULL (551.42 µs) : 530, 573 . : milestone, 551, iast_GLOBAL (501.596 µs) : 481, 523 . : milestone, 502, iast_HARDCODED_SECRET_DISABLED (483.996 µs) : 462, 506 . : milestone, 484, iast_INACTIVE (441.84 µs) : 421, 463 . : milestone, 442, iast_TELEMETRY_OFF (472.818 µs) : 452, 494 . : milestone, 473, tracing (442.861 µs) : 422, 464 . : milestone, 443, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|367.419 µs [347.472 µs, 387.365 µs]|-| |iast|485.294 µs [463.674 µs, 506.915 µs]|117.876 µs (32.1%)| |iast_FULL|547.833 µs [526.668 µs, 568.997 µs]|180.414 µs (49.1%)| |iast_GLOBAL|510.156 µs [487.746 µs, 532.565 µs]|142.737 µs (38.8%)| |iast_HARDCODED_SECRET_DISABLED|480.508 µs [459.076 µs, 501.94 µs]|113.089 µs (30.8%)| |iast_INACTIVE|447.313 µs [425.789 µs, 468.837 µs]|79.894 µs (21.7%)| |iast_TELEMETRY_OFF|474.275 µs [452.743 µs, 495.807 µs]|106.857 µs (29.1%)| |tracing|446.548 µs [425.294 µs, 467.802 µs]|79.13 µs (21.5%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|364.997 µs [345.007 µs, 384.987 µs]|-| |iast|482.236 µs [460.837 µs, 503.635 µs]|117.239 µs (32.1%)| |iast_FULL|551.42 µs [530.098 µs, 572.742 µs]|186.423 µs (51.1%)| |iast_GLOBAL|501.596 µs [480.682 µs, 522.51 µs]|136.599 µs (37.4%)| |iast_HARDCODED_SECRET_DISABLED|483.996 µs [461.897 µs, 506.095 µs]|118.999 µs (32.6%)| |iast_INACTIVE|441.84 µs [421.052 µs, 462.629 µs]|76.844 µs (21.1%)| |iast_TELEMETRY_OFF|472.818 µs [451.949 µs, 493.687 µs]|107.821 µs (29.5%)| |tracing|442.861 µs [422.151 µs, 463.571 µs]|77.864 µs (21.3%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section baseline no_agent (1.34 ms) : 1321, 1360 . : milestone, 1340, appsec (1.711 ms) : 1686, 1737 . : milestone, 1711, appsec_no_iast (1.731 ms) : 1707, 1754 . : milestone, 1731, iast (1.475 ms) : 1452, 1497 . : milestone, 1475, profiling (1.49 ms) : 1467, 1513 . : milestone, 1490, tracing (1.47 ms) : 1446, 1495 . : milestone, 1470, section candidate no_agent (1.328 ms) : 1307, 1348 . : milestone, 1328, appsec (1.7 ms) : 1676, 1724 . : milestone, 1700, appsec_no_iast (1.727 ms) : 1703, 1751 . : milestone, 1727, iast (1.471 ms) : 1448, 1494 . : milestone, 1471, profiling (1.49 ms) : 1467, 1514 . : milestone, 1490, tracing (1.45 ms) : 1425, 1475 . : milestone, 1450, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.34 ms [1.321 ms, 1.36 ms]|-| |appsec|1.711 ms [1.686 ms, 1.737 ms]|371.155 µs (27.7%)| |appsec_no_iast|1.731 ms [1.707 ms, 1.754 ms]|390.441 µs (29.1%)| |iast|1.475 ms [1.452 ms, 1.497 ms]|134.622 µs (10.0%)| |profiling|1.49 ms [1.467 ms, 1.513 ms]|149.719 µs (11.2%)| |tracing|1.47 ms [1.446 ms, 1.495 ms]|130.227 µs (9.7%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.328 ms [1.307 ms, 1.348 ms]|-| |appsec|1.7 ms [1.676 ms, 1.724 ms]|372.073 µs (28.0%)| |appsec_no_iast|1.727 ms [1.703 ms, 1.751 ms]|399.051 µs (30.1%)| |iast|1.471 ms [1.448 ms, 1.494 ms]|143.449 µs (10.8%)| |profiling|1.49 ms [1.467 ms, 1.514 ms]|162.302 µs (12.2%)| |tracing|1.45 ms [1.425 ms, 1.475 ms]|122.25 µs (9.2%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7779
git_commit_date 1729245368 1729254284
git_commit_sha 52cdab0c9c 19f44666b2
release_version 1.42.0-SNAPSHOT~52cdab0c9c 1.42.0-SNAPSHOT~19f44666b2
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1729256314 |1729256314 | |ci_job_id |676763464 |676763464 | |ci_pipeline_id|46908632 |46908632 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section baseline no_agent (15.439 s) : 15439000, 15439000 . : milestone, 15439000, appsec (15.26 s) : 15260000, 15260000 . : milestone, 15260000, iast (18.938 s) : 18938000, 18938000 . : milestone, 18938000, iast_GLOBAL (18.014 s) : 18014000, 18014000 . : milestone, 18014000, profiling (15.169 s) : 15169000, 15169000 . : milestone, 15169000, tracing (14.926 s) : 14926000, 14926000 . : milestone, 14926000, section candidate no_agent (15.767 s) : 15767000, 15767000 . : milestone, 15767000, appsec (15.082 s) : 15082000, 15082000 . : milestone, 15082000, iast (18.964 s) : 18964000, 18964000 . : milestone, 18964000, iast_GLOBAL (18.052 s) : 18052000, 18052000 . : milestone, 18052000, profiling (15.548 s) : 15548000, 15548000 . : milestone, 15548000, tracing (15.265 s) : 15265000, 15265000 . : milestone, 15265000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.439 s [15.439 s, 15.439 s]|-| |appsec|15.26 s [15.26 s, 15.26 s]|-179.0 ms (-1.2%)| |iast|18.938 s [18.938 s, 18.938 s]|3.499 s (22.7%)| |iast_GLOBAL|18.014 s [18.014 s, 18.014 s]|2.575 s (16.7%)| |profiling|15.169 s [15.169 s, 15.169 s]|-270.0 ms (-1.7%)| |tracing|14.926 s [14.926 s, 14.926 s]|-513.0 ms (-3.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.767 s [15.767 s, 15.767 s]|-| |appsec|15.082 s [15.082 s, 15.082 s]|-685.0 ms (-4.3%)| |iast|18.964 s [18.964 s, 18.964 s]|3.197 s (20.3%)| |iast_GLOBAL|18.052 s [18.052 s, 18.052 s]|2.285 s (14.5%)| |profiling|15.548 s [15.548 s, 15.548 s]|-219.0 ms (-1.4%)| |tracing|15.265 s [15.265 s, 15.265 s]|-502.0 ms (-3.2%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section baseline no_agent (1.473 ms) : 1462, 1485 . : milestone, 1473, appsec (2.34 ms) : 2299, 2382 . : milestone, 2340, iast (2.073 ms) : 2021, 2124 . : milestone, 2073, iast_GLOBAL (2.128 ms) : 2076, 2180 . : milestone, 2128, profiling (1.934 ms) : 1893, 1974 . : milestone, 1934, tracing (1.922 ms) : 1883, 1961 . : milestone, 1922, section candidate no_agent (1.468 ms) : 1457, 1480 . : milestone, 1468, appsec (2.341 ms) : 2299, 2382 . : milestone, 2341, iast (2.09 ms) : 2038, 2143 . : milestone, 2090, iast_GLOBAL (2.122 ms) : 2069, 2174 . : milestone, 2122, profiling (1.949 ms) : 1907, 1990 . : milestone, 1949, tracing (1.93 ms) : 1890, 1970 . : milestone, 1930, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.473 ms [1.462 ms, 1.485 ms]|-| |appsec|2.34 ms [2.299 ms, 2.382 ms]|866.963 µs (58.8%)| |iast|2.073 ms [2.021 ms, 2.124 ms]|599.193 µs (40.7%)| |iast_GLOBAL|2.128 ms [2.076 ms, 2.18 ms]|654.712 µs (44.4%)| |profiling|1.934 ms [1.893 ms, 1.974 ms]|460.289 µs (31.2%)| |tracing|1.922 ms [1.883 ms, 1.961 ms]|448.633 µs (30.4%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.468 ms [1.457 ms, 1.48 ms]|-| |appsec|2.341 ms [2.299 ms, 2.382 ms]|872.423 µs (59.4%)| |iast|2.09 ms [2.038 ms, 2.143 ms]|622.057 µs (42.4%)| |iast_GLOBAL|2.122 ms [2.069 ms, 2.174 ms]|653.739 µs (44.5%)| |profiling|1.949 ms [1.907 ms, 1.99 ms]|480.43 µs (32.7%)| |tracing|1.93 ms [1.89 ms, 1.97 ms]|461.695 µs (31.4%)|