DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

[🍒 7779] Fix module name detection for headless sessions #7807

Closed nikita-tkachenko-datadog closed 1 month ago

nikita-tkachenko-datadog commented 1 month ago

Cherry pick #7779

What Does This Do

Fixes module name detection for headless test sessions (i.e. sessions for JVMs that are not part of an instrumented Maven/Gradle build).

When a JVM is a part of an instrumented Maven/Gradle build, the parent process provides module names to the children processes via system properties. For headless sessions the module name is not provided, so there is a fallback that tries to derive module name from current path and repository root (e.g. if repo root is /my/repo/root and current path is /my/repo/root/submodule, then the module name is set to submodule). This fallback logic works incorrectly when repo root is /my/repo/root and the current path is /my/repo/root/: in this case module name is empty, which is not allowed.

The fix detects these cases, and uses service name as the last fallback if module name cannot be derived from current path.

Contributor Checklist

Jira ticket: SDTEST-1110

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7779
git_commit_date 1729257196 1729254284
git_commit_sha 00856e02d3 19f44666b2
release_version 1.42.0-SNAPSHOT~00856e02d3 1.42.0-SNAPSHOT~19f44666b2
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729259691 |1729259691 | |ci_job_id |676840206 |676840206 | |ci_pipeline_id|46913183 |46913183 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 49 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+2.910ms; +8.362ms] or [+3.177%; +9.130%]
97.221ms 91.585ms
scenario:startup:petclinic:profiling:Profiling worse
[+2.910ms; +8.362ms] or [+3.177%; +9.128%]
97.244ms 91.609ms
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~00856e02d3 dateFormat X axisFormat %s section tracing Agent [baseline] (1.089 s) : 0, 1088965 Total [baseline] (8.595 s) : 0, 8594628 Agent [candidate] (1.078 s) : 0, 1077847 Total [candidate] (8.573 s) : 0, 8572698 section iast Agent [baseline] (1.201 s) : 0, 1200876 Total [baseline] (9.105 s) : 0, 9104531 Agent [candidate] (1.2 s) : 0, 1199812 Total [candidate] (9.146 s) : 0, 9146013 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.201 s) : 0, 1200770 Total [baseline] (9.082 s) : 0, 9082282 Agent [candidate] (1.209 s) : 0, 1209310 Total [candidate] (9.181 s) : 0, 9181422 section iast_TELEMETRY_OFF Agent [baseline] (1.207 s) : 0, 1206868 Total [baseline] (9.127 s) : 0, 9127167 Agent [candidate] (1.204 s) : 0, 1204474 Total [candidate] (9.13 s) : 0, 9129590 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.089 s |-| |Agent|iast|1.201 s |111.911 ms (10.3%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.201 s |111.805 ms (10.3%)| |Agent|iast_TELEMETRY_OFF|1.207 s |117.903 ms (10.8%)| |Total|tracing|8.595 s |-| |Total|iast|9.105 s |509.902 ms (5.9%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.082 s |487.654 ms (5.7%)| |Total|iast_TELEMETRY_OFF|9.127 s |532.539 ms (6.2%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.078 s |-| |Agent|iast|1.2 s |121.965 ms (11.3%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.209 s |131.463 ms (12.2%)| |Agent|iast_TELEMETRY_OFF|1.204 s |126.628 ms (11.7%)| |Total|tracing|8.573 s |-| |Total|iast|9.146 s |573.315 ms (6.7%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.181 s |608.724 ms (7.1%)| |Total|iast_TELEMETRY_OFF|9.13 s |556.892 ms (6.5%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~00856e02d3 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (693.604 ms) : 0, 693604 BytebuddyAgent [candidate] (687.076 ms) : 0, 687076 GlobalTracer [baseline] (316.391 ms) : 0, 316391 GlobalTracer [candidate] (314.402 ms) : 0, 314402 AppSec [baseline] (54.294 ms) : 0, 54294 AppSec [candidate] (54.361 ms) : 0, 54361 Remote Config [baseline] (666.689 µs) : 0, 667 Remote Config [candidate] (669.975 µs) : 0, 670 Telemetry [baseline] (10.198 ms) : 0, 10198 Telemetry [candidate] (7.528 ms) : 0, 7528 section iast BytebuddyAgent [baseline] (800.926 ms) : 0, 800926 BytebuddyAgent [candidate] (798.039 ms) : 0, 798039 GlobalTracer [baseline] (301.22 ms) : 0, 301220 GlobalTracer [candidate] (302.07 ms) : 0, 302070 AppSec [baseline] (57.187 ms) : 0, 57187 AppSec [candidate] (55.36 ms) : 0, 55360 IAST [baseline] (20.234 ms) : 0, 20234 IAST [candidate] (22.94 ms) : 0, 22940 Remote Config [baseline] (611.587 µs) : 0, 612 Remote Config [candidate] (613.119 µs) : 0, 613 Telemetry [baseline] (7.001 ms) : 0, 7001 Telemetry [candidate] (7.053 ms) : 0, 7053 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (799.511 ms) : 0, 799511 BytebuddyAgent [candidate] (803.949 ms) : 0, 803949 GlobalTracer [baseline] (302.272 ms) : 0, 302272 GlobalTracer [candidate] (304.354 ms) : 0, 304354 AppSec [baseline] (55.986 ms) : 0, 55986 AppSec [candidate] (56.845 ms) : 0, 56845 IAST [baseline] (21.702 ms) : 0, 21702 IAST [candidate] (22.467 ms) : 0, 22467 Remote Config [baseline] (598.113 µs) : 0, 598 Remote Config [candidate] (626.981 µs) : 0, 627 Telemetry [baseline] (6.994 ms) : 0, 6994 Telemetry [candidate] (7.244 ms) : 0, 7244 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (803.636 ms) : 0, 803636 BytebuddyAgent [candidate] (801.251 ms) : 0, 801251 GlobalTracer [baseline] (304.287 ms) : 0, 304287 GlobalTracer [candidate] (304.286 ms) : 0, 304286 AppSec [baseline] (57.549 ms) : 0, 57549 AppSec [candidate] (55.911 ms) : 0, 55911 IAST [baseline] (19.991 ms) : 0, 19991 IAST [candidate] (21.603 ms) : 0, 21603 Remote Config [baseline] (615.19 µs) : 0, 615 Remote Config [candidate] (620.267 µs) : 0, 620 Telemetry [baseline] (7.006 ms) : 0, 7006 Telemetry [candidate] (7.027 ms) : 0, 7027 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~00856e02d3 dateFormat X axisFormat %s section tracing Agent [baseline] (1.075 s) : 0, 1075355 Total [baseline] (10.437 s) : 0, 10436816 Agent [candidate] (1.073 s) : 0, 1072614 Total [candidate] (10.376 s) : 0, 10376213 section appsec Agent [baseline] (1.208 s) : 0, 1207634 Total [baseline] (10.627 s) : 0, 10627235 Agent [candidate] (1.21 s) : 0, 1210282 Total [candidate] (10.607 s) : 0, 10606801 section iast Agent [baseline] (1.202 s) : 0, 1201800 Total [baseline] (10.836 s) : 0, 10836315 Agent [candidate] (1.2 s) : 0, 1200012 Total [candidate] (10.863 s) : 0, 10862761 section profiling Agent [baseline] (1.274 s) : 0, 1273704 Total [baseline] (10.687 s) : 0, 10686571 Agent [candidate] (1.28 s) : 0, 1280161 Total [candidate] (10.742 s) : 0, 10742357 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.075 s |-| |Agent|appsec|1.208 s |132.279 ms (12.3%)| |Agent|iast|1.202 s |126.445 ms (11.8%)| |Agent|profiling|1.274 s |198.35 ms (18.4%)| |Total|tracing|10.437 s |-| |Total|appsec|10.627 s |190.419 ms (1.8%)| |Total|iast|10.836 s |399.499 ms (3.8%)| |Total|profiling|10.687 s |249.755 ms (2.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.073 s |-| |Agent|appsec|1.21 s |137.669 ms (12.8%)| |Agent|iast|1.2 s |127.398 ms (11.9%)| |Agent|profiling|1.28 s |207.548 ms (19.3%)| |Total|tracing|10.376 s |-| |Total|appsec|10.607 s |230.588 ms (2.2%)| |Total|iast|10.863 s |486.549 ms (4.7%)| |Total|profiling|10.742 s |366.144 ms (3.5%)| ```mermaid gantt title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~00856e02d3 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (685.331 ms) : 0, 685331 BytebuddyAgent [candidate] (683.457 ms) : 0, 683457 GlobalTracer [baseline] (313.721 ms) : 0, 313721 GlobalTracer [candidate] (313.53 ms) : 0, 313530 AppSec [baseline] (53.859 ms) : 0, 53859 AppSec [candidate] (53.804 ms) : 0, 53804 Remote Config [baseline] (660.548 µs) : 0, 661 Remote Config [candidate] (686.44 µs) : 0, 686 Telemetry [baseline] (8.147 ms) : 0, 8147 Telemetry [candidate] (7.455 ms) : 0, 7455 section appsec BytebuddyAgent [baseline] (701.07 ms) : 0, 701070 BytebuddyAgent [candidate] (702.151 ms) : 0, 702151 GlobalTracer [baseline] (309.866 ms) : 0, 309866 GlobalTracer [candidate] (310.887 ms) : 0, 310887 AppSec [baseline] (163.947 ms) : 0, 163947 AppSec [candidate] (162.42 ms) : 0, 162420 IAST [baseline] (19.346 ms) : 0, 19346 IAST [candidate] (19.916 ms) : 0, 19916 Remote Config [baseline] (635.771 µs) : 0, 636 Remote Config [candidate] (641.809 µs) : 0, 642 Telemetry [baseline] (8.839 ms) : 0, 8839 Telemetry [candidate] (10.516 ms) : 0, 10516 section iast BytebuddyAgent [baseline] (800.357 ms) : 0, 800357 BytebuddyAgent [candidate] (798.364 ms) : 0, 798364 GlobalTracer [baseline] (302.171 ms) : 0, 302171 GlobalTracer [candidate] (301.918 ms) : 0, 301918 AppSec [baseline] (55.452 ms) : 0, 55452 AppSec [candidate] (54.593 ms) : 0, 54593 IAST [baseline] (22.596 ms) : 0, 22596 IAST [candidate] (22.906 ms) : 0, 22906 Remote Config [baseline] (582.269 µs) : 0, 582 Remote Config [candidate] (601.968 µs) : 0, 602 Telemetry [baseline] (6.976 ms) : 0, 6976 Telemetry [candidate] (7.922 ms) : 0, 7922 section profiling BytebuddyAgent [baseline] (679.382 ms) : 0, 679382 BytebuddyAgent [candidate] (681.404 ms) : 0, 681404 GlobalTracer [baseline] (396.281 ms) : 0, 396281 GlobalTracer [candidate] (399.578 ms) : 0, 399578 AppSec [baseline] (54.872 ms) : 0, 54872 AppSec [candidate] (54.806 ms) : 0, 54806 Remote Config [baseline] (659.231 µs) : 0, 659 Remote Config [candidate] (662.714 µs) : 0, 663 Telemetry [baseline] (12.295 ms) : 0, 12295 Telemetry [candidate] (7.51 ms) : 0, 7510 ProfilingAgent [baseline] (91.585 ms) : 0, 91585 ProfilingAgent [candidate] (97.221 ms) : 0, 97221 Profiling [baseline] (91.609 ms) : 0, 91609 Profiling [candidate] (97.244 ms) : 0, 97244 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-18T13:27:12 2024-10-18T13:34:04
git_branch master nikita-tkachenko/backport-pr-7779
git_commit_date 1729257196 1729254284
git_commit_sha 00856e02d3 19f44666b2
release_version 1.42.0-SNAPSHOT~00856e02d3 1.42.0-SNAPSHOT~19f44666b2
start_time 2024-10-18T13:26:58 2024-10-18T13:33:51
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729258792 |1729258792 | |ci_job_id |676840207 |676840207 | |ci_pipeline_id|46913183 |46913183 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~00856e02d3 dateFormat X axisFormat %s section baseline no_agent (375.038 µs) : 354, 396 . : milestone, 375, iast (485.929 µs) : 465, 507 . : milestone, 486, iast_FULL (556.196 µs) : 535, 577 . : milestone, 556, iast_GLOBAL (526.104 µs) : 504, 549 . : milestone, 526, iast_HARDCODED_SECRET_DISABLED (488.812 µs) : 467, 510 . : milestone, 489, iast_INACTIVE (446.57 µs) : 426, 467 . : milestone, 447, iast_TELEMETRY_OFF (474.263 µs) : 453, 495 . : milestone, 474, tracing (445.874 µs) : 425, 467 . : milestone, 446, section candidate no_agent (371.157 µs) : 351, 392 . : milestone, 371, iast (482.955 µs) : 462, 504 . : milestone, 483, iast_FULL (558.472 µs) : 537, 580 . : milestone, 558, iast_GLOBAL (512.28 µs) : 491, 534 . : milestone, 512, iast_HARDCODED_SECRET_DISABLED (484.201 µs) : 463, 505 . : milestone, 484, iast_INACTIVE (453.526 µs) : 432, 475 . : milestone, 454, iast_TELEMETRY_OFF (471.906 µs) : 451, 493 . : milestone, 472, tracing (446.752 µs) : 426, 468 . : milestone, 447, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|375.038 µs [354.041 µs, 396.034 µs]|-| |iast|485.929 µs [464.64 µs, 507.218 µs]|110.891 µs (29.6%)| |iast_FULL|556.196 µs [535.002 µs, 577.39 µs]|181.158 µs (48.3%)| |iast_GLOBAL|526.104 µs [503.618 µs, 548.59 µs]|151.066 µs (40.3%)| |iast_HARDCODED_SECRET_DISABLED|488.812 µs [467.125 µs, 510.498 µs]|113.774 µs (30.3%)| |iast_INACTIVE|446.57 µs [425.962 µs, 467.177 µs]|71.532 µs (19.1%)| |iast_TELEMETRY_OFF|474.263 µs [453.05 µs, 495.476 µs]|99.225 µs (26.5%)| |tracing|445.874 µs [425.149 µs, 466.599 µs]|70.836 µs (18.9%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|371.157 µs [350.731 µs, 391.584 µs]|-| |iast|482.955 µs [462.029 µs, 503.88 µs]|111.797 µs (30.1%)| |iast_FULL|558.472 µs [537.097 µs, 579.847 µs]|187.315 µs (50.5%)| |iast_GLOBAL|512.28 µs [490.527 µs, 534.032 µs]|141.122 µs (38.0%)| |iast_HARDCODED_SECRET_DISABLED|484.201 µs [463.071 µs, 505.33 µs]|113.043 µs (30.5%)| |iast_INACTIVE|453.526 µs [432.184 µs, 474.868 µs]|82.369 µs (22.2%)| |iast_TELEMETRY_OFF|471.906 µs [450.919 µs, 492.892 µs]|100.748 µs (27.1%)| |tracing|446.752 µs [425.885 µs, 467.62 µs]|75.595 µs (20.4%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~00856e02d3 dateFormat X axisFormat %s section baseline no_agent (1.328 ms) : 1309, 1347 . : milestone, 1328, appsec (1.744 ms) : 1720, 1769 . : milestone, 1744, appsec_no_iast (1.734 ms) : 1711, 1758 . : milestone, 1734, iast (1.479 ms) : 1457, 1502 . : milestone, 1479, profiling (1.484 ms) : 1460, 1508 . : milestone, 1484, tracing (1.455 ms) : 1431, 1479 . : milestone, 1455, section candidate no_agent (1.332 ms) : 1313, 1352 . : milestone, 1332, appsec (1.722 ms) : 1699, 1744 . : milestone, 1722, appsec_no_iast (1.742 ms) : 1718, 1766 . : milestone, 1742, iast (1.486 ms) : 1463, 1510 . : milestone, 1486, profiling (1.479 ms) : 1457, 1502 . : milestone, 1479, tracing (1.471 ms) : 1446, 1495 . : milestone, 1471, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.328 ms [1.309 ms, 1.347 ms]|-| |appsec|1.744 ms [1.72 ms, 1.769 ms]|416.154 µs (31.3%)| |appsec_no_iast|1.734 ms [1.711 ms, 1.758 ms]|406.269 µs (30.6%)| |iast|1.479 ms [1.457 ms, 1.502 ms]|151.179 µs (11.4%)| |profiling|1.484 ms [1.46 ms, 1.508 ms]|155.786 µs (11.7%)| |tracing|1.455 ms [1.431 ms, 1.479 ms]|126.712 µs (9.5%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.332 ms [1.313 ms, 1.352 ms]|-| |appsec|1.722 ms [1.699 ms, 1.744 ms]|389.475 µs (29.2%)| |appsec_no_iast|1.742 ms [1.718 ms, 1.766 ms]|410.111 µs (30.8%)| |iast|1.486 ms [1.463 ms, 1.51 ms]|154.261 µs (11.6%)| |profiling|1.479 ms [1.457 ms, 1.502 ms]|147.287 µs (11.1%)| |tracing|1.471 ms [1.446 ms, 1.495 ms]|138.498 µs (10.4%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7779
git_commit_date 1729257196 1729254284
git_commit_sha 00856e02d3 19f44666b2
release_version 1.42.0-SNAPSHOT~00856e02d3 1.42.0-SNAPSHOT~19f44666b2
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1729259319 |1729259319 | |ci_job_id |676840209 |676840209 | |ci_pipeline_id|46913183 |46913183 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~00856e02d3 dateFormat X axisFormat %s section baseline no_agent (1.464 ms) : 1452, 1475 . : milestone, 1464, appsec (2.308 ms) : 2267, 2349 . : milestone, 2308, iast (2.062 ms) : 2010, 2114 . : milestone, 2062, iast_GLOBAL (2.092 ms) : 2040, 2144 . : milestone, 2092, profiling (1.935 ms) : 1894, 1977 . : milestone, 1935, tracing (1.906 ms) : 1866, 1945 . : milestone, 1906, section candidate no_agent (1.459 ms) : 1447, 1470 . : milestone, 1459, appsec (2.31 ms) : 2269, 2352 . : milestone, 2310, iast (2.058 ms) : 2006, 2110 . : milestone, 2058, iast_GLOBAL (2.114 ms) : 2061, 2167 . : milestone, 2114, profiling (1.916 ms) : 1875, 1956 . : milestone, 1916, tracing (1.904 ms) : 1865, 1943 . : milestone, 1904, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.464 ms [1.452 ms, 1.475 ms]|-| |appsec|2.308 ms [2.267 ms, 2.349 ms]|844.414 µs (57.7%)| |iast|2.062 ms [2.01 ms, 2.114 ms]|597.798 µs (40.8%)| |iast_GLOBAL|2.092 ms [2.04 ms, 2.144 ms]|628.061 µs (42.9%)| |profiling|1.935 ms [1.894 ms, 1.977 ms]|471.304 µs (32.2%)| |tracing|1.906 ms [1.866 ms, 1.945 ms]|441.853 µs (30.2%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.459 ms [1.447 ms, 1.47 ms]|-| |appsec|2.31 ms [2.269 ms, 2.352 ms]|851.466 µs (58.4%)| |iast|2.058 ms [2.006 ms, 2.11 ms]|599.652 µs (41.1%)| |iast_GLOBAL|2.114 ms [2.061 ms, 2.167 ms]|655.663 µs (45.0%)| |profiling|1.916 ms [1.875 ms, 1.956 ms]|456.921 µs (31.3%)| |tracing|1.904 ms [1.865 ms, 1.943 ms]|445.725 µs (30.6%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~19f44666b2, baseline=1.42.0-SNAPSHOT~00856e02d3 dateFormat X axisFormat %s section baseline no_agent (15.006 s) : 15006000, 15006000 . : milestone, 15006000, appsec (15.064 s) : 15064000, 15064000 . : milestone, 15064000, iast (18.572 s) : 18572000, 18572000 . : milestone, 18572000, iast_GLOBAL (18.011 s) : 18011000, 18011000 . : milestone, 18011000, profiling (15.201 s) : 15201000, 15201000 . : milestone, 15201000, tracing (14.899 s) : 14899000, 14899000 . : milestone, 14899000, section candidate no_agent (15.384 s) : 15384000, 15384000 . : milestone, 15384000, appsec (15.18 s) : 15180000, 15180000 . : milestone, 15180000, iast (18.953 s) : 18953000, 18953000 . : milestone, 18953000, iast_GLOBAL (17.891 s) : 17891000, 17891000 . : milestone, 17891000, profiling (15.12 s) : 15120000, 15120000 . : milestone, 15120000, tracing (15.077 s) : 15077000, 15077000 . : milestone, 15077000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.006 s [15.006 s, 15.006 s]|-| |appsec|15.064 s [15.064 s, 15.064 s]|58.0 ms (0.4%)| |iast|18.572 s [18.572 s, 18.572 s]|3.566 s (23.8%)| |iast_GLOBAL|18.011 s [18.011 s, 18.011 s]|3.005 s (20.0%)| |profiling|15.201 s [15.201 s, 15.201 s]|195.0 ms (1.3%)| |tracing|14.899 s [14.899 s, 14.899 s]|-107.0 ms (-0.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.384 s [15.384 s, 15.384 s]|-| |appsec|15.18 s [15.18 s, 15.18 s]|-204.0 ms (-1.3%)| |iast|18.953 s [18.953 s, 18.953 s]|3.569 s (23.2%)| |iast_GLOBAL|17.891 s [17.891 s, 17.891 s]|2.507 s (16.3%)| |profiling|15.12 s [15.12 s, 15.12 s]|-264.0 ms (-1.7%)| |tracing|15.077 s [15.077 s, 15.077 s]|-307.0 ms (-2.0%)|