search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Fix automatic coverage includes calculation for headless test sessions #7784

Closed nikita-tkachenko-datadog closed 1 month ago

nikita-tkachenko-datadog commented 1 month ago

What Does This Do

Fixes automatic configuration of code coverage-enabled packages for headless sessions.

Motivation

"Headless" sessions are those where the build system is not instrumented. At the moment we support instrumenting Maven and Gradle, so when a Maven or a Gradle build is traced, the tracer is injected into the parent build system process. The list of coverage-enabled packages is computed in the parent process and is then propagated to children.

For headless sessions, where there is no instrumented parent process, the list of packages needs to be computed inside the child process (JVM that runs the tests).

Contributor Checklist

Jira ticket: SDTEST-1130

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/fix-coverage-includes-for-headless
git_commit_date 1729113612 1729166832
git_commit_sha b53b6dc565 2e701d4fbf
release_version 1.41.0-SNAPSHOT~b53b6dc565 1.41.0-SNAPSHOT~2e701d4fbf
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729169319 |1729169319 | |ci_job_id |675271252 |675271252 | |ci_pipeline_id|46809152 |46809152 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 8 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~2e701d4fbf, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section tracing Agent [baseline] (1.081 s) : 0, 1081031 Total [baseline] (10.336 s) : 0, 10336076 Agent [candidate] (1.073 s) : 0, 1072900 Total [candidate] (10.431 s) : 0, 10430931 section appsec Agent [baseline] (1.203 s) : 0, 1202781 Total [baseline] (10.613 s) : 0, 10612663 Agent [candidate] (1.211 s) : 0, 1210955 Total [candidate] (10.605 s) : 0, 10604666 section iast Agent [baseline] (1.206 s) : 0, 1205581 Total [baseline] (10.847 s) : 0, 10847185 Agent [candidate] (1.202 s) : 0, 1201774 Total [candidate] (10.897 s) : 0, 10897060 section profiling Agent [baseline] (1.274 s) : 0, 1273977 Total [baseline] (10.647 s) : 0, 10646931 Agent [candidate] (1.284 s) : 0, 1283515 Total [candidate] (10.792 s) : 0, 10792017 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.081 s |-| |Agent|appsec|1.203 s |121.75 ms (11.3%)| |Agent|iast|1.206 s |124.55 ms (11.5%)| |Agent|profiling|1.274 s |192.946 ms (17.8%)| |Total|tracing|10.336 s |-| |Total|appsec|10.613 s |276.587 ms (2.7%)| |Total|iast|10.847 s |511.109 ms (4.9%)| |Total|profiling|10.647 s |310.855 ms (3.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.073 s |-| |Agent|appsec|1.211 s |138.056 ms (12.9%)| |Agent|iast|1.202 s |128.874 ms (12.0%)| |Agent|profiling|1.284 s |210.615 ms (19.6%)| |Total|tracing|10.431 s |-| |Total|appsec|10.605 s |173.736 ms (1.7%)| |Total|iast|10.897 s |466.129 ms (4.5%)| |Total|profiling|10.792 s |361.086 ms (3.5%)| ```mermaid gantt title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~2e701d4fbf, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (688.497 ms) : 0, 688497 BytebuddyAgent [candidate] (683.658 ms) : 0, 683658 GlobalTracer [baseline] (316.124 ms) : 0, 316124 GlobalTracer [candidate] (313.547 ms) : 0, 313547 AppSec [baseline] (54.43 ms) : 0, 54430 AppSec [candidate] (53.873 ms) : 0, 53873 Remote Config [baseline] (673.107 µs) : 0, 673 Remote Config [candidate] (659.321 µs) : 0, 659 Telemetry [baseline] (7.564 ms) : 0, 7564 Telemetry [candidate] (7.488 ms) : 0, 7488 section appsec BytebuddyAgent [baseline] (698.28 ms) : 0, 698280 BytebuddyAgent [candidate] (702.288 ms) : 0, 702288 GlobalTracer [baseline] (308.985 ms) : 0, 308985 GlobalTracer [candidate] (310.855 ms) : 0, 310855 AppSec [baseline] (161.714 ms) : 0, 161714 AppSec [candidate] (164.193 ms) : 0, 164193 Remote Config [baseline] (634.935 µs) : 0, 635 Remote Config [candidate] (638.015 µs) : 0, 638 Telemetry [baseline] (9.184 ms) : 0, 9184 Telemetry [candidate] (9.149 ms) : 0, 9149 IAST [baseline] (20.775 ms) : 0, 20775 IAST [candidate] (20.269 ms) : 0, 20269 section iast BytebuddyAgent [baseline] (802.894 ms) : 0, 802894 BytebuddyAgent [candidate] (800.141 ms) : 0, 800141 GlobalTracer [baseline] (303.342 ms) : 0, 303342 GlobalTracer [candidate] (302.056 ms) : 0, 302056 AppSec [baseline] (55.819 ms) : 0, 55819 AppSec [candidate] (56.246 ms) : 0, 56246 Remote Config [baseline] (594.202 µs) : 0, 594 Remote Config [candidate] (603.148 µs) : 0, 603 Telemetry [baseline] (7.065 ms) : 0, 7065 Telemetry [candidate] (7.054 ms) : 0, 7054 IAST [baseline] (22.131 ms) : 0, 22131 IAST [candidate] (21.988 ms) : 0, 21988 section profiling BytebuddyAgent [baseline] (679.323 ms) : 0, 679323 BytebuddyAgent [candidate] (682.408 ms) : 0, 682408 GlobalTracer [baseline] (396.865 ms) : 0, 396865 GlobalTracer [candidate] (400.654 ms) : 0, 400654 AppSec [baseline] (54.26 ms) : 0, 54260 AppSec [candidate] (55.297 ms) : 0, 55297 Remote Config [baseline] (648.402 µs) : 0, 648 Remote Config [candidate] (655.739 µs) : 0, 656 Telemetry [baseline] (7.452 ms) : 0, 7452 Telemetry [candidate] (7.582 ms) : 0, 7582 ProfilingAgent [baseline] (96.637 ms) : 0, 96637 ProfilingAgent [candidate] (97.994 ms) : 0, 97994 Profiling [baseline] (96.661 ms) : 0, 96661 Profiling [candidate] (98.018 ms) : 0, 98018 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~2e701d4fbf, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section tracing Agent [baseline] (1.072 s) : 0, 1071969 Total [baseline] (8.57 s) : 0, 8569958 Agent [candidate] (1.071 s) : 0, 1071413 Total [candidate] (8.546 s) : 0, 8546027 section iast Agent [baseline] (1.198 s) : 0, 1197998 Total [baseline] (9.113 s) : 0, 9112960 Agent [candidate] (1.199 s) : 0, 1199369 Total [candidate] (9.098 s) : 0, 9097607 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.199 s) : 0, 1198756 Total [baseline] (9.046 s) : 0, 9045991 Agent [candidate] (1.201 s) : 0, 1200685 Total [candidate] (9.099 s) : 0, 9098904 section iast_TELEMETRY_OFF Agent [baseline] (1.197 s) : 0, 1197288 Total [baseline] (9.073 s) : 0, 9073458 Agent [candidate] (1.197 s) : 0, 1196646 Total [candidate] (9.089 s) : 0, 9088577 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.072 s |-| |Agent|iast|1.198 s |126.029 ms (11.8%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.199 s |126.787 ms (11.8%)| |Agent|iast_TELEMETRY_OFF|1.197 s |125.319 ms (11.7%)| |Total|tracing|8.57 s |-| |Total|iast|9.113 s |543.002 ms (6.3%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.046 s |476.033 ms (5.6%)| |Total|iast_TELEMETRY_OFF|9.073 s |503.5 ms (5.9%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.071 s |-| |Agent|iast|1.199 s |127.956 ms (11.9%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.201 s |129.272 ms (12.1%)| |Agent|iast_TELEMETRY_OFF|1.197 s |125.233 ms (11.7%)| |Total|tracing|8.546 s |-| |Total|iast|9.098 s |551.58 ms (6.5%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.099 s |552.877 ms (6.5%)| |Total|iast_TELEMETRY_OFF|9.089 s |542.55 ms (6.3%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~2e701d4fbf, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (683.479 ms) : 0, 683479 BytebuddyAgent [candidate] (682.954 ms) : 0, 682954 GlobalTracer [baseline] (312.87 ms) : 0, 312870 GlobalTracer [candidate] (312.851 ms) : 0, 312851 AppSec [baseline] (53.893 ms) : 0, 53893 AppSec [candidate] (53.764 ms) : 0, 53764 Remote Config [baseline] (658.041 µs) : 0, 658 Remote Config [candidate] (669.486 µs) : 0, 669 Telemetry [baseline] (7.439 ms) : 0, 7439 Telemetry [candidate] (7.514 ms) : 0, 7514 section iast BytebuddyAgent [baseline] (798.031 ms) : 0, 798031 BytebuddyAgent [candidate] (798.138 ms) : 0, 798138 GlobalTracer [baseline] (301.37 ms) : 0, 301370 GlobalTracer [candidate] (301.862 ms) : 0, 301862 AppSec [baseline] (54.572 ms) : 0, 54572 AppSec [candidate] (56.044 ms) : 0, 56044 IAST [baseline] (22.675 ms) : 0, 22675 IAST [candidate] (22.013 ms) : 0, 22013 Remote Config [baseline] (602.368 µs) : 0, 602 Remote Config [candidate] (604.885 µs) : 0, 605 Telemetry [baseline] (7.048 ms) : 0, 7048 Telemetry [candidate] (7.039 ms) : 0, 7039 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (797.447 ms) : 0, 797447 BytebuddyAgent [candidate] (798.049 ms) : 0, 798049 GlobalTracer [baseline] (301.661 ms) : 0, 301661 GlobalTracer [candidate] (301.87 ms) : 0, 301870 AppSec [baseline] (54.819 ms) : 0, 54819 AppSec [candidate] (57.285 ms) : 0, 57285 IAST [baseline] (23.56 ms) : 0, 23560 IAST [candidate] (22.093 ms) : 0, 22093 Remote Config [baseline] (600.321 µs) : 0, 600 Remote Config [candidate] (606.341 µs) : 0, 606 Telemetry [baseline] (7.025 ms) : 0, 7025 Telemetry [candidate] (7.096 ms) : 0, 7096 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (795.804 ms) : 0, 795804 BytebuddyAgent [candidate] (795.277 ms) : 0, 795277 GlobalTracer [baseline] (302.309 ms) : 0, 302309 GlobalTracer [candidate] (301.833 ms) : 0, 301833 AppSec [baseline] (56.181 ms) : 0, 56181 AppSec [candidate] (54.863 ms) : 0, 54863 IAST [baseline] (21.72 ms) : 0, 21720 IAST [candidate] (23.403 ms) : 0, 23403 Remote Config [baseline] (603.352 µs) : 0, 603 Remote Config [candidate] (616.677 µs) : 0, 617 Telemetry [baseline] (6.962 ms) : 0, 6962 Telemetry [candidate] (6.964 ms) : 0, 6964 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-17T12:19:05 2024-10-17T12:25:58
git_branch master nikita-tkachenko/fix-coverage-includes-for-headless
git_commit_date 1729113612 1729166832
git_commit_sha b53b6dc565 2e701d4fbf
release_version 1.41.0-SNAPSHOT~b53b6dc565 1.41.0-SNAPSHOT~2e701d4fbf
start_time 2024-10-17T12:18:52 2024-10-17T12:25:45
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729168305 |1729168305 | |ci_job_id |675271253 |675271253 | |ci_pipeline_id|46809152 |46809152 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~2e701d4fbf, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section baseline no_agent (362.363 µs) : 343, 382 . : milestone, 362, iast (487.345 µs) : 466, 509 . : milestone, 487, iast_FULL (546.888 µs) : 526, 568 . : milestone, 547, iast_GLOBAL (503.948 µs) : 482, 526 . : milestone, 504, iast_HARDCODED_SECRET_DISABLED (483.264 µs) : 461, 505 . : milestone, 483, iast_INACTIVE (445.57 µs) : 424, 467 . : milestone, 446, iast_TELEMETRY_OFF (470.115 µs) : 448, 492 . : milestone, 470, tracing (443.057 µs) : 422, 464 . : milestone, 443, section candidate no_agent (378.763 µs) : 357, 400 . : milestone, 379, iast (487.719 µs) : 466, 510 . : milestone, 488, iast_FULL (553.529 µs) : 532, 575 . : milestone, 554, iast_GLOBAL (511.215 µs) : 489, 533 . : milestone, 511, iast_HARDCODED_SECRET_DISABLED (483.544 µs) : 462, 505 . : milestone, 484, iast_INACTIVE (444.385 µs) : 423, 465 . : milestone, 444, iast_TELEMETRY_OFF (469.912 µs) : 449, 491 . : milestone, 470, tracing (446.784 µs) : 425, 469 . : milestone, 447, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|362.363 µs [343.089 µs, 381.638 µs]|-| |iast|487.345 µs [465.785 µs, 508.906 µs]|124.982 µs (34.5%)| |iast_FULL|546.888 µs [525.764 µs, 568.011 µs]|184.524 µs (50.9%)| |iast_GLOBAL|503.948 µs [481.597 µs, 526.3 µs]|141.585 µs (39.1%)| |iast_HARDCODED_SECRET_DISABLED|483.264 µs [461.396 µs, 505.132 µs]|120.901 µs (33.4%)| |iast_INACTIVE|445.57 µs [424.497 µs, 466.643 µs]|83.207 µs (23.0%)| |iast_TELEMETRY_OFF|470.115 µs [448.457 µs, 491.773 µs]|107.751 µs (29.7%)| |tracing|443.057 µs [421.676 µs, 464.438 µs]|80.694 µs (22.3%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|378.763 µs [357.386 µs, 400.14 µs]|-| |iast|487.719 µs [465.515 µs, 509.923 µs]|108.956 µs (28.8%)| |iast_FULL|553.529 µs [532.23 µs, 574.829 µs]|174.766 µs (46.1%)| |iast_GLOBAL|511.215 µs [489.065 µs, 533.364 µs]|132.451 µs (35.0%)| |iast_HARDCODED_SECRET_DISABLED|483.544 µs [462.056 µs, 505.032 µs]|104.781 µs (27.7%)| |iast_INACTIVE|444.385 µs [423.457 µs, 465.313 µs]|65.622 µs (17.3%)| |iast_TELEMETRY_OFF|469.912 µs [448.675 µs, 491.15 µs]|91.149 µs (24.1%)| |tracing|446.784 µs [424.955 µs, 468.613 µs]|68.021 µs (18.0%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~2e701d4fbf, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section baseline no_agent (1.346 ms) : 1327, 1365 . : milestone, 1346, appsec (1.71 ms) : 1686, 1734 . : milestone, 1710, appsec_no_iast (1.728 ms) : 1703, 1752 . : milestone, 1728, iast (1.477 ms) : 1454, 1500 . : milestone, 1477, profiling (1.538 ms) : 1514, 1563 . : milestone, 1538, tracing (1.479 ms) : 1455, 1503 . : milestone, 1479, section candidate no_agent (1.327 ms) : 1308, 1346 . : milestone, 1327, appsec (1.708 ms) : 1683, 1733 . : milestone, 1708, appsec_no_iast (1.723 ms) : 1699, 1747 . : milestone, 1723, iast (1.473 ms) : 1450, 1496 . : milestone, 1473, profiling (1.515 ms) : 1490, 1540 . : milestone, 1515, tracing (1.485 ms) : 1461, 1509 . : milestone, 1485, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.346 ms [1.327 ms, 1.365 ms]|-| |appsec|1.71 ms [1.686 ms, 1.734 ms]|363.522 µs (27.0%)| |appsec_no_iast|1.728 ms [1.703 ms, 1.752 ms]|381.452 µs (28.3%)| |iast|1.477 ms [1.454 ms, 1.5 ms]|130.917 µs (9.7%)| |profiling|1.538 ms [1.514 ms, 1.563 ms]|192.143 µs (14.3%)| |tracing|1.479 ms [1.455 ms, 1.503 ms]|133.124 µs (9.9%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.327 ms [1.308 ms, 1.346 ms]|-| |appsec|1.708 ms [1.683 ms, 1.733 ms]|380.516 µs (28.7%)| |appsec_no_iast|1.723 ms [1.699 ms, 1.747 ms]|395.868 µs (29.8%)| |iast|1.473 ms [1.45 ms, 1.496 ms]|145.546 µs (11.0%)| |profiling|1.515 ms [1.49 ms, 1.54 ms]|188.001 µs (14.2%)| |tracing|1.485 ms [1.461 ms, 1.509 ms]|158.049 µs (11.9%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/fix-coverage-includes-for-headless
git_commit_date 1729113612 1729166832
git_commit_sha b53b6dc565 2e701d4fbf
release_version 1.41.0-SNAPSHOT~b53b6dc565 1.41.0-SNAPSHOT~2e701d4fbf
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1729168835 |1729168835 | |ci_job_id |675271254 |675271254 | |ci_pipeline_id|46809152 |46809152 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~2e701d4fbf, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section baseline no_agent (15.097 s) : 15097000, 15097000 . : milestone, 15097000, appsec (15.196 s) : 15196000, 15196000 . : milestone, 15196000, iast (18.865 s) : 18865000, 18865000 . : milestone, 18865000, iast_GLOBAL (17.934 s) : 17934000, 17934000 . : milestone, 17934000, profiling (15.275 s) : 15275000, 15275000 . : milestone, 15275000, tracing (15.483 s) : 15483000, 15483000 . : milestone, 15483000, section candidate no_agent (15.59 s) : 15590000, 15590000 . : milestone, 15590000, appsec (15.313 s) : 15313000, 15313000 . : milestone, 15313000, iast (19.145 s) : 19145000, 19145000 . : milestone, 19145000, iast_GLOBAL (17.864 s) : 17864000, 17864000 . : milestone, 17864000, profiling (15.137 s) : 15137000, 15137000 . : milestone, 15137000, tracing (15.077 s) : 15077000, 15077000 . : milestone, 15077000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.097 s [15.097 s, 15.097 s]|-| |appsec|15.196 s [15.196 s, 15.196 s]|99.0 ms (0.7%)| |iast|18.865 s [18.865 s, 18.865 s]|3.768 s (25.0%)| |iast_GLOBAL|17.934 s [17.934 s, 17.934 s]|2.837 s (18.8%)| |profiling|15.275 s [15.275 s, 15.275 s]|178.0 ms (1.2%)| |tracing|15.483 s [15.483 s, 15.483 s]|386.0 ms (2.6%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.59 s [15.59 s, 15.59 s]|-| |appsec|15.313 s [15.313 s, 15.313 s]|-277.0 ms (-1.8%)| |iast|19.145 s [19.145 s, 19.145 s]|3.555 s (22.8%)| |iast_GLOBAL|17.864 s [17.864 s, 17.864 s]|2.274 s (14.6%)| |profiling|15.137 s [15.137 s, 15.137 s]|-453.0 ms (-2.9%)| |tracing|15.077 s [15.077 s, 15.077 s]|-513.0 ms (-3.3%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~2e701d4fbf, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section baseline no_agent (1.465 ms) : 1453, 1476 . : milestone, 1465, appsec (2.323 ms) : 2281, 2364 . : milestone, 2323, iast (2.071 ms) : 2019, 2123 . : milestone, 2071, iast_GLOBAL (2.113 ms) : 2060, 2165 . : milestone, 2113, profiling (1.944 ms) : 1901, 1987 . : milestone, 1944, tracing (1.905 ms) : 1866, 1945 . : milestone, 1905, section candidate no_agent (1.467 ms) : 1455, 1478 . : milestone, 1467, appsec (2.307 ms) : 2266, 2347 . : milestone, 2307, iast (2.074 ms) : 2022, 2126 . : milestone, 2074, iast_GLOBAL (2.107 ms) : 2054, 2159 . : milestone, 2107, profiling (1.927 ms) : 1886, 1968 . : milestone, 1927, tracing (1.914 ms) : 1873, 1954 . : milestone, 1914, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.465 ms [1.453 ms, 1.476 ms]|-| |appsec|2.323 ms [2.281 ms, 2.364 ms]|858.069 µs (58.6%)| |iast|2.071 ms [2.019 ms, 2.123 ms]|605.879 µs (41.4%)| |iast_GLOBAL|2.113 ms [2.06 ms, 2.165 ms]|647.709 µs (44.2%)| |profiling|1.944 ms [1.901 ms, 1.987 ms]|478.984 µs (32.7%)| |tracing|1.905 ms [1.866 ms, 1.945 ms]|440.653 µs (30.1%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.467 ms [1.455 ms, 1.478 ms]|-| |appsec|2.307 ms [2.266 ms, 2.347 ms]|839.878 µs (57.3%)| |iast|2.074 ms [2.022 ms, 2.126 ms]|607.594 µs (41.4%)| |iast_GLOBAL|2.107 ms [2.054 ms, 2.159 ms]|639.996 µs (43.6%)| |profiling|1.927 ms [1.886 ms, 1.968 ms]|460.493 µs (31.4%)| |tracing|1.914 ms [1.873 ms, 1.954 ms]|446.87 µs (30.5%)|