search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Fix code coverage percentage reporting for Android projects #7815

Closed nikita-tkachenko-datadog closed 3 weeks ago

nikita-tkachenko-datadog commented 4 weeks ago

What Does This Do

Fixes code coverage percentage reporting for Android Gradle projects.

Motivation

Gradle projects for Android have a different structure, so calculating source sets (folders for code sources and compiled classes) has to be done differently for them.

Contributor Checklist

Jira ticket: SDTEST-979

pr-commenter[bot] commented 4 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/android-code-coverage
git_commit_date 1729502178 1729505027
git_commit_sha f687c2d038 c9e1416925
release_version 1.42.0-SNAPSHOT~f687c2d038 1.42.0-SNAPSHOT~c9e1416925
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729507414 |1729507414 | |ci_job_id |678105670 |678105670 | |ci_pipeline_id|47021769 |47021769 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 51 metrics, 12 unstable metrics.

Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~c9e1416925, baseline=1.42.0-SNAPSHOT~f687c2d038 dateFormat X axisFormat %s section tracing Agent [baseline] (1.079 s) : 0, 1078618 Total [baseline] (8.552 s) : 0, 8551589 Agent [candidate] (1.076 s) : 0, 1076398 Total [candidate] (8.567 s) : 0, 8567221 section iast Agent [baseline] (1.208 s) : 0, 1208203 Total [baseline] (9.121 s) : 0, 9121127 Agent [candidate] (1.208 s) : 0, 1207508 Total [candidate] (9.102 s) : 0, 9101898 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.205 s) : 0, 1205111 Total [baseline] (9.101 s) : 0, 9100816 Agent [candidate] (1.205 s) : 0, 1204694 Total [candidate] (9.118 s) : 0, 9118041 section iast_TELEMETRY_OFF Agent [baseline] (1.196 s) : 0, 1196097 Total [baseline] (9.121 s) : 0, 9121264 Agent [candidate] (1.198 s) : 0, 1197845 Total [candidate] (9.144 s) : 0, 9144264 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.079 s |-| |Agent|iast|1.208 s |129.585 ms (12.0%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.205 s |126.493 ms (11.7%)| |Agent|iast_TELEMETRY_OFF|1.196 s |117.479 ms (10.9%)| |Total|tracing|8.552 s |-| |Total|iast|9.121 s |569.538 ms (6.7%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.101 s |549.226 ms (6.4%)| |Total|iast_TELEMETRY_OFF|9.121 s |569.675 ms (6.7%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.076 s |-| |Agent|iast|1.208 s |131.11 ms (12.2%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.205 s |128.297 ms (11.9%)| |Agent|iast_TELEMETRY_OFF|1.198 s |121.447 ms (11.3%)| |Total|tracing|8.567 s |-| |Total|iast|9.102 s |534.676 ms (6.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.118 s |550.82 ms (6.4%)| |Total|iast_TELEMETRY_OFF|9.144 s |577.043 ms (6.7%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~c9e1416925, baseline=1.42.0-SNAPSHOT~f687c2d038 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (687.21 ms) : 0, 687210 BytebuddyAgent [candidate] (685.021 ms) : 0, 685021 GlobalTracer [baseline] (313.087 ms) : 0, 313087 GlobalTracer [candidate] (312.916 ms) : 0, 312916 AppSec [baseline] (54.242 ms) : 0, 54242 AppSec [candidate] (53.774 ms) : 0, 53774 Remote Config [baseline] (683.88 µs) : 0, 684 Remote Config [candidate] (676.569 µs) : 0, 677 Telemetry [baseline] (9.678 ms) : 0, 9678 Telemetry [candidate] (10.269 ms) : 0, 10269 section iast BytebuddyAgent [baseline] (805.31 ms) : 0, 805310 BytebuddyAgent [candidate] (805.061 ms) : 0, 805061 GlobalTracer [baseline] (303.714 ms) : 0, 303714 GlobalTracer [candidate] (303.252 ms) : 0, 303252 AppSec [baseline] (55.941 ms) : 0, 55941 AppSec [candidate] (56.859 ms) : 0, 56859 IAST [baseline] (21.811 ms) : 0, 21811 IAST [candidate] (20.922 ms) : 0, 20922 Remote Config [baseline] (612.062 µs) : 0, 612 Remote Config [candidate] (601.129 µs) : 0, 601 Telemetry [baseline] (7.057 ms) : 0, 7057 Telemetry [candidate] (7.031 ms) : 0, 7031 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (803.71 ms) : 0, 803710 BytebuddyAgent [candidate] (802.275 ms) : 0, 802275 GlobalTracer [baseline] (302.054 ms) : 0, 302054 GlobalTracer [candidate] (302.548 ms) : 0, 302548 AppSec [baseline] (57.358 ms) : 0, 57358 AppSec [candidate] (57.03 ms) : 0, 57030 IAST [baseline] (20.483 ms) : 0, 20483 IAST [candidate] (21.319 ms) : 0, 21319 Remote Config [baseline] (605.822 µs) : 0, 606 Remote Config [candidate] (610.435 µs) : 0, 610 Telemetry [baseline] (7.108 ms) : 0, 7108 Telemetry [candidate] (7.156 ms) : 0, 7156 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (795.54 ms) : 0, 795540 BytebuddyAgent [candidate] (796.695 ms) : 0, 796695 GlobalTracer [baseline] (301.265 ms) : 0, 301265 GlobalTracer [candidate] (301.906 ms) : 0, 301906 AppSec [baseline] (57.945 ms) : 0, 57945 AppSec [candidate] (57.74 ms) : 0, 57740 IAST [baseline] (20.056 ms) : 0, 20056 IAST [candidate] (20.145 ms) : 0, 20145 Remote Config [baseline] (613.64 µs) : 0, 614 Remote Config [candidate] (618.041 µs) : 0, 618 Telemetry [baseline] (7.021 ms) : 0, 7021 Telemetry [candidate] (7.055 ms) : 0, 7055 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~c9e1416925, baseline=1.42.0-SNAPSHOT~f687c2d038 dateFormat X axisFormat %s section tracing Agent [baseline] (1.075 s) : 0, 1074801 Total [baseline] (10.473 s) : 0, 10472625 Agent [candidate] (1.076 s) : 0, 1075767 Total [candidate] (10.443 s) : 0, 10443044 section appsec Agent [baseline] (1.213 s) : 0, 1213075 Total [baseline] (10.605 s) : 0, 10604539 Agent [candidate] (1.212 s) : 0, 1212446 Total [candidate] (10.64 s) : 0, 10640105 section iast Agent [baseline] (1.201 s) : 0, 1201294 Total [baseline] (10.863 s) : 0, 10862804 Agent [candidate] (1.21 s) : 0, 1209583 Total [candidate] (10.917 s) : 0, 10917147 section profiling Agent [baseline] (1.271 s) : 0, 1270771 Total [baseline] (10.675 s) : 0, 10675327 Agent [candidate] (1.274 s) : 0, 1274351 Total [candidate] (10.691 s) : 0, 10691356 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.075 s |-| |Agent|appsec|1.213 s |138.274 ms (12.9%)| |Agent|iast|1.201 s |126.493 ms (11.8%)| |Agent|profiling|1.271 s |195.971 ms (18.2%)| |Total|tracing|10.473 s |-| |Total|appsec|10.605 s |131.914 ms (1.3%)| |Total|iast|10.863 s |390.179 ms (3.7%)| |Total|profiling|10.675 s |202.701 ms (1.9%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.076 s |-| |Agent|appsec|1.212 s |136.679 ms (12.7%)| |Agent|iast|1.21 s |133.816 ms (12.4%)| |Agent|profiling|1.274 s |198.584 ms (18.5%)| |Total|tracing|10.443 s |-| |Total|appsec|10.64 s |197.062 ms (1.9%)| |Total|iast|10.917 s |474.103 ms (4.5%)| |Total|profiling|10.691 s |248.313 ms (2.4%)| ```mermaid gantt title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~c9e1416925, baseline=1.42.0-SNAPSHOT~f687c2d038 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (684.657 ms) : 0, 684657 BytebuddyAgent [candidate] (686.155 ms) : 0, 686155 GlobalTracer [baseline] (313.142 ms) : 0, 313142 GlobalTracer [candidate] (313.175 ms) : 0, 313175 AppSec [baseline] (53.83 ms) : 0, 53830 AppSec [candidate] (53.852 ms) : 0, 53852 Remote Config [baseline] (667.595 µs) : 0, 668 Remote Config [candidate] (670.575 µs) : 0, 671 Telemetry [baseline] (8.849 ms) : 0, 8849 Telemetry [candidate] (8.233 ms) : 0, 8233 section appsec BytebuddyAgent [baseline] (704.562 ms) : 0, 704562 BytebuddyAgent [candidate] (702.768 ms) : 0, 702768 GlobalTracer [baseline] (311.349 ms) : 0, 311349 GlobalTracer [candidate] (311.035 ms) : 0, 311035 AppSec [baseline] (164.67 ms) : 0, 164670 AppSec [candidate] (165.989 ms) : 0, 165989 Remote Config [baseline] (640.744 µs) : 0, 641 Remote Config [candidate] (636.302 µs) : 0, 636 Telemetry [baseline] (7.793 ms) : 0, 7793 Telemetry [candidate] (7.482 ms) : 0, 7482 IAST [baseline] (20.729 ms) : 0, 20729 IAST [candidate] (21.741 ms) : 0, 21741 section iast BytebuddyAgent [baseline] (799.599 ms) : 0, 799599 BytebuddyAgent [candidate] (806.108 ms) : 0, 806108 GlobalTracer [baseline] (302.327 ms) : 0, 302327 GlobalTracer [candidate] (303.678 ms) : 0, 303678 AppSec [baseline] (56.253 ms) : 0, 56253 AppSec [candidate] (57.731 ms) : 0, 57731 Remote Config [baseline] (596.627 µs) : 0, 597 Remote Config [candidate] (617.84 µs) : 0, 618 Telemetry [baseline] (7.846 ms) : 0, 7846 Telemetry [candidate] (7.14 ms) : 0, 7140 IAST [baseline] (21.007 ms) : 0, 21007 IAST [candidate] (20.559 ms) : 0, 20559 section profiling ProfilingAgent [baseline] (89.87 ms) : 0, 89870 ProfilingAgent [candidate] (92.512 ms) : 0, 92512 BytebuddyAgent [baseline] (678.007 ms) : 0, 678007 BytebuddyAgent [candidate] (679.704 ms) : 0, 679704 GlobalTracer [baseline] (396.295 ms) : 0, 396295 GlobalTracer [candidate] (396.476 ms) : 0, 396476 AppSec [baseline] (54.289 ms) : 0, 54289 AppSec [candidate] (54.676 ms) : 0, 54676 Remote Config [baseline] (650.347 µs) : 0, 650 Remote Config [candidate] (650.516 µs) : 0, 651 Telemetry [baseline] (13.007 ms) : 0, 13007 Telemetry [candidate] (11.588 ms) : 0, 11588 Profiling [baseline] (89.894 ms) : 0, 89894 Profiling [candidate] (92.535 ms) : 0, 92535 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-21T10:15:51 2024-10-21T10:22:45
git_branch master nikita-tkachenko/android-code-coverage
git_commit_date 1729502178 1729505027
git_commit_sha f687c2d038 c9e1416925
release_version 1.42.0-SNAPSHOT~f687c2d038 1.42.0-SNAPSHOT~c9e1416925
start_time 2024-10-21T10:15:38 2024-10-21T10:22:31
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729506513 |1729506513 | |ci_job_id |678105671 |678105671 | |ci_pipeline_id|47021769 |47021769 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~c9e1416925, baseline=1.42.0-SNAPSHOT~f687c2d038 dateFormat X axisFormat %s section baseline no_agent (378.97 µs) : 359, 399 . : milestone, 379, iast (486.636 µs) : 465, 508 . : milestone, 487, iast_FULL (557.088 µs) : 536, 579 . : milestone, 557, iast_GLOBAL (517.653 µs) : 495, 540 . : milestone, 518, iast_HARDCODED_SECRET_DISABLED (489.658 µs) : 469, 511 . : milestone, 490, iast_INACTIVE (451.565 µs) : 431, 473 . : milestone, 452, iast_TELEMETRY_OFF (477.325 µs) : 456, 499 . : milestone, 477, tracing (453.637 µs) : 433, 474 . : milestone, 454, section candidate no_agent (380.236 µs) : 360, 400 . : milestone, 380, iast (491.486 µs) : 470, 513 . : milestone, 491, iast_FULL (553.856 µs) : 533, 575 . : milestone, 554, iast_GLOBAL (513.685 µs) : 492, 535 . : milestone, 514, iast_HARDCODED_SECRET_DISABLED (491.064 µs) : 470, 512 . : milestone, 491, iast_INACTIVE (453.684 µs) : 433, 475 . : milestone, 454, iast_TELEMETRY_OFF (480.092 µs) : 459, 502 . : milestone, 480, tracing (445.447 µs) : 425, 466 . : milestone, 445, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|378.97 µs [358.616 µs, 399.324 µs]|-| |iast|486.636 µs [465.319 µs, 507.953 µs]|107.666 µs (28.4%)| |iast_FULL|557.088 µs [535.525 µs, 578.651 µs]|178.118 µs (47.0%)| |iast_GLOBAL|517.653 µs [494.909 µs, 540.397 µs]|138.683 µs (36.6%)| |iast_HARDCODED_SECRET_DISABLED|489.658 µs [468.512 µs, 510.803 µs]|110.687 µs (29.2%)| |iast_INACTIVE|451.565 µs [430.545 µs, 472.584 µs]|72.595 µs (19.2%)| |iast_TELEMETRY_OFF|477.325 µs [455.99 µs, 498.66 µs]|98.355 µs (26.0%)| |tracing|453.637 µs [432.965 µs, 474.309 µs]|74.667 µs (19.7%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|380.236 µs [360.389 µs, 400.083 µs]|-| |iast|491.486 µs [470.179 µs, 512.794 µs]|111.25 µs (29.3%)| |iast_FULL|553.856 µs [532.706 µs, 575.005 µs]|173.62 µs (45.7%)| |iast_GLOBAL|513.685 µs [491.966 µs, 535.405 µs]|133.449 µs (35.1%)| |iast_HARDCODED_SECRET_DISABLED|491.064 µs [469.707 µs, 512.421 µs]|110.828 µs (29.1%)| |iast_INACTIVE|453.684 µs [432.648 µs, 474.72 µs]|73.448 µs (19.3%)| |iast_TELEMETRY_OFF|480.092 µs [458.644 µs, 501.54 µs]|99.856 µs (26.3%)| |tracing|445.447 µs [424.955 µs, 465.94 µs]|65.211 µs (17.2%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~c9e1416925, baseline=1.42.0-SNAPSHOT~f687c2d038 dateFormat X axisFormat %s section baseline no_agent (1.342 ms) : 1322, 1361 . : milestone, 1342, appsec (1.724 ms) : 1701, 1747 . : milestone, 1724, appsec_no_iast (1.718 ms) : 1694, 1742 . : milestone, 1718, iast (1.471 ms) : 1448, 1494 . : milestone, 1471, profiling (1.488 ms) : 1466, 1511 . : milestone, 1488, tracing (1.472 ms) : 1448, 1496 . : milestone, 1472, section candidate no_agent (1.353 ms) : 1334, 1373 . : milestone, 1353, appsec (1.718 ms) : 1693, 1742 . : milestone, 1718, appsec_no_iast (1.75 ms) : 1725, 1774 . : milestone, 1750, iast (1.494 ms) : 1471, 1517 . : milestone, 1494, profiling (1.486 ms) : 1463, 1509 . : milestone, 1486, tracing (1.46 ms) : 1435, 1484 . : milestone, 1460, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.342 ms [1.322 ms, 1.361 ms]|-| |appsec|1.724 ms [1.701 ms, 1.747 ms]|382.093 µs (28.5%)| |appsec_no_iast|1.718 ms [1.694 ms, 1.742 ms]|376.195 µs (28.0%)| |iast|1.471 ms [1.448 ms, 1.494 ms]|129.199 µs (9.6%)| |profiling|1.488 ms [1.466 ms, 1.511 ms]|146.842 µs (10.9%)| |tracing|1.472 ms [1.448 ms, 1.496 ms]|130.092 µs (9.7%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.353 ms [1.334 ms, 1.373 ms]|-| |appsec|1.718 ms [1.693 ms, 1.742 ms]|364.448 µs (26.9%)| |appsec_no_iast|1.75 ms [1.725 ms, 1.774 ms]|396.403 µs (29.3%)| |iast|1.494 ms [1.471 ms, 1.517 ms]|141.176 µs (10.4%)| |profiling|1.486 ms [1.463 ms, 1.509 ms]|132.569 µs (9.8%)| |tracing|1.46 ms [1.435 ms, 1.484 ms]|106.545 µs (7.9%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/android-code-coverage
git_commit_date 1729502178 1729505027
git_commit_sha f687c2d038 c9e1416925
release_version 1.42.0-SNAPSHOT~f687c2d038 1.42.0-SNAPSHOT~c9e1416925
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1729507069 |1729507069 | |ci_job_id |678105672 |678105672 | |ci_pipeline_id|47021769 |47021769 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~c9e1416925, baseline=1.42.0-SNAPSHOT~f687c2d038 dateFormat X axisFormat %s section baseline no_agent (1.465 ms) : 1454, 1477 . : milestone, 1465, appsec (2.312 ms) : 2272, 2353 . : milestone, 2312, iast (2.065 ms) : 2014, 2117 . : milestone, 2065, iast_GLOBAL (2.111 ms) : 2058, 2164 . : milestone, 2111, profiling (1.949 ms) : 1907, 1991 . : milestone, 1949, tracing (1.91 ms) : 1871, 1949 . : milestone, 1910, section candidate no_agent (1.466 ms) : 1454, 1478 . : milestone, 1466, appsec (2.335 ms) : 2294, 2376 . : milestone, 2335, iast (2.072 ms) : 2020, 2124 . : milestone, 2072, iast_GLOBAL (2.114 ms) : 2062, 2167 . : milestone, 2114, profiling (1.934 ms) : 1892, 1977 . : milestone, 1934, tracing (1.916 ms) : 1876, 1955 . : milestone, 1916, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.465 ms [1.454 ms, 1.477 ms]|-| |appsec|2.312 ms [2.272 ms, 2.353 ms]|847.036 µs (57.8%)| |iast|2.065 ms [2.014 ms, 2.117 ms]|599.851 µs (40.9%)| |iast_GLOBAL|2.111 ms [2.058 ms, 2.164 ms]|646.038 µs (44.1%)| |profiling|1.949 ms [1.907 ms, 1.991 ms]|483.557 µs (33.0%)| |tracing|1.91 ms [1.871 ms, 1.949 ms]|444.474 µs (30.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.466 ms [1.454 ms, 1.478 ms]|-| |appsec|2.335 ms [2.294 ms, 2.376 ms]|869.273 µs (59.3%)| |iast|2.072 ms [2.02 ms, 2.124 ms]|606.368 µs (41.4%)| |iast_GLOBAL|2.114 ms [2.062 ms, 2.167 ms]|648.371 µs (44.2%)| |profiling|1.934 ms [1.892 ms, 1.977 ms]|468.11 µs (31.9%)| |tracing|1.916 ms [1.876 ms, 1.955 ms]|449.466 µs (30.7%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~c9e1416925, baseline=1.42.0-SNAPSHOT~f687c2d038 dateFormat X axisFormat %s section baseline no_agent (15.071 s) : 15071000, 15071000 . : milestone, 15071000, appsec (15.152 s) : 15152000, 15152000 . : milestone, 15152000, iast (18.942 s) : 18942000, 18942000 . : milestone, 18942000, iast_GLOBAL (18.029 s) : 18029000, 18029000 . : milestone, 18029000, profiling (15.744 s) : 15744000, 15744000 . : milestone, 15744000, tracing (15.293 s) : 15293000, 15293000 . : milestone, 15293000, section candidate no_agent (15.554 s) : 15554000, 15554000 . : milestone, 15554000, appsec (15.23 s) : 15230000, 15230000 . : milestone, 15230000, iast (19.087 s) : 19087000, 19087000 . : milestone, 19087000, iast_GLOBAL (18.198 s) : 18198000, 18198000 . : milestone, 18198000, profiling (15.203 s) : 15203000, 15203000 . : milestone, 15203000, tracing (15.149 s) : 15149000, 15149000 . : milestone, 15149000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.071 s [15.071 s, 15.071 s]|-| |appsec|15.152 s [15.152 s, 15.152 s]|81.0 ms (0.5%)| |iast|18.942 s [18.942 s, 18.942 s]|3.871 s (25.7%)| |iast_GLOBAL|18.029 s [18.029 s, 18.029 s]|2.958 s (19.6%)| |profiling|15.744 s [15.744 s, 15.744 s]|673.0 ms (4.5%)| |tracing|15.293 s [15.293 s, 15.293 s]|222.0 ms (1.5%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.554 s [15.554 s, 15.554 s]|-| |appsec|15.23 s [15.23 s, 15.23 s]|-324.0 ms (-2.1%)| |iast|19.087 s [19.087 s, 19.087 s]|3.533 s (22.7%)| |iast_GLOBAL|18.198 s [18.198 s, 18.198 s]|2.644 s (17.0%)| |profiling|15.203 s [15.203 s, 15.203 s]|-351.0 ms (-2.3%)| |tracing|15.149 s [15.149 s, 15.149 s]|-405.0 ms (-2.6%)|