search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
573 stars 284 forks source link

Nikita tkachenko/class match cache #7584

Closed nikita-tkachenko-datadog closed 2 weeks ago

nikita-tkachenko-datadog commented 3 weeks ago

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 3 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/class-match-cache
git_commit_date 1725887583 1725889789
git_commit_sha 3fd417447a f3b46e32e9
release_version 1.40.0-SNAPSHOT~3fd417447a 1.39.0-SNAPSHOT~f3b46e32e9
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725892317 |1725892317 | |ci_job_id |631981664 |631981664 | |ci_pipeline_id|43858159 |43858159 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.39.0-SNAPSHOT~f3b46e32e9, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section tracing Agent [baseline] (1.049 s) : 0, 1049350 Total [baseline] (10.361 s) : 0, 10361127 Agent [candidate] (1.051 s) : 0, 1050584 Total [candidate] (10.453 s) : 0, 10452681 section appsec Agent [baseline] (1.179 s) : 0, 1178754 Total [baseline] (10.549 s) : 0, 10548525 Agent [candidate] (1.179 s) : 0, 1178743 Total [candidate] (10.465 s) : 0, 10465242 section iast Agent [baseline] (1.177 s) : 0, 1177126 Total [baseline] (10.926 s) : 0, 10925547 Agent [candidate] (1.176 s) : 0, 1175907 Total [candidate] (10.847 s) : 0, 10846996 section profiling Agent [baseline] (1.242 s) : 0, 1242187 Total [baseline] (10.576 s) : 0, 10576262 Agent [candidate] (1.265 s) : 0, 1265295 Total [candidate] (10.649 s) : 0, 10648857 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.049 s |-| |Agent|appsec|1.179 s |129.404 ms (12.3%)| |Agent|iast|1.177 s |127.776 ms (12.2%)| |Agent|profiling|1.242 s |192.837 ms (18.4%)| |Total|tracing|10.361 s |-| |Total|appsec|10.549 s |187.398 ms (1.8%)| |Total|iast|10.926 s |564.42 ms (5.4%)| |Total|profiling|10.576 s |215.135 ms (2.1%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.051 s |-| |Agent|appsec|1.179 s |128.159 ms (12.2%)| |Agent|iast|1.176 s |125.323 ms (11.9%)| |Agent|profiling|1.265 s |214.711 ms (20.4%)| |Total|tracing|10.453 s |-| |Total|appsec|10.465 s |12.561 ms (0.1%)| |Total|iast|10.847 s |394.316 ms (3.8%)| |Total|profiling|10.649 s |196.176 ms (1.9%)| ```mermaid gantt title petclinic - break down per module: candidate=1.39.0-SNAPSHOT~f3b46e32e9, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (669.54 ms) : 0, 669540 BytebuddyAgent [candidate] (670.038 ms) : 0, 670038 GlobalTracer [baseline] (307.038 ms) : 0, 307038 GlobalTracer [candidate] (307.276 ms) : 0, 307276 AppSec [baseline] (51.088 ms) : 0, 51088 AppSec [candidate] (51.57 ms) : 0, 51570 Remote Config [baseline] (683.298 µs) : 0, 683 Remote Config [candidate] (671.912 µs) : 0, 672 Telemetry [baseline] (7.435 ms) : 0, 7435 Telemetry [candidate] (7.441 ms) : 0, 7441 section appsec BytebuddyAgent [baseline] (687.447 ms) : 0, 687447 BytebuddyAgent [candidate] (683.844 ms) : 0, 683844 GlobalTracer [baseline] (299.02 ms) : 0, 299020 GlobalTracer [candidate] (302.029 ms) : 0, 302029 AppSec [baseline] (158.568 ms) : 0, 158568 AppSec [candidate] (161.219 ms) : 0, 161219 Remote Config [baseline] (623.794 µs) : 0, 624 Remote Config [candidate] (612.748 µs) : 0, 613 Telemetry [baseline] (9.155 ms) : 0, 9155 Telemetry [candidate] (8.105 ms) : 0, 8105 IAST [baseline] (20.858 ms) : 0, 20858 IAST [candidate] (18.542 ms) : 0, 18542 section iast BytebuddyAgent [baseline] (782.848 ms) : 0, 782848 BytebuddyAgent [candidate] (781.162 ms) : 0, 781162 GlobalTracer [baseline] (296.362 ms) : 0, 296362 GlobalTracer [candidate] (297.051 ms) : 0, 297051 AppSec [baseline] (52.835 ms) : 0, 52835 AppSec [candidate] (50.338 ms) : 0, 50338 Remote Config [baseline] (589.159 µs) : 0, 589 Remote Config [candidate] (611.21 µs) : 0, 611 Telemetry [baseline] (7.384 ms) : 0, 7384 Telemetry [candidate] (7.937 ms) : 0, 7937 IAST [baseline] (23.511 ms) : 0, 23511 IAST [candidate] (25.18 ms) : 0, 25180 section profiling ProfilingAgent [baseline] (94.687 ms) : 0, 94687 ProfilingAgent [candidate] (97.013 ms) : 0, 97013 BytebuddyAgent [baseline] (662.752 ms) : 0, 662752 BytebuddyAgent [candidate] (674.956 ms) : 0, 674956 GlobalTracer [baseline] (387.096 ms) : 0, 387096 GlobalTracer [candidate] (394.356 ms) : 0, 394356 AppSec [baseline] (51.924 ms) : 0, 51924 AppSec [candidate] (52.888 ms) : 0, 52888 Remote Config [baseline] (678.79 µs) : 0, 679 Remote Config [candidate] (703.334 µs) : 0, 703 Telemetry [baseline] (7.343 ms) : 0, 7343 Telemetry [candidate] (7.397 ms) : 0, 7397 Profiling [baseline] (94.711 ms) : 0, 94711 Profiling [candidate] (97.037 ms) : 0, 97037 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.39.0-SNAPSHOT~f3b46e32e9, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section tracing Agent [baseline] (1.051 s) : 0, 1050889 Total [baseline] (8.49 s) : 0, 8489854 Agent [candidate] (1.049 s) : 0, 1048748 Total [candidate] (8.542 s) : 0, 8541557 section iast Agent [baseline] (1.181 s) : 0, 1181220 Total [baseline] (9.003 s) : 0, 9003238 Agent [candidate] (1.172 s) : 0, 1171727 Total [candidate] (8.955 s) : 0, 8954890 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.174 s) : 0, 1173898 Total [baseline] (8.937 s) : 0, 8936667 Agent [candidate] (1.171 s) : 0, 1170524 Total [candidate] (8.921 s) : 0, 8920640 section iast_TELEMETRY_OFF Agent [baseline] (1.169 s) : 0, 1168977 Total [baseline] (8.946 s) : 0, 8946444 Agent [candidate] (1.168 s) : 0, 1168418 Total [candidate] (8.968 s) : 0, 8967982 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.051 s |-| |Agent|iast|1.181 s |130.331 ms (12.4%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.174 s |123.009 ms (11.7%)| |Agent|iast_TELEMETRY_OFF|1.169 s |118.087 ms (11.2%)| |Total|tracing|8.49 s |-| |Total|iast|9.003 s |513.384 ms (6.0%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.937 s |446.813 ms (5.3%)| |Total|iast_TELEMETRY_OFF|8.946 s |456.59 ms (5.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.049 s |-| |Agent|iast|1.172 s |122.98 ms (11.7%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.171 s |121.776 ms (11.6%)| |Agent|iast_TELEMETRY_OFF|1.168 s |119.67 ms (11.4%)| |Total|tracing|8.542 s |-| |Total|iast|8.955 s |413.333 ms (4.8%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.921 s |379.084 ms (4.4%)| |Total|iast_TELEMETRY_OFF|8.968 s |426.426 ms (5.0%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.39.0-SNAPSHOT~f3b46e32e9, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (670.802 ms) : 0, 670802 BytebuddyAgent [candidate] (668.825 ms) : 0, 668825 GlobalTracer [baseline] (307.086 ms) : 0, 307086 GlobalTracer [candidate] (306.784 ms) : 0, 306784 AppSec [baseline] (51.255 ms) : 0, 51255 AppSec [candidate] (51.402 ms) : 0, 51402 Remote Config [baseline] (705.067 µs) : 0, 705 Remote Config [candidate] (668.03 µs) : 0, 668 Telemetry [baseline] (7.448 ms) : 0, 7448 Telemetry [candidate] (7.519 ms) : 0, 7519 section iast BytebuddyAgent [baseline] (785.987 ms) : 0, 785987 BytebuddyAgent [candidate] (777.783 ms) : 0, 777783 GlobalTracer [baseline] (297.323 ms) : 0, 297323 GlobalTracer [candidate] (295.756 ms) : 0, 295756 AppSec [baseline] (53.286 ms) : 0, 53286 AppSec [candidate] (50.494 ms) : 0, 50494 IAST [baseline] (22.146 ms) : 0, 22146 IAST [candidate] (24.748 ms) : 0, 24748 Remote Config [baseline] (1.346 ms) : 0, 1346 Remote Config [candidate] (605.02 µs) : 0, 605 Telemetry [baseline] (7.472 ms) : 0, 7472 Telemetry [candidate] (8.755 ms) : 0, 8755 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (780.462 ms) : 0, 780462 BytebuddyAgent [candidate] (776.887 ms) : 0, 776887 GlobalTracer [baseline] (295.811 ms) : 0, 295811 GlobalTracer [candidate] (295.823 ms) : 0, 295823 AppSec [baseline] (52.737 ms) : 0, 52737 AppSec [candidate] (53.088 ms) : 0, 53088 IAST [baseline] (22.589 ms) : 0, 22589 IAST [candidate] (21.686 ms) : 0, 21686 Remote Config [baseline] (601.81 µs) : 0, 602 Remote Config [candidate] (591.944 µs) : 0, 592 Telemetry [baseline] (8.095 ms) : 0, 8095 Telemetry [candidate] (8.857 ms) : 0, 8857 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (777.291 ms) : 0, 777291 BytebuddyAgent [candidate] (775.363 ms) : 0, 775363 GlobalTracer [baseline] (295.501 ms) : 0, 295501 GlobalTracer [candidate] (296.415 ms) : 0, 296415 AppSec [baseline] (51.803 ms) : 0, 51803 AppSec [candidate] (50.508 ms) : 0, 50508 IAST [baseline] (22.247 ms) : 0, 22247 IAST [candidate] (22.445 ms) : 0, 22445 Remote Config [baseline] (577.851 µs) : 0, 578 Remote Config [candidate] (598.582 µs) : 0, 599 Telemetry [baseline] (7.97 ms) : 0, 7970 Telemetry [candidate] (9.472 ms) : 0, 9472 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-09T14:03:53 2024-09-09T14:10:41
git_branch master nikita-tkachenko/class-match-cache
git_commit_date 1725887583 1725889789
git_commit_sha 3fd417447a f3b46e32e9
release_version 1.40.0-SNAPSHOT~3fd417447a 1.39.0-SNAPSHOT~f3b46e32e9
start_time 2024-09-09T14:03:40 2024-09-09T14:10:27
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725891384 |1725891384 | |ci_job_id |631981665 |631981665 | |ci_pipeline_id|43858159 |43858159 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~f3b46e32e9, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section baseline no_agent (363.968 µs) : 343, 385 . : milestone, 364, iast (473.798 µs) : 452, 496 . : milestone, 474, iast_FULL (543.035 µs) : 522, 564 . : milestone, 543, iast_GLOBAL (495.8 µs) : 475, 517 . : milestone, 496, iast_HARDCODED_SECRET_DISABLED (483.069 µs) : 460, 506 . : milestone, 483, iast_INACTIVE (439.903 µs) : 419, 461 . : milestone, 440, iast_TELEMETRY_OFF (470.813 µs) : 448, 493 . : milestone, 471, tracing (436.928 µs) : 415, 459 . : milestone, 437, section candidate no_agent (366.767 µs) : 347, 386 . : milestone, 367, iast (481.671 µs) : 460, 503 . : milestone, 482, iast_FULL (547.01 µs) : 526, 568 . : milestone, 547, iast_GLOBAL (500.377 µs) : 478, 522 . : milestone, 500, iast_HARDCODED_SECRET_DISABLED (475.792 µs) : 455, 497 . : milestone, 476, iast_INACTIVE (446.544 µs) : 425, 468 . : milestone, 447, iast_TELEMETRY_OFF (465.153 µs) : 443, 487 . : milestone, 465, tracing (430.174 µs) : 410, 450 . : milestone, 430, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|363.968 µs [343.354 µs, 384.582 µs]|-| |iast|473.798 µs [451.856 µs, 495.739 µs]|109.83 µs (30.2%)| |iast_FULL|543.035 µs [522.092 µs, 563.978 µs]|179.067 µs (49.2%)| |iast_GLOBAL|495.8 µs [474.891 µs, 516.709 µs]|131.832 µs (36.2%)| |iast_HARDCODED_SECRET_DISABLED|483.069 µs [460.311 µs, 505.826 µs]|119.101 µs (32.7%)| |iast_INACTIVE|439.903 µs [418.509 µs, 461.297 µs]|75.935 µs (20.9%)| |iast_TELEMETRY_OFF|470.813 µs [448.49 µs, 493.137 µs]|106.845 µs (29.4%)| |tracing|436.928 µs [415.055 µs, 458.801 µs]|72.96 µs (20.0%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|366.767 µs [347.212 µs, 386.322 µs]|-| |iast|481.671 µs [460.254 µs, 503.087 µs]|114.904 µs (31.3%)| |iast_FULL|547.01 µs [525.598 µs, 568.421 µs]|180.243 µs (49.1%)| |iast_GLOBAL|500.377 µs [478.355 µs, 522.399 µs]|133.61 µs (36.4%)| |iast_HARDCODED_SECRET_DISABLED|475.792 µs [454.515 µs, 497.068 µs]|109.025 µs (29.7%)| |iast_INACTIVE|446.544 µs [425.123 µs, 467.964 µs]|79.777 µs (21.8%)| |iast_TELEMETRY_OFF|465.153 µs [442.818 µs, 487.488 µs]|98.386 µs (26.8%)| |tracing|430.174 µs [409.927 µs, 450.421 µs]|63.407 µs (17.3%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.39.0-SNAPSHOT~f3b46e32e9, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section baseline no_agent (1.333 ms) : 1314, 1351 . : milestone, 1333, appsec (1.717 ms) : 1693, 1740 . : milestone, 1717, appsec_no_iast (1.691 ms) : 1667, 1716 . : milestone, 1691, iast (1.467 ms) : 1444, 1490 . : milestone, 1467, profiling (1.518 ms) : 1493, 1543 . : milestone, 1518, tracing (1.453 ms) : 1428, 1478 . : milestone, 1453, section candidate no_agent (1.341 ms) : 1321, 1361 . : milestone, 1341, appsec (1.728 ms) : 1704, 1752 . : milestone, 1728, appsec_no_iast (1.708 ms) : 1684, 1732 . : milestone, 1708, iast (1.464 ms) : 1442, 1486 . : milestone, 1464, profiling (1.497 ms) : 1475, 1520 . : milestone, 1497, tracing (1.457 ms) : 1432, 1481 . : milestone, 1457, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.333 ms [1.314 ms, 1.351 ms]|-| |appsec|1.717 ms [1.693 ms, 1.74 ms]|384.154 µs (28.8%)| |appsec_no_iast|1.691 ms [1.667 ms, 1.716 ms]|358.95 µs (26.9%)| |iast|1.467 ms [1.444 ms, 1.49 ms]|134.255 µs (10.1%)| |profiling|1.518 ms [1.493 ms, 1.543 ms]|185.377 µs (13.9%)| |tracing|1.453 ms [1.428 ms, 1.478 ms]|120.766 µs (9.1%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.341 ms [1.321 ms, 1.361 ms]|-| |appsec|1.728 ms [1.704 ms, 1.752 ms]|387.112 µs (28.9%)| |appsec_no_iast|1.708 ms [1.684 ms, 1.732 ms]|367.422 µs (27.4%)| |iast|1.464 ms [1.442 ms, 1.486 ms]|122.91 µs (9.2%)| |profiling|1.497 ms [1.475 ms, 1.52 ms]|156.67 µs (11.7%)| |tracing|1.457 ms [1.432 ms, 1.481 ms]|115.879 µs (8.6%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/class-match-cache
git_commit_date 1725887583 1725889789
git_commit_sha 3fd417447a f3b46e32e9
release_version 1.40.0-SNAPSHOT~3fd417447a 1.39.0-SNAPSHOT~f3b46e32e9
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1725891650 |1725891650 | |ci_job_id |631981666 |631981666 | |ci_pipeline_id|43858159 |43858159 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~f3b46e32e9, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section baseline no_agent (1.465 ms) : 1453, 1476 . : milestone, 1465, appsec (2.234 ms) : 2199, 2270 . : milestone, 2234, iast (1.984 ms) : 1941, 2027 . : milestone, 1984, iast_GLOBAL (2.021 ms) : 1977, 2064 . : milestone, 2021, profiling (1.862 ms) : 1827, 1896 . : milestone, 1862, tracing (1.845 ms) : 1812, 1878 . : milestone, 1845, section candidate no_agent (1.456 ms) : 1445, 1468 . : milestone, 1456, appsec (2.229 ms) : 2194, 2265 . : milestone, 2229, iast (1.979 ms) : 1937, 2022 . : milestone, 1979, iast_GLOBAL (2.013 ms) : 1969, 2056 . : milestone, 2013, profiling (1.86 ms) : 1826, 1894 . : milestone, 1860, tracing (1.838 ms) : 1805, 1870 . : milestone, 1838, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.465 ms [1.453 ms, 1.476 ms]|-| |appsec|2.234 ms [2.199 ms, 2.27 ms]|769.21 µs (52.5%)| |iast|1.984 ms [1.941 ms, 2.027 ms]|519.301 µs (35.4%)| |iast_GLOBAL|2.021 ms [1.977 ms, 2.064 ms]|555.724 µs (37.9%)| |profiling|1.862 ms [1.827 ms, 1.896 ms]|396.565 µs (27.1%)| |tracing|1.845 ms [1.812 ms, 1.878 ms]|379.97 µs (25.9%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.456 ms [1.445 ms, 1.468 ms]|-| |appsec|2.229 ms [2.194 ms, 2.265 ms]|772.691 µs (53.1%)| |iast|1.979 ms [1.937 ms, 2.022 ms]|522.805 µs (35.9%)| |iast_GLOBAL|2.013 ms [1.969 ms, 2.056 ms]|556.493 µs (38.2%)| |profiling|1.86 ms [1.826 ms, 1.894 ms]|403.965 µs (27.7%)| |tracing|1.838 ms [1.805 ms, 1.87 ms]|381.103 µs (26.2%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.39.0-SNAPSHOT~f3b46e32e9, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section baseline no_agent (15.415 s) : 15415000, 15415000 . : milestone, 15415000, appsec (15.083 s) : 15083000, 15083000 . : milestone, 15083000, iast (18.752 s) : 18752000, 18752000 . : milestone, 18752000, iast_GLOBAL (17.86 s) : 17860000, 17860000 . : milestone, 17860000, profiling (15.873 s) : 15873000, 15873000 . : milestone, 15873000, tracing (14.945 s) : 14945000, 14945000 . : milestone, 14945000, section candidate no_agent (15.043 s) : 15043000, 15043000 . : milestone, 15043000, appsec (14.943 s) : 14943000, 14943000 . : milestone, 14943000, iast (19.051 s) : 19051000, 19051000 . : milestone, 19051000, iast_GLOBAL (18.288 s) : 18288000, 18288000 . : milestone, 18288000, profiling (15.105 s) : 15105000, 15105000 . : milestone, 15105000, tracing (14.975 s) : 14975000, 14975000 . : milestone, 14975000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.415 s [15.415 s, 15.415 s]|-| |appsec|15.083 s [15.083 s, 15.083 s]|-332.0 ms (-2.2%)| |iast|18.752 s [18.752 s, 18.752 s]|3.337 s (21.6%)| |iast_GLOBAL|17.86 s [17.86 s, 17.86 s]|2.445 s (15.9%)| |profiling|15.873 s [15.873 s, 15.873 s]|458.0 ms (3.0%)| |tracing|14.945 s [14.945 s, 14.945 s]|-470.0 ms (-3.0%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.043 s [15.043 s, 15.043 s]|-| |appsec|14.943 s [14.943 s, 14.943 s]|-100.0 ms (-0.7%)| |iast|19.051 s [19.051 s, 19.051 s]|4.008 s (26.6%)| |iast_GLOBAL|18.288 s [18.288 s, 18.288 s]|3.245 s (21.6%)| |profiling|15.105 s [15.105 s, 15.105 s]|62.0 ms (0.4%)| |tracing|14.975 s [14.975 s, 14.975 s]|-68.0 ms (-0.5%)|