search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
573 stars 284 forks source link

Improve test scenario name uniqueness #7567

Closed PerfectSlayer closed 3 weeks ago

PerfectSlayer commented 3 weeks ago

What Does This Do

This PR improves test scenario name uniqueness by avoiding using toString() in test name that generates random scenario name.

Motivation

Avoid such reporting issue in our backend: image

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 3 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1725526572 1725529313
git_commit_sha 7497a93de3 811da93152
release_version 1.40.0-SNAPSHOT~7497a93de3 1.40.0-SNAPSHOT~811da93152
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725531782 |1725531782 | |ci_job_id |628433023 |628433023 | |ci_pipeline_id|43598328 |43598328 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~811da93152, baseline=1.40.0-SNAPSHOT~7497a93de3 dateFormat X axisFormat %s section tracing Agent [baseline] (1.05 s) : 0, 1050153 Total [baseline] (10.373 s) : 0, 10373192 Agent [candidate] (1.065 s) : 0, 1064771 Total [candidate] (10.411 s) : 0, 10411091 section appsec Agent [baseline] (1.18 s) : 0, 1179809 Total [baseline] (10.549 s) : 0, 10549239 Agent [candidate] (1.183 s) : 0, 1183198 Total [candidate] (10.618 s) : 0, 10617805 section iast Agent [baseline] (1.176 s) : 0, 1175764 Total [baseline] (10.832 s) : 0, 10831825 Agent [candidate] (1.176 s) : 0, 1176126 Total [candidate] (10.77 s) : 0, 10769922 section profiling Agent [baseline] (1.256 s) : 0, 1256276 Total [baseline] (10.584 s) : 0, 10583940 Agent [candidate] (1.247 s) : 0, 1246737 Total [candidate] (10.519 s) : 0, 10518798 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.05 s |-| |Agent|appsec|1.18 s |129.656 ms (12.3%)| |Agent|iast|1.176 s |125.611 ms (12.0%)| |Agent|profiling|1.256 s |206.123 ms (19.6%)| |Total|tracing|10.373 s |-| |Total|appsec|10.549 s |176.047 ms (1.7%)| |Total|iast|10.832 s |458.633 ms (4.4%)| |Total|profiling|10.584 s |210.748 ms (2.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.065 s |-| |Agent|appsec|1.183 s |118.427 ms (11.1%)| |Agent|iast|1.176 s |111.355 ms (10.5%)| |Agent|profiling|1.247 s |181.966 ms (17.1%)| |Total|tracing|10.411 s |-| |Total|appsec|10.618 s |206.713 ms (2.0%)| |Total|iast|10.77 s |358.831 ms (3.4%)| |Total|profiling|10.519 s |107.707 ms (1.0%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~811da93152, baseline=1.40.0-SNAPSHOT~7497a93de3 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (670.165 ms) : 0, 670165 BytebuddyAgent [candidate] (679.887 ms) : 0, 679887 GlobalTracer [baseline] (306.765 ms) : 0, 306765 GlobalTracer [candidate] (310.996 ms) : 0, 310996 AppSec [baseline] (51.505 ms) : 0, 51505 AppSec [candidate] (51.87 ms) : 0, 51870 Remote Config [baseline] (667.071 µs) : 0, 667 Remote Config [candidate] (694.87 µs) : 0, 695 Telemetry [baseline] (7.499 ms) : 0, 7499 Telemetry [candidate] (7.545 ms) : 0, 7545 section appsec BytebuddyAgent [baseline] (688.524 ms) : 0, 688524 BytebuddyAgent [candidate] (689.684 ms) : 0, 689684 GlobalTracer [baseline] (300.018 ms) : 0, 300018 GlobalTracer [candidate] (300.589 ms) : 0, 300589 AppSec [baseline] (158.452 ms) : 0, 158452 AppSec [candidate] (159.878 ms) : 0, 159878 Remote Config [baseline] (617.993 µs) : 0, 618 Remote Config [candidate] (620.021 µs) : 0, 620 Telemetry [baseline] (8.527 ms) : 0, 8527 Telemetry [candidate] (8.579 ms) : 0, 8579 IAST [baseline] (20.265 ms) : 0, 20265 IAST [candidate] (20.538 ms) : 0, 20538 section iast BytebuddyAgent [baseline] (781.492 ms) : 0, 781492 BytebuddyAgent [candidate] (781.827 ms) : 0, 781827 GlobalTracer [baseline] (296.253 ms) : 0, 296253 GlobalTracer [candidate] (296.404 ms) : 0, 296404 AppSec [baseline] (52.253 ms) : 0, 52253 AppSec [candidate] (51.823 ms) : 0, 51823 Remote Config [baseline] (593.11 µs) : 0, 593 Remote Config [candidate] (598.024 µs) : 0, 598 Telemetry [baseline] (7.275 ms) : 0, 7275 Telemetry [candidate] (7.286 ms) : 0, 7286 IAST [baseline] (24.329 ms) : 0, 24329 IAST [candidate] (24.557 ms) : 0, 24557 section profiling BytebuddyAgent [baseline] (669.743 ms) : 0, 669743 BytebuddyAgent [candidate] (664.33 ms) : 0, 664330 GlobalTracer [baseline] (390.758 ms) : 0, 390758 GlobalTracer [candidate] (388.918 ms) : 0, 388918 AppSec [baseline] (52.76 ms) : 0, 52760 AppSec [candidate] (52.113 ms) : 0, 52113 Remote Config [baseline] (693.899 µs) : 0, 694 Remote Config [candidate] (714.389 µs) : 0, 714 Telemetry [baseline] (7.465 ms) : 0, 7465 Telemetry [candidate] (7.45 ms) : 0, 7450 ProfilingAgent [baseline] (96.751 ms) : 0, 96751 ProfilingAgent [candidate] (95.403 ms) : 0, 95403 Profiling [baseline] (96.776 ms) : 0, 96776 Profiling [candidate] (95.426 ms) : 0, 95426 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~811da93152, baseline=1.40.0-SNAPSHOT~7497a93de3 dateFormat X axisFormat %s section tracing Agent [baseline] (1.049 s) : 0, 1048983 Total [baseline] (8.468 s) : 0, 8467763 Agent [candidate] (1.063 s) : 0, 1063334 Total [candidate] (8.539 s) : 0, 8539009 section iast Agent [baseline] (1.174 s) : 0, 1174168 Total [baseline] (8.972 s) : 0, 8971569 Agent [candidate] (1.184 s) : 0, 1183627 Total [candidate] (8.993 s) : 0, 8992875 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.182 s) : 0, 1181844 Total [baseline] (8.987 s) : 0, 8987146 Agent [candidate] (1.184 s) : 0, 1183612 Total [candidate] (8.995 s) : 0, 8995337 section iast_TELEMETRY_OFF Agent [baseline] (1.171 s) : 0, 1170927 Total [baseline] (8.941 s) : 0, 8941181 Agent [candidate] (1.179 s) : 0, 1179119 Total [candidate] (8.989 s) : 0, 8988764 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.049 s |-| |Agent|iast|1.174 s |125.185 ms (11.9%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.182 s |132.861 ms (12.7%)| |Agent|iast_TELEMETRY_OFF|1.171 s |121.944 ms (11.6%)| |Total|tracing|8.468 s |-| |Total|iast|8.972 s |503.805 ms (5.9%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.987 s |519.383 ms (6.1%)| |Total|iast_TELEMETRY_OFF|8.941 s |473.418 ms (5.6%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.063 s |-| |Agent|iast|1.184 s |120.292 ms (11.3%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.184 s |120.277 ms (11.3%)| |Agent|iast_TELEMETRY_OFF|1.179 s |115.785 ms (10.9%)| |Total|tracing|8.539 s |-| |Total|iast|8.993 s |453.866 ms (5.3%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.995 s |456.328 ms (5.3%)| |Total|iast_TELEMETRY_OFF|8.989 s |449.756 ms (5.3%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~811da93152, baseline=1.40.0-SNAPSHOT~7497a93de3 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (669.545 ms) : 0, 669545 BytebuddyAgent [candidate] (678.92 ms) : 0, 678920 GlobalTracer [baseline] (306.692 ms) : 0, 306692 GlobalTracer [candidate] (310.552 ms) : 0, 310552 AppSec [baseline] (51.085 ms) : 0, 51085 AppSec [candidate] (51.794 ms) : 0, 51794 Remote Config [baseline] (667.743 µs) : 0, 668 Remote Config [candidate] (684.434 µs) : 0, 684 Telemetry [baseline] (7.441 ms) : 0, 7441 Telemetry [candidate] (7.585 ms) : 0, 7585 section iast BytebuddyAgent [baseline] (781.365 ms) : 0, 781365 BytebuddyAgent [candidate] (787.622 ms) : 0, 787622 GlobalTracer [baseline] (295.861 ms) : 0, 295861 GlobalTracer [candidate] (298.044 ms) : 0, 298044 AppSec [baseline] (53.663 ms) : 0, 53663 AppSec [candidate] (53.494 ms) : 0, 53494 IAST [baseline] (21.016 ms) : 0, 21016 IAST [candidate] (21.953 ms) : 0, 21953 Remote Config [baseline] (574.323 µs) : 0, 574 Remote Config [candidate] (599.96 µs) : 0, 600 Telemetry [baseline] (8.085 ms) : 0, 8085 Telemetry [candidate] (8.152 ms) : 0, 8152 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (785.531 ms) : 0, 785531 BytebuddyAgent [candidate] (787.085 ms) : 0, 787085 GlobalTracer [baseline] (297.966 ms) : 0, 297966 GlobalTracer [candidate] (298.633 ms) : 0, 298633 AppSec [baseline] (53.679 ms) : 0, 53679 AppSec [candidate] (53.073 ms) : 0, 53073 IAST [baseline] (22.196 ms) : 0, 22196 IAST [candidate] (22.21 ms) : 0, 22210 Remote Config [baseline] (597.017 µs) : 0, 597 Remote Config [candidate] (604.896 µs) : 0, 605 Telemetry [baseline] (8.189 ms) : 0, 8189 Telemetry [candidate] (8.246 ms) : 0, 8246 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (777.644 ms) : 0, 777644 BytebuddyAgent [candidate] (784.095 ms) : 0, 784095 GlobalTracer [baseline] (296.694 ms) : 0, 296694 GlobalTracer [candidate] (298.181 ms) : 0, 298181 AppSec [baseline] (52.916 ms) : 0, 52916 AppSec [candidate] (50.894 ms) : 0, 50894 IAST [baseline] (22.31 ms) : 0, 22310 IAST [candidate] (23.762 ms) : 0, 23762 Remote Config [baseline] (574.195 µs) : 0, 574 Remote Config [candidate] (571.948 µs) : 0, 572 Telemetry [baseline] (7.14 ms) : 0, 7140 Telemetry [candidate] (7.859 ms) : 0, 7859 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-05T09:51:44 2024-09-05T09:58:31
git_branch master bbujon/ci
git_commit_date 1725526572 1725529313
git_commit_sha 7497a93de3 811da93152
release_version 1.40.0-SNAPSHOT~7497a93de3 1.40.0-SNAPSHOT~811da93152
start_time 2024-09-05T09:51:31 2024-09-05T09:58:18
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725530655 |1725530655 | |ci_job_id |628433024 |628433024 | |ci_pipeline_id|43598328 |43598328 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~811da93152, baseline=1.40.0-SNAPSHOT~7497a93de3 dateFormat X axisFormat %s section baseline no_agent (1.344 ms) : 1324, 1363 . : milestone, 1344, appsec (1.7 ms) : 1675, 1725 . : milestone, 1700, appsec_no_iast (1.73 ms) : 1706, 1753 . : milestone, 1730, iast (1.484 ms) : 1461, 1507 . : milestone, 1484, profiling (1.464 ms) : 1441, 1488 . : milestone, 1464, tracing (1.457 ms) : 1432, 1481 . : milestone, 1457, section candidate no_agent (1.348 ms) : 1329, 1367 . : milestone, 1348, appsec (1.705 ms) : 1681, 1729 . : milestone, 1705, appsec_no_iast (1.734 ms) : 1710, 1758 . : milestone, 1734, iast (1.466 ms) : 1443, 1489 . : milestone, 1466, profiling (1.467 ms) : 1444, 1490 . : milestone, 1467, tracing (1.47 ms) : 1446, 1493 . : milestone, 1470, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.344 ms [1.324 ms, 1.363 ms]|-| |appsec|1.7 ms [1.675 ms, 1.725 ms]|356.197 µs (26.5%)| |appsec_no_iast|1.73 ms [1.706 ms, 1.753 ms]|385.882 µs (28.7%)| |iast|1.484 ms [1.461 ms, 1.507 ms]|140.328 µs (10.4%)| |profiling|1.464 ms [1.441 ms, 1.488 ms]|120.758 µs (9.0%)| |tracing|1.457 ms [1.432 ms, 1.481 ms]|113.07 µs (8.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.348 ms [1.329 ms, 1.367 ms]|-| |appsec|1.705 ms [1.681 ms, 1.729 ms]|356.526 µs (26.4%)| |appsec_no_iast|1.734 ms [1.71 ms, 1.758 ms]|385.445 µs (28.6%)| |iast|1.466 ms [1.443 ms, 1.489 ms]|117.601 µs (8.7%)| |profiling|1.467 ms [1.444 ms, 1.49 ms]|119.077 µs (8.8%)| |tracing|1.47 ms [1.446 ms, 1.493 ms]|121.311 µs (9.0%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~811da93152, baseline=1.40.0-SNAPSHOT~7497a93de3 dateFormat X axisFormat %s section baseline no_agent (366.336 µs) : 347, 386 . : milestone, 366, iast (484.081 µs) : 462, 506 . : milestone, 484, iast_FULL (549.251 µs) : 528, 570 . : milestone, 549, iast_GLOBAL (497.347 µs) : 477, 518 . : milestone, 497, iast_HARDCODED_SECRET_DISABLED (481.776 µs) : 460, 504 . : milestone, 482, iast_INACTIVE (442.739 µs) : 422, 464 . : milestone, 443, iast_TELEMETRY_OFF (466.719 µs) : 444, 489 . : milestone, 467, tracing (444.717 µs) : 423, 466 . : milestone, 445, section candidate no_agent (374.582 µs) : 355, 394 . : milestone, 375, iast (487.041 µs) : 465, 509 . : milestone, 487, iast_FULL (549.915 µs) : 529, 571 . : milestone, 550, iast_GLOBAL (515.398 µs) : 492, 538 . : milestone, 515, iast_HARDCODED_SECRET_DISABLED (479.198 µs) : 458, 500 . : milestone, 479, iast_INACTIVE (443.658 µs) : 423, 465 . : milestone, 444, iast_TELEMETRY_OFF (466.839 µs) : 445, 489 . : milestone, 467, tracing (438.269 µs) : 418, 459 . : milestone, 438, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|366.336 µs [346.599 µs, 386.072 µs]|-| |iast|484.081 µs [461.904 µs, 506.258 µs]|117.745 µs (32.1%)| |iast_FULL|549.251 µs [528.162 µs, 570.339 µs]|182.915 µs (49.9%)| |iast_GLOBAL|497.347 µs [476.613 µs, 518.081 µs]|131.011 µs (35.8%)| |iast_HARDCODED_SECRET_DISABLED|481.776 µs [459.874 µs, 503.679 µs]|115.441 µs (31.5%)| |iast_INACTIVE|442.739 µs [421.599 µs, 463.879 µs]|76.404 µs (20.9%)| |iast_TELEMETRY_OFF|466.719 µs [444.447 µs, 488.992 µs]|100.384 µs (27.4%)| |tracing|444.717 µs [423.056 µs, 466.379 µs]|78.382 µs (21.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|374.582 µs [355.132 µs, 394.033 µs]|-| |iast|487.041 µs [465.125 µs, 508.957 µs]|112.458 µs (30.0%)| |iast_FULL|549.915 µs [528.822 µs, 571.008 µs]|175.333 µs (46.8%)| |iast_GLOBAL|515.398 µs [492.41 µs, 538.386 µs]|140.816 µs (37.6%)| |iast_HARDCODED_SECRET_DISABLED|479.198 µs [458.11 µs, 500.287 µs]|104.616 µs (27.9%)| |iast_INACTIVE|443.658 µs [422.817 µs, 464.5 µs]|69.076 µs (18.4%)| |iast_TELEMETRY_OFF|466.839 µs [444.554 µs, 489.124 µs]|92.256 µs (24.6%)| |tracing|438.269 µs [418.013 µs, 458.526 µs]|63.687 µs (17.0%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/ci
git_commit_date 1725526572 1725529313
git_commit_sha 7497a93de3 811da93152
release_version 1.40.0-SNAPSHOT~7497a93de3 1.40.0-SNAPSHOT~811da93152
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1725531296 |1725531296 | |ci_job_id |628433025 |628433025 | |ci_pipeline_id|43598328 |43598328 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~811da93152, baseline=1.40.0-SNAPSHOT~7497a93de3 dateFormat X axisFormat %s section baseline no_agent (1.456 ms) : 1444, 1467 . : milestone, 1456, appsec (2.224 ms) : 2189, 2259 . : milestone, 2224, iast (1.962 ms) : 1920, 2004 . : milestone, 1962, iast_GLOBAL (2.032 ms) : 1987, 2076 . : milestone, 2032, profiling (1.87 ms) : 1834, 1906 . : milestone, 1870, tracing (1.842 ms) : 1808, 1875 . : milestone, 1842, section candidate no_agent (1.458 ms) : 1446, 1469 . : milestone, 1458, appsec (2.227 ms) : 2192, 2263 . : milestone, 2227, iast (1.974 ms) : 1931, 2017 . : milestone, 1974, iast_GLOBAL (2.035 ms) : 1990, 2079 . : milestone, 2035, profiling (1.87 ms) : 1834, 1907 . : milestone, 1870, tracing (1.829 ms) : 1796, 1862 . : milestone, 1829, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.456 ms [1.444 ms, 1.467 ms]|-| |appsec|2.224 ms [2.189 ms, 2.259 ms]|768.229 µs (52.8%)| |iast|1.962 ms [1.92 ms, 2.004 ms]|506.777 µs (34.8%)| |iast_GLOBAL|2.032 ms [1.987 ms, 2.076 ms]|576.192 µs (39.6%)| |profiling|1.87 ms [1.834 ms, 1.906 ms]|414.442 µs (28.5%)| |tracing|1.842 ms [1.808 ms, 1.875 ms]|386.002 µs (26.5%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.458 ms [1.446 ms, 1.469 ms]|-| |appsec|2.227 ms [2.192 ms, 2.263 ms]|769.625 µs (52.8%)| |iast|1.974 ms [1.931 ms, 2.017 ms]|516.419 µs (35.4%)| |iast_GLOBAL|2.035 ms [1.99 ms, 2.079 ms]|576.865 µs (39.6%)| |profiling|1.87 ms [1.834 ms, 1.907 ms]|412.726 µs (28.3%)| |tracing|1.829 ms [1.796 ms, 1.862 ms]|371.706 µs (25.5%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~811da93152, baseline=1.40.0-SNAPSHOT~7497a93de3 dateFormat X axisFormat %s section baseline no_agent (15.397 s) : 15397000, 15397000 . : milestone, 15397000, appsec (15.23 s) : 15230000, 15230000 . : milestone, 15230000, iast (18.665 s) : 18665000, 18665000 . : milestone, 18665000, iast_GLOBAL (18.034 s) : 18034000, 18034000 . : milestone, 18034000, profiling (15.193 s) : 15193000, 15193000 . : milestone, 15193000, tracing (14.916 s) : 14916000, 14916000 . : milestone, 14916000, section candidate no_agent (14.979 s) : 14979000, 14979000 . : milestone, 14979000, appsec (14.902 s) : 14902000, 14902000 . : milestone, 14902000, iast (18.845 s) : 18845000, 18845000 . : milestone, 18845000, iast_GLOBAL (17.717 s) : 17717000, 17717000 . : milestone, 17717000, profiling (15.27 s) : 15270000, 15270000 . : milestone, 15270000, tracing (15.163 s) : 15163000, 15163000 . : milestone, 15163000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.397 s [15.397 s, 15.397 s]|-| |appsec|15.23 s [15.23 s, 15.23 s]|-167.0 ms (-1.1%)| |iast|18.665 s [18.665 s, 18.665 s]|3.268 s (21.2%)| |iast_GLOBAL|18.034 s [18.034 s, 18.034 s]|2.637 s (17.1%)| |profiling|15.193 s [15.193 s, 15.193 s]|-204.0 ms (-1.3%)| |tracing|14.916 s [14.916 s, 14.916 s]|-481.0 ms (-3.1%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.979 s [14.979 s, 14.979 s]|-| |appsec|14.902 s [14.902 s, 14.902 s]|-77.0 ms (-0.5%)| |iast|18.845 s [18.845 s, 18.845 s]|3.866 s (25.8%)| |iast_GLOBAL|17.717 s [17.717 s, 17.717 s]|2.738 s (18.3%)| |profiling|15.27 s [15.27 s, 15.27 s]|291.0 ms (1.9%)| |tracing|15.163 s [15.163 s, 15.163 s]|184.0 ms (1.2%)|