search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
573 stars 284 forks source link

Avoid redundant Python 3.12 in system-tests #7578

Closed smola closed 3 weeks ago

smola commented 3 weeks ago

What Does This Do

ubuntu:2404 images from Circle CI already include Python 3.12 by default.

Motivation

Minor build time improvement in CI.

Additional Notes

Contributor Checklist

pr-commenter[bot] commented 3 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-py12
git_commit_date 1725870430 1725871282
git_commit_sha ed00591df5 4216e2201c
release_version 1.40.0-SNAPSHOT~ed00591df5 1.40.0-SNAPSHOT~4216e2201c
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725873471 |1725873471 | |ci_job_id |631539696 |631539696 | |ci_pipeline_id|43831157 |43831157 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~4216e2201c, baseline=1.40.0-SNAPSHOT~ed00591df5 dateFormat X axisFormat %s section tracing Agent [baseline] (1.053 s) : 0, 1053236 Total [baseline] (10.396 s) : 0, 10395591 Agent [candidate] (1.053 s) : 0, 1052559 Total [candidate] (10.351 s) : 0, 10351151 section appsec Agent [baseline] (1.182 s) : 0, 1182138 Total [baseline] (10.598 s) : 0, 10598097 Agent [candidate] (1.181 s) : 0, 1181042 Total [candidate] (10.604 s) : 0, 10604245 section iast Agent [baseline] (1.176 s) : 0, 1176220 Total [baseline] (10.842 s) : 0, 10841740 Agent [candidate] (1.176 s) : 0, 1175734 Total [candidate] (10.833 s) : 0, 10832634 section profiling Agent [baseline] (1.257 s) : 0, 1257003 Total [baseline] (10.629 s) : 0, 10628976 Agent [candidate] (1.254 s) : 0, 1254184 Total [candidate] (10.623 s) : 0, 10623114 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.053 s |-| |Agent|appsec|1.182 s |128.902 ms (12.2%)| |Agent|iast|1.176 s |122.985 ms (11.7%)| |Agent|profiling|1.257 s |203.767 ms (19.3%)| |Total|tracing|10.396 s |-| |Total|appsec|10.598 s |202.506 ms (1.9%)| |Total|iast|10.842 s |446.149 ms (4.3%)| |Total|profiling|10.629 s |233.385 ms (2.2%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.053 s |-| |Agent|appsec|1.181 s |128.483 ms (12.2%)| |Agent|iast|1.176 s |123.175 ms (11.7%)| |Agent|profiling|1.254 s |201.625 ms (19.2%)| |Total|tracing|10.351 s |-| |Total|appsec|10.604 s |253.094 ms (2.4%)| |Total|iast|10.833 s |481.483 ms (4.7%)| |Total|profiling|10.623 s |271.963 ms (2.6%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~4216e2201c, baseline=1.40.0-SNAPSHOT~ed00591df5 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (672.48 ms) : 0, 672480 BytebuddyAgent [candidate] (671.615 ms) : 0, 671615 GlobalTracer [baseline] (307.271 ms) : 0, 307271 GlobalTracer [candidate] (307.658 ms) : 0, 307658 AppSec [baseline] (51.748 ms) : 0, 51748 AppSec [candidate] (51.433 ms) : 0, 51433 Remote Config [baseline] (696.27 µs) : 0, 696 Remote Config [candidate] (684.219 µs) : 0, 684 Telemetry [baseline] (7.482 ms) : 0, 7482 Telemetry [candidate] (7.529 ms) : 0, 7529 section appsec BytebuddyAgent [baseline] (690.52 ms) : 0, 690520 BytebuddyAgent [candidate] (689.42 ms) : 0, 689420 GlobalTracer [baseline] (300.388 ms) : 0, 300388 GlobalTracer [candidate] (300.388 ms) : 0, 300388 AppSec [baseline] (159.262 ms) : 0, 159262 AppSec [candidate] (158.118 ms) : 0, 158118 IAST [baseline] (18.982 ms) : 0, 18982 IAST [candidate] (21.219 ms) : 0, 21219 Remote Config [baseline] (631.694 µs) : 0, 632 Remote Config [candidate] (633.283 µs) : 0, 633 Telemetry [baseline] (8.292 ms) : 0, 8292 Telemetry [candidate] (8.322 ms) : 0, 8322 section iast BytebuddyAgent [baseline] (781.993 ms) : 0, 781993 BytebuddyAgent [candidate] (782.549 ms) : 0, 782549 GlobalTracer [baseline] (296.955 ms) : 0, 296955 GlobalTracer [candidate] (296.402 ms) : 0, 296402 AppSec [baseline] (53.179 ms) : 0, 53179 AppSec [candidate] (50.45 ms) : 0, 50450 IAST [baseline] (22.655 ms) : 0, 22655 IAST [candidate] (24.909 ms) : 0, 24909 Remote Config [baseline] (589.976 µs) : 0, 590 Remote Config [candidate] (591.04 µs) : 0, 591 Telemetry [baseline] (7.269 ms) : 0, 7269 Telemetry [candidate] (7.224 ms) : 0, 7224 section profiling BytebuddyAgent [baseline] (670.465 ms) : 0, 670465 BytebuddyAgent [candidate] (667.344 ms) : 0, 667344 GlobalTracer [baseline] (391.706 ms) : 0, 391706 GlobalTracer [candidate] (391.31 ms) : 0, 391310 AppSec [baseline] (52.383 ms) : 0, 52383 AppSec [candidate] (52.713 ms) : 0, 52713 Remote Config [baseline] (692.462 µs) : 0, 692 Remote Config [candidate] (709.569 µs) : 0, 710 Telemetry [baseline] (7.413 ms) : 0, 7413 Telemetry [candidate] (7.495 ms) : 0, 7495 ProfilingAgent [baseline] (96.267 ms) : 0, 96267 ProfilingAgent [candidate] (96.703 ms) : 0, 96703 Profiling [baseline] (96.291 ms) : 0, 96291 Profiling [candidate] (96.727 ms) : 0, 96727 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~4216e2201c, baseline=1.40.0-SNAPSHOT~ed00591df5 dateFormat X axisFormat %s section tracing Agent [baseline] (1.053 s) : 0, 1053329 Total [baseline] (8.535 s) : 0, 8534923 Agent [candidate] (1.052 s) : 0, 1052323 Total [candidate] (8.523 s) : 0, 8523167 section iast Agent [baseline] (1.175 s) : 0, 1174691 Total [baseline] (8.972 s) : 0, 8972422 Agent [candidate] (1.177 s) : 0, 1177243 Total [candidate] (8.989 s) : 0, 8988957 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.177 s) : 0, 1176817 Total [baseline] (8.962 s) : 0, 8962234 Agent [candidate] (1.178 s) : 0, 1178181 Total [candidate] (8.96 s) : 0, 8960359 section iast_TELEMETRY_OFF Agent [baseline] (1.174 s) : 0, 1174040 Total [baseline] (8.958 s) : 0, 8958104 Agent [candidate] (1.181 s) : 0, 1181231 Total [candidate] (9.029 s) : 0, 9028723 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.053 s |-| |Agent|iast|1.175 s |121.362 ms (11.5%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.177 s |123.488 ms (11.7%)| |Agent|iast_TELEMETRY_OFF|1.174 s |120.711 ms (11.5%)| |Total|tracing|8.535 s |-| |Total|iast|8.972 s |437.498 ms (5.1%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.962 s |427.311 ms (5.0%)| |Total|iast_TELEMETRY_OFF|8.958 s |423.181 ms (5.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.052 s |-| |Agent|iast|1.177 s |124.92 ms (11.9%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.178 s |125.858 ms (12.0%)| |Agent|iast_TELEMETRY_OFF|1.181 s |128.908 ms (12.2%)| |Total|tracing|8.523 s |-| |Total|iast|8.989 s |465.79 ms (5.5%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.96 s |437.192 ms (5.1%)| |Total|iast_TELEMETRY_OFF|9.029 s |505.556 ms (5.9%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~4216e2201c, baseline=1.40.0-SNAPSHOT~ed00591df5 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (672.678 ms) : 0, 672678 BytebuddyAgent [candidate] (671.466 ms) : 0, 671466 GlobalTracer [baseline] (307.36 ms) : 0, 307360 GlobalTracer [candidate] (307.696 ms) : 0, 307696 AppSec [baseline] (51.522 ms) : 0, 51522 AppSec [candidate] (51.372 ms) : 0, 51372 Remote Config [baseline] (687.126 µs) : 0, 687 Remote Config [candidate] (681.01 µs) : 0, 681 Telemetry [baseline] (7.493 ms) : 0, 7493 Telemetry [candidate] (7.494 ms) : 0, 7494 section iast BytebuddyAgent [baseline] (781.506 ms) : 0, 781506 BytebuddyAgent [candidate] (782.9 ms) : 0, 782900 GlobalTracer [baseline] (295.731 ms) : 0, 295731 GlobalTracer [candidate] (296.745 ms) : 0, 296745 AppSec [baseline] (52.428 ms) : 0, 52428 AppSec [candidate] (52.684 ms) : 0, 52684 IAST [baseline] (23.458 ms) : 0, 23458 IAST [candidate] (22.706 ms) : 0, 22706 Remote Config [baseline] (639.072 µs) : 0, 639 Remote Config [candidate] (592.272 µs) : 0, 592 Telemetry [baseline] (7.342 ms) : 0, 7342 Telemetry [candidate] (7.961 ms) : 0, 7961 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (782.491 ms) : 0, 782491 BytebuddyAgent [candidate] (783.013 ms) : 0, 783013 GlobalTracer [baseline] (296.445 ms) : 0, 296445 GlobalTracer [candidate] (297.305 ms) : 0, 297305 AppSec [baseline] (50.707 ms) : 0, 50707 AppSec [candidate] (52.841 ms) : 0, 52841 IAST [baseline] (23.456 ms) : 0, 23456 IAST [candidate] (22.717 ms) : 0, 22717 Remote Config [baseline] (606.184 µs) : 0, 606 Remote Config [candidate] (598.513 µs) : 0, 599 Telemetry [baseline] (9.491 ms) : 0, 9491 Telemetry [candidate] (8.04 ms) : 0, 8040 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (780.273 ms) : 0, 780273 BytebuddyAgent [candidate] (784.984 ms) : 0, 784984 GlobalTracer [baseline] (297.147 ms) : 0, 297147 GlobalTracer [candidate] (298.624 ms) : 0, 298624 AppSec [baseline] (51.1 ms) : 0, 51100 AppSec [candidate] (51.18 ms) : 0, 51180 IAST [baseline] (24.057 ms) : 0, 24057 IAST [candidate] (24.129 ms) : 0, 24129 Remote Config [baseline] (576.465 µs) : 0, 576 Remote Config [candidate] (585.401 µs) : 0, 585 Telemetry [baseline] (7.235 ms) : 0, 7235 Telemetry [candidate] (7.997 ms) : 0, 7997 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-09T08:48:31 2024-09-09T08:55:17
git_branch master smola/system-tests-py12
git_commit_date 1725870430 1725871282
git_commit_sha ed00591df5 4216e2201c
release_version 1.40.0-SNAPSHOT~ed00591df5 1.40.0-SNAPSHOT~4216e2201c
start_time 2024-09-09T08:48:18 2024-09-09T08:55:04
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725872460 |1725872460 | |ci_job_id |631539697 |631539697 | |ci_pipeline_id|43831157 |43831157 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~4216e2201c, baseline=1.40.0-SNAPSHOT~ed00591df5 dateFormat X axisFormat %s section baseline no_agent (1.33 ms) : 1311, 1349 . : milestone, 1330, appsec (1.728 ms) : 1705, 1751 . : milestone, 1728, appsec_no_iast (1.725 ms) : 1700, 1750 . : milestone, 1725, iast (1.465 ms) : 1443, 1488 . : milestone, 1465, profiling (1.467 ms) : 1444, 1490 . : milestone, 1467, tracing (1.448 ms) : 1424, 1473 . : milestone, 1448, section candidate no_agent (1.338 ms) : 1318, 1357 . : milestone, 1338, appsec (1.721 ms) : 1697, 1745 . : milestone, 1721, appsec_no_iast (1.718 ms) : 1693, 1743 . : milestone, 1718, iast (1.463 ms) : 1440, 1486 . : milestone, 1463, profiling (1.469 ms) : 1446, 1492 . : milestone, 1469, tracing (1.46 ms) : 1435, 1484 . : milestone, 1460, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.33 ms [1.311 ms, 1.349 ms]|-| |appsec|1.728 ms [1.705 ms, 1.751 ms]|397.902 µs (29.9%)| |appsec_no_iast|1.725 ms [1.7 ms, 1.75 ms]|395.238 µs (29.7%)| |iast|1.465 ms [1.443 ms, 1.488 ms]|135.387 µs (10.2%)| |profiling|1.467 ms [1.444 ms, 1.49 ms]|136.613 µs (10.3%)| |tracing|1.448 ms [1.424 ms, 1.473 ms]|118.349 µs (8.9%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.338 ms [1.318 ms, 1.357 ms]|-| |appsec|1.721 ms [1.697 ms, 1.745 ms]|382.958 µs (28.6%)| |appsec_no_iast|1.718 ms [1.693 ms, 1.743 ms]|380.549 µs (28.4%)| |iast|1.463 ms [1.44 ms, 1.486 ms]|125.144 µs (9.4%)| |profiling|1.469 ms [1.446 ms, 1.492 ms]|130.9 µs (9.8%)| |tracing|1.46 ms [1.435 ms, 1.484 ms]|121.864 µs (9.1%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~4216e2201c, baseline=1.40.0-SNAPSHOT~ed00591df5 dateFormat X axisFormat %s section baseline no_agent (366.821 µs) : 347, 386 . : milestone, 367, iast (478.065 µs) : 456, 500 . : milestone, 478, iast_FULL (545.182 µs) : 524, 567 . : milestone, 545, iast_GLOBAL (497.273 µs) : 475, 520 . : milestone, 497, iast_HARDCODED_SECRET_DISABLED (471.666 µs) : 449, 494 . : milestone, 472, iast_INACTIVE (441.567 µs) : 420, 463 . : milestone, 442, iast_TELEMETRY_OFF (464.785 µs) : 442, 487 . : milestone, 465, tracing (431.336 µs) : 411, 452 . : milestone, 431, section candidate no_agent (360.052 µs) : 341, 379 . : milestone, 360, iast (475.425 µs) : 454, 497 . : milestone, 475, iast_FULL (543.618 µs) : 522, 565 . : milestone, 544, iast_GLOBAL (498.452 µs) : 477, 520 . : milestone, 498, iast_HARDCODED_SECRET_DISABLED (492.48 µs) : 471, 514 . : milestone, 492, iast_INACTIVE (439.362 µs) : 419, 460 . : milestone, 439, iast_TELEMETRY_OFF (467.541 µs) : 445, 490 . : milestone, 468, tracing (433.497 µs) : 413, 454 . : milestone, 433, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|366.821 µs [347.336 µs, 386.307 µs]|-| |iast|478.065 µs [455.751 µs, 500.379 µs]|111.243 µs (30.3%)| |iast_FULL|545.182 µs [523.83 µs, 566.535 µs]|178.361 µs (48.6%)| |iast_GLOBAL|497.273 µs [474.753 µs, 519.792 µs]|130.451 µs (35.6%)| |iast_HARDCODED_SECRET_DISABLED|471.666 µs [449.448 µs, 493.885 µs]|104.845 µs (28.6%)| |iast_INACTIVE|441.567 µs [420.199 µs, 462.935 µs]|74.746 µs (20.4%)| |iast_TELEMETRY_OFF|464.785 µs [442.282 µs, 487.289 µs]|97.964 µs (26.7%)| |tracing|431.336 µs [410.888 µs, 451.784 µs]|64.515 µs (17.6%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|360.052 µs [340.679 µs, 379.425 µs]|-| |iast|475.425 µs [453.868 µs, 496.982 µs]|115.373 µs (32.0%)| |iast_FULL|543.618 µs [522.083 µs, 565.153 µs]|183.566 µs (51.0%)| |iast_GLOBAL|498.452 µs [477.324 µs, 519.58 µs]|138.399 µs (38.4%)| |iast_HARDCODED_SECRET_DISABLED|492.48 µs [471.197 µs, 513.764 µs]|132.428 µs (36.8%)| |iast_INACTIVE|439.362 µs [418.704 µs, 460.02 µs]|79.31 µs (22.0%)| |iast_TELEMETRY_OFF|467.541 µs [445.16 µs, 489.921 µs]|107.488 µs (29.9%)| |tracing|433.497 µs [413.15 µs, 453.845 µs]|73.445 µs (20.4%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-py12
git_commit_date 1725870430 1725871282
git_commit_sha ed00591df5 4216e2201c
release_version 1.40.0-SNAPSHOT~ed00591df5 1.40.0-SNAPSHOT~4216e2201c
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1725872996 |1725872996 | |ci_job_id |631539698 |631539698 | |ci_pipeline_id|43831157 |43831157 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~4216e2201c, baseline=1.40.0-SNAPSHOT~ed00591df5 dateFormat X axisFormat %s section baseline no_agent (1.458 ms) : 1447, 1470 . : milestone, 1458, appsec (2.221 ms) : 2185, 2256 . : milestone, 2221, iast (1.968 ms) : 1925, 2010 . : milestone, 1968, iast_GLOBAL (2.019 ms) : 1974, 2063 . : milestone, 2019, profiling (1.851 ms) : 1817, 1885 . : milestone, 1851, tracing (1.827 ms) : 1794, 1861 . : milestone, 1827, section candidate no_agent (1.454 ms) : 1442, 1465 . : milestone, 1454, appsec (2.212 ms) : 2177, 2247 . : milestone, 2212, iast (1.965 ms) : 1922, 2008 . : milestone, 1965, iast_GLOBAL (2.003 ms) : 1960, 2047 . : milestone, 2003, profiling (1.857 ms) : 1823, 1892 . : milestone, 1857, tracing (1.839 ms) : 1805, 1872 . : milestone, 1839, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.458 ms [1.447 ms, 1.47 ms]|-| |appsec|2.221 ms [2.185 ms, 2.256 ms]|762.306 µs (52.3%)| |iast|1.968 ms [1.925 ms, 2.01 ms]|509.243 µs (34.9%)| |iast_GLOBAL|2.019 ms [1.974 ms, 2.063 ms]|560.073 µs (38.4%)| |profiling|1.851 ms [1.817 ms, 1.885 ms]|392.771 µs (26.9%)| |tracing|1.827 ms [1.794 ms, 1.861 ms]|368.982 µs (25.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.454 ms [1.442 ms, 1.465 ms]|-| |appsec|2.212 ms [2.177 ms, 2.247 ms]|757.858 µs (52.1%)| |iast|1.965 ms [1.922 ms, 2.008 ms]|511.125 µs (35.2%)| |iast_GLOBAL|2.003 ms [1.96 ms, 2.047 ms]|549.421 µs (37.8%)| |profiling|1.857 ms [1.823 ms, 1.892 ms]|403.498 µs (27.8%)| |tracing|1.839 ms [1.805 ms, 1.872 ms]|384.778 µs (26.5%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~4216e2201c, baseline=1.40.0-SNAPSHOT~ed00591df5 dateFormat X axisFormat %s section baseline no_agent (14.975 s) : 14975000, 14975000 . : milestone, 14975000, appsec (15.181 s) : 15181000, 15181000 . : milestone, 15181000, iast (18.953 s) : 18953000, 18953000 . : milestone, 18953000, iast_GLOBAL (17.704 s) : 17704000, 17704000 . : milestone, 17704000, profiling (15.3 s) : 15300000, 15300000 . : milestone, 15300000, tracing (14.974 s) : 14974000, 14974000 . : milestone, 14974000, section candidate no_agent (15.189 s) : 15189000, 15189000 . : milestone, 15189000, appsec (15.107 s) : 15107000, 15107000 . : milestone, 15107000, iast (18.865 s) : 18865000, 18865000 . : milestone, 18865000, iast_GLOBAL (17.817 s) : 17817000, 17817000 . : milestone, 17817000, profiling (15.243 s) : 15243000, 15243000 . : milestone, 15243000, tracing (14.949 s) : 14949000, 14949000 . : milestone, 14949000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.975 s [14.975 s, 14.975 s]|-| |appsec|15.181 s [15.181 s, 15.181 s]|206.0 ms (1.4%)| |iast|18.953 s [18.953 s, 18.953 s]|3.978 s (26.6%)| |iast_GLOBAL|17.704 s [17.704 s, 17.704 s]|2.729 s (18.2%)| |profiling|15.3 s [15.3 s, 15.3 s]|325.0 ms (2.2%)| |tracing|14.974 s [14.974 s, 14.974 s]|-1.0 ms (-0.0%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.189 s [15.189 s, 15.189 s]|-| |appsec|15.107 s [15.107 s, 15.107 s]|-82.0 ms (-0.5%)| |iast|18.865 s [18.865 s, 18.865 s]|3.676 s (24.2%)| |iast_GLOBAL|17.817 s [17.817 s, 17.817 s]|2.628 s (17.3%)| |profiling|15.243 s [15.243 s, 15.243 s]|54.0 ms (0.4%)| |tracing|14.949 s [14.949 s, 14.949 s]|-240.0 ms (-1.6%)|