search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Improve GitHub Workflows #7614

Closed PerfectSlayer closed 2 months ago

PerfectSlayer commented 2 months ago

What Does This Do

Motivation

Additional Notes

Testing script start being really useful. I will document it later, still trying to find the right format / usage for it.

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 2 months ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/gh-workflow
git_commit_date 1726154176 1726204215
git_commit_sha a472c9dc91 fe0e8a37d5
release_version 1.40.0-SNAPSHOT~a472c9dc91 1.40.0-SNAPSHOT~fe0e8a37d5
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726206632 |1726206632 | |ci_job_id |638178016 |638178016 | |ci_pipeline_id|44255280 |44255280 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~fe0e8a37d5, baseline=1.40.0-SNAPSHOT~a472c9dc91 dateFormat X axisFormat %s section tracing Agent [baseline] (1.078 s) : 0, 1077685 Total [baseline] (8.54 s) : 0, 8540416 Agent [candidate] (1.062 s) : 0, 1062293 Total [candidate] (8.51 s) : 0, 8509977 section iast Agent [baseline] (1.188 s) : 0, 1187543 Total [baseline] (8.981 s) : 0, 8981269 Agent [candidate] (1.185 s) : 0, 1185118 Total [candidate] (8.954 s) : 0, 8953584 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.191 s) : 0, 1191398 Total [baseline] (8.975 s) : 0, 8974571 Agent [candidate] (1.189 s) : 0, 1189074 Total [candidate] (9.071 s) : 0, 9071417 section iast_TELEMETRY_OFF Agent [baseline] (1.182 s) : 0, 1181877 Total [baseline] (8.972 s) : 0, 8971928 Agent [candidate] (1.185 s) : 0, 1185290 Total [candidate] (8.969 s) : 0, 8969461 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.078 s |-| |Agent|iast|1.188 s |109.857 ms (10.2%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.191 s |113.713 ms (10.6%)| |Agent|iast_TELEMETRY_OFF|1.182 s |104.192 ms (9.7%)| |Total|tracing|8.54 s |-| |Total|iast|8.981 s |440.853 ms (5.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.975 s |434.154 ms (5.1%)| |Total|iast_TELEMETRY_OFF|8.972 s |431.511 ms (5.1%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.062 s |-| |Agent|iast|1.185 s |122.825 ms (11.6%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.189 s |126.781 ms (11.9%)| |Agent|iast_TELEMETRY_OFF|1.185 s |122.997 ms (11.6%)| |Total|tracing|8.51 s |-| |Total|iast|8.954 s |443.606 ms (5.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.071 s |561.439 ms (6.6%)| |Total|iast_TELEMETRY_OFF|8.969 s |459.483 ms (5.4%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~fe0e8a37d5, baseline=1.40.0-SNAPSHOT~a472c9dc91 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (688.989 ms) : 0, 688989 BytebuddyAgent [candidate] (678.992 ms) : 0, 678992 GlobalTracer [baseline] (314.134 ms) : 0, 314134 GlobalTracer [candidate] (310.037 ms) : 0, 310037 AppSec [baseline] (52.333 ms) : 0, 52333 AppSec [candidate] (51.427 ms) : 0, 51427 Remote Config [baseline] (727.399 µs) : 0, 727 Remote Config [candidate] (716.737 µs) : 0, 717 Telemetry [baseline] (7.713 ms) : 0, 7713 Telemetry [candidate] (7.51 ms) : 0, 7510 section iast BytebuddyAgent [baseline] (791.024 ms) : 0, 791024 BytebuddyAgent [candidate] (789.164 ms) : 0, 789164 GlobalTracer [baseline] (298.745 ms) : 0, 298745 GlobalTracer [candidate] (298.182 ms) : 0, 298182 AppSec [baseline] (52.665 ms) : 0, 52665 AppSec [candidate] (51.162 ms) : 0, 51162 IAST [baseline] (23.51 ms) : 0, 23510 IAST [candidate] (25.13 ms) : 0, 25130 Remote Config [baseline] (603.686 µs) : 0, 604 Remote Config [candidate] (612.12 µs) : 0, 612 Telemetry [baseline] (7.388 ms) : 0, 7388 Telemetry [candidate] (7.273 ms) : 0, 7273 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (791.666 ms) : 0, 791666 BytebuddyAgent [candidate] (790.929 ms) : 0, 790929 GlobalTracer [baseline] (300.849 ms) : 0, 300849 GlobalTracer [candidate] (299.062 ms) : 0, 299062 AppSec [baseline] (52.608 ms) : 0, 52608 AppSec [candidate] (55.007 ms) : 0, 55007 IAST [baseline] (23.014 ms) : 0, 23014 IAST [candidate] (22.284 ms) : 0, 22284 Remote Config [baseline] (631.202 µs) : 0, 631 Remote Config [candidate] (615.394 µs) : 0, 615 Telemetry [baseline] (9.008 ms) : 0, 9008 Telemetry [candidate] (7.509 ms) : 0, 7509 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (787.321 ms) : 0, 787321 BytebuddyAgent [candidate] (787.856 ms) : 0, 787856 GlobalTracer [baseline] (297.939 ms) : 0, 297939 GlobalTracer [candidate] (299.172 ms) : 0, 299172 AppSec [baseline] (52.765 ms) : 0, 52765 AppSec [candidate] (53.518 ms) : 0, 53518 IAST [baseline] (20.874 ms) : 0, 20874 IAST [candidate] (22.413 ms) : 0, 22413 Remote Config [baseline] (608.043 µs) : 0, 608 Remote Config [candidate] (600.674 µs) : 0, 601 Telemetry [baseline] (8.719 ms) : 0, 8719 Telemetry [candidate] (8.061 ms) : 0, 8061 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~fe0e8a37d5, baseline=1.40.0-SNAPSHOT~a472c9dc91 dateFormat X axisFormat %s section tracing Agent [baseline] (1.064 s) : 0, 1064255 Total [baseline] (10.338 s) : 0, 10337802 Agent [candidate] (1.07 s) : 0, 1069771 Total [candidate] (10.392 s) : 0, 10392236 section appsec Agent [baseline] (1.201 s) : 0, 1200539 Total [baseline] (10.645 s) : 0, 10644546 Agent [candidate] (1.193 s) : 0, 1192958 Total [candidate] (10.582 s) : 0, 10581915 section iast Agent [baseline] (1.196 s) : 0, 1196462 Total [baseline] (10.903 s) : 0, 10902707 Agent [candidate] (1.19 s) : 0, 1189889 Total [candidate] (10.825 s) : 0, 10824748 section profiling Agent [baseline] (1.262 s) : 0, 1262266 Total [baseline] (10.718 s) : 0, 10718446 Agent [candidate] (1.26 s) : 0, 1259539 Total [candidate] (10.617 s) : 0, 10617126 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.064 s |-| |Agent|appsec|1.201 s |136.284 ms (12.8%)| |Agent|iast|1.196 s |132.206 ms (12.4%)| |Agent|profiling|1.262 s |198.011 ms (18.6%)| |Total|tracing|10.338 s |-| |Total|appsec|10.645 s |306.743 ms (3.0%)| |Total|iast|10.903 s |564.904 ms (5.5%)| |Total|profiling|10.718 s |380.644 ms (3.7%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.07 s |-| |Agent|appsec|1.193 s |123.187 ms (11.5%)| |Agent|iast|1.19 s |120.118 ms (11.2%)| |Agent|profiling|1.26 s |189.768 ms (17.7%)| |Total|tracing|10.392 s |-| |Total|appsec|10.582 s |189.678 ms (1.8%)| |Total|iast|10.825 s |432.512 ms (4.2%)| |Total|profiling|10.617 s |224.89 ms (2.2%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~fe0e8a37d5, baseline=1.40.0-SNAPSHOT~a472c9dc91 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (680.149 ms) : 0, 680149 BytebuddyAgent [candidate] (683.369 ms) : 0, 683369 GlobalTracer [baseline] (310.61 ms) : 0, 310610 GlobalTracer [candidate] (312.364 ms) : 0, 312364 AppSec [baseline] (51.685 ms) : 0, 51685 AppSec [candidate] (52.02 ms) : 0, 52020 Remote Config [baseline] (717.108 µs) : 0, 717 Remote Config [candidate] (717.461 µs) : 0, 717 Telemetry [baseline] (7.486 ms) : 0, 7486 Telemetry [candidate] (7.596 ms) : 0, 7596 section appsec BytebuddyAgent [baseline] (703.119 ms) : 0, 703119 BytebuddyAgent [candidate] (697.506 ms) : 0, 697506 GlobalTracer [baseline] (303.819 ms) : 0, 303819 GlobalTracer [candidate] (302.358 ms) : 0, 302358 AppSec [baseline] (160.517 ms) : 0, 160517 AppSec [candidate] (161.034 ms) : 0, 161034 Remote Config [baseline] (652.748 µs) : 0, 653 Remote Config [candidate] (639.913 µs) : 0, 640 Telemetry [baseline] (8.697 ms) : 0, 8697 Telemetry [candidate] (8.67 ms) : 0, 8670 IAST [baseline] (20.137 ms) : 0, 20137 IAST [candidate] (18.347 ms) : 0, 18347 section iast BytebuddyAgent [baseline] (796.852 ms) : 0, 796852 BytebuddyAgent [candidate] (792.114 ms) : 0, 792114 GlobalTracer [baseline] (300.876 ms) : 0, 300876 GlobalTracer [candidate] (299.424 ms) : 0, 299424 AppSec [baseline] (56.515 ms) : 0, 56515 AppSec [candidate] (53.249 ms) : 0, 53249 Remote Config [baseline] (599.182 µs) : 0, 599 Remote Config [candidate] (678.882 µs) : 0, 679 Telemetry [baseline] (7.447 ms) : 0, 7447 Telemetry [candidate] (7.278 ms) : 0, 7278 IAST [baseline] (20.499 ms) : 0, 20499 IAST [candidate] (23.484 ms) : 0, 23484 section profiling ProfilingAgent [baseline] (96.578 ms) : 0, 96578 ProfilingAgent [candidate] (95.687 ms) : 0, 95687 BytebuddyAgent [baseline] (673.836 ms) : 0, 673836 BytebuddyAgent [candidate] (672.447 ms) : 0, 672447 GlobalTracer [baseline] (393.496 ms) : 0, 393496 GlobalTracer [candidate] (393.069 ms) : 0, 393069 AppSec [baseline] (52.142 ms) : 0, 52142 AppSec [candidate] (52.255 ms) : 0, 52255 Remote Config [baseline] (737.449 µs) : 0, 737 Remote Config [candidate] (735.257 µs) : 0, 735 Telemetry [baseline] (7.504 ms) : 0, 7504 Telemetry [candidate] (7.409 ms) : 0, 7409 Profiling [baseline] (96.603 ms) : 0, 96603 Profiling [candidate] (95.711 ms) : 0, 95711 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-13T05:21:10 2024-09-13T05:28:00
git_branch master bbujon/gh-workflow
git_commit_date 1726154176 1726204215
git_commit_sha a472c9dc91 fe0e8a37d5
release_version 1.40.0-SNAPSHOT~a472c9dc91 1.40.0-SNAPSHOT~fe0e8a37d5
start_time 2024-09-13T05:20:56 2024-09-13T05:27:47
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726205626 |1726205626 | |ci_job_id |638178017 |638178017 | |ci_pipeline_id|44255280 |44255280 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~fe0e8a37d5, baseline=1.40.0-SNAPSHOT~a472c9dc91 dateFormat X axisFormat %s section baseline no_agent (1.333 ms) : 1312, 1353 . : milestone, 1333, appsec (1.721 ms) : 1698, 1744 . : milestone, 1721, appsec_no_iast (1.72 ms) : 1695, 1745 . : milestone, 1720, iast (1.497 ms) : 1475, 1519 . : milestone, 1497, profiling (1.493 ms) : 1470, 1516 . : milestone, 1493, tracing (1.472 ms) : 1448, 1496 . : milestone, 1472, section candidate no_agent (1.338 ms) : 1318, 1357 . : milestone, 1338, appsec (1.733 ms) : 1709, 1758 . : milestone, 1733, appsec_no_iast (1.703 ms) : 1678, 1728 . : milestone, 1703, iast (1.469 ms) : 1446, 1491 . : milestone, 1469, profiling (1.525 ms) : 1500, 1549 . : milestone, 1525, tracing (1.458 ms) : 1434, 1482 . : milestone, 1458, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.333 ms [1.312 ms, 1.353 ms]|-| |appsec|1.721 ms [1.698 ms, 1.744 ms]|388.008 µs (29.1%)| |appsec_no_iast|1.72 ms [1.695 ms, 1.745 ms]|386.78 µs (29.0%)| |iast|1.497 ms [1.475 ms, 1.519 ms]|164.075 µs (12.3%)| |profiling|1.493 ms [1.47 ms, 1.516 ms]|160.24 µs (12.0%)| |tracing|1.472 ms [1.448 ms, 1.496 ms]|138.944 µs (10.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.338 ms [1.318 ms, 1.357 ms]|-| |appsec|1.733 ms [1.709 ms, 1.758 ms]|395.522 µs (29.6%)| |appsec_no_iast|1.703 ms [1.678 ms, 1.728 ms]|365.14 µs (27.3%)| |iast|1.469 ms [1.446 ms, 1.491 ms]|130.959 µs (9.8%)| |profiling|1.525 ms [1.5 ms, 1.549 ms]|186.882 µs (14.0%)| |tracing|1.458 ms [1.434 ms, 1.482 ms]|120.234 µs (9.0%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~fe0e8a37d5, baseline=1.40.0-SNAPSHOT~a472c9dc91 dateFormat X axisFormat %s section baseline no_agent (375.657 µs) : 356, 395 . : milestone, 376, iast (483.157 µs) : 461, 505 . : milestone, 483, iast_FULL (553.198 µs) : 532, 574 . : milestone, 553, iast_GLOBAL (504.682 µs) : 484, 526 . : milestone, 505, iast_HARDCODED_SECRET_DISABLED (487.134 µs) : 465, 509 . : milestone, 487, iast_INACTIVE (449.6 µs) : 428, 471 . : milestone, 450, iast_TELEMETRY_OFF (473.184 µs) : 451, 496 . : milestone, 473, tracing (445.02 µs) : 424, 466 . : milestone, 445, section candidate no_agent (369.907 µs) : 351, 389 . : milestone, 370, iast (484.702 µs) : 463, 507 . : milestone, 485, iast_FULL (552.785 µs) : 532, 574 . : milestone, 553, iast_GLOBAL (504.877 µs) : 484, 526 . : milestone, 505, iast_HARDCODED_SECRET_DISABLED (489.372 µs) : 467, 511 . : milestone, 489, iast_INACTIVE (447.445 µs) : 426, 468 . : milestone, 447, iast_TELEMETRY_OFF (482.29 µs) : 459, 505 . : milestone, 482, tracing (443.14 µs) : 423, 463 . : milestone, 443, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|375.657 µs [356.014 µs, 395.3 µs]|-| |iast|483.157 µs [461.013 µs, 505.302 µs]|107.5 µs (28.6%)| |iast_FULL|553.198 µs [532.223 µs, 574.173 µs]|177.541 µs (47.3%)| |iast_GLOBAL|504.682 µs [483.695 µs, 525.669 µs]|129.025 µs (34.3%)| |iast_HARDCODED_SECRET_DISABLED|487.134 µs [465.083 µs, 509.184 µs]|111.477 µs (29.7%)| |iast_INACTIVE|449.6 µs [428.235 µs, 470.965 µs]|73.943 µs (19.7%)| |iast_TELEMETRY_OFF|473.184 µs [450.641 µs, 495.727 µs]|97.527 µs (26.0%)| |tracing|445.02 µs [424.171 µs, 465.869 µs]|69.363 µs (18.5%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|369.907 µs [350.575 µs, 389.24 µs]|-| |iast|484.702 µs [462.809 µs, 506.595 µs]|114.794 µs (31.0%)| |iast_FULL|552.785 µs [531.726 µs, 573.843 µs]|182.877 µs (49.4%)| |iast_GLOBAL|504.877 µs [483.953 µs, 525.8 µs]|134.969 µs (36.5%)| |iast_HARDCODED_SECRET_DISABLED|489.372 µs [467.429 µs, 511.314 µs]|119.464 µs (32.3%)| |iast_INACTIVE|447.445 µs [426.466 µs, 468.424 µs]|77.538 µs (21.0%)| |iast_TELEMETRY_OFF|482.29 µs [459.153 µs, 505.428 µs]|112.383 µs (30.4%)| |tracing|443.14 µs [422.983 µs, 463.297 µs]|73.233 µs (19.8%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/gh-workflow
git_commit_date 1726154176 1726204215
git_commit_sha a472c9dc91 fe0e8a37d5
release_version 1.40.0-SNAPSHOT~a472c9dc91 1.40.0-SNAPSHOT~fe0e8a37d5
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1726206457 |1726206457 | |ci_job_id |638178018 |638178018 | |ci_pipeline_id|44255280 |44255280 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~fe0e8a37d5, baseline=1.40.0-SNAPSHOT~a472c9dc91 dateFormat X axisFormat %s section baseline no_agent (1.463 ms) : 1452, 1475 . : milestone, 1463, appsec (2.282 ms) : 2241, 2323 . : milestone, 2282, iast (2.057 ms) : 2006, 2108 . : milestone, 2057, iast_GLOBAL (2.092 ms) : 2042, 2143 . : milestone, 2092, profiling (1.926 ms) : 1885, 1966 . : milestone, 1926, tracing (1.903 ms) : 1864, 1941 . : milestone, 1903, section candidate no_agent (1.464 ms) : 1452, 1475 . : milestone, 1464, appsec (2.267 ms) : 2226, 2307 . : milestone, 2267, iast (2.036 ms) : 1986, 2086 . : milestone, 2036, iast_GLOBAL (2.085 ms) : 2035, 2136 . : milestone, 2085, profiling (1.917 ms) : 1876, 1958 . : milestone, 1917, tracing (1.887 ms) : 1849, 1925 . : milestone, 1887, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.463 ms [1.452 ms, 1.475 ms]|-| |appsec|2.282 ms [2.241 ms, 2.323 ms]|818.187 µs (55.9%)| |iast|2.057 ms [2.006 ms, 2.108 ms]|593.129 µs (40.5%)| |iast_GLOBAL|2.092 ms [2.042 ms, 2.143 ms]|628.855 µs (43.0%)| |profiling|1.926 ms [1.885 ms, 1.966 ms]|462.218 µs (31.6%)| |tracing|1.903 ms [1.864 ms, 1.941 ms]|439.083 µs (30.0%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.464 ms [1.452 ms, 1.475 ms]|-| |appsec|2.267 ms [2.226 ms, 2.307 ms]|802.837 µs (54.8%)| |iast|2.036 ms [1.986 ms, 2.086 ms]|572.14 µs (39.1%)| |iast_GLOBAL|2.085 ms [2.035 ms, 2.136 ms]|621.454 µs (42.5%)| |profiling|1.917 ms [1.876 ms, 1.958 ms]|453.218 µs (31.0%)| |tracing|1.887 ms [1.849 ms, 1.925 ms]|423.554 µs (28.9%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~fe0e8a37d5, baseline=1.40.0-SNAPSHOT~a472c9dc91 dateFormat X axisFormat %s section baseline no_agent (15.562 s) : 15562000, 15562000 . : milestone, 15562000, appsec (15.381 s) : 15381000, 15381000 . : milestone, 15381000, iast (18.958 s) : 18958000, 18958000 . : milestone, 18958000, iast_GLOBAL (18.299 s) : 18299000, 18299000 . : milestone, 18299000, profiling (15.479 s) : 15479000, 15479000 . : milestone, 15479000, tracing (15.306 s) : 15306000, 15306000 . : milestone, 15306000, section candidate no_agent (15.418 s) : 15418000, 15418000 . : milestone, 15418000, appsec (15.108 s) : 15108000, 15108000 . : milestone, 15108000, iast (19.089 s) : 19089000, 19089000 . : milestone, 19089000, iast_GLOBAL (18.247 s) : 18247000, 18247000 . : milestone, 18247000, profiling (15.963 s) : 15963000, 15963000 . : milestone, 15963000, tracing (15.11 s) : 15110000, 15110000 . : milestone, 15110000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.562 s [15.562 s, 15.562 s]|-| |appsec|15.381 s [15.381 s, 15.381 s]|-181.0 ms (-1.2%)| |iast|18.958 s [18.958 s, 18.958 s]|3.396 s (21.8%)| |iast_GLOBAL|18.299 s [18.299 s, 18.299 s]|2.737 s (17.6%)| |profiling|15.479 s [15.479 s, 15.479 s]|-83.0 ms (-0.5%)| |tracing|15.306 s [15.306 s, 15.306 s]|-256.0 ms (-1.6%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.418 s [15.418 s, 15.418 s]|-| |appsec|15.108 s [15.108 s, 15.108 s]|-310.0 ms (-2.0%)| |iast|19.089 s [19.089 s, 19.089 s]|3.671 s (23.8%)| |iast_GLOBAL|18.247 s [18.247 s, 18.247 s]|2.829 s (18.3%)| |profiling|15.963 s [15.963 s, 15.963 s]|545.0 ms (3.5%)| |tracing|15.11 s [15.11 s, 15.11 s]|-308.0 ms (-2.0%)|