search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
572 stars 284 forks source link

[🍒 7562] Backport systest bump for release v1.39.x #7673

Closed MattAlp closed 6 days ago

MattAlp commented 6 days ago

What Does This Do

Includes https://github.com/DataDog/dd-trace-java/pull/7562 in the v1.39.1 patch milestone so that system tests succeed.

This needs to be a cherry picked commit.

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 6 days ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/backport-systest-bump-v1.39.x
git_commit_date 1727095368 1727113343
git_commit_sha 27f522f863 8aada56dfc
release_version 1.40.0-SNAPSHOT~27f522f863 1.40.0-SNAPSHOT~8aada56dfc
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727115800 |1727115800 | |ci_job_id |648625370 |648625370 | |ci_pipeline_id|44939332 |44939332 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 1 performance improvements and 2 performance regressions! Performance is the same for 46 metrics, 14 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Telemetry worse
[+348.345µs; +544.681µs] or [+5.001%; +7.819%]		 7.412ms 6.966ms
scenario:startup:petclinic:iast:Telemetry worse
[+244.454µs; +493.670µs] or [+3.488%; +7.044%]		 7.378ms 7.009ms
scenario:startup:petclinic:profiling:AppSec better
[-3.243ms; -1.160ms] or [-5.910%; -2.114%]		 52.666ms 54.867ms
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~8aada56dfc, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section tracing Agent [baseline] (1.071 s) : 0, 1071164 Total [baseline] (10.387 s) : 0, 10387133 Agent [candidate] (1.068 s) : 0, 1067571 Total [candidate] (10.372 s) : 0, 10371813 section appsec Agent [baseline] (1.202 s) : 0, 1202394 Total [baseline] (10.613 s) : 0, 10612511 Agent [candidate] (1.195 s) : 0, 1194779 Total [candidate] (10.624 s) : 0, 10623635 section iast Agent [baseline] (1.19 s) : 0, 1190294 Total [baseline] (10.806 s) : 0, 10806242 Agent [candidate] (1.189 s) : 0, 1189478 Total [candidate] (10.827 s) : 0, 10827149 section profiling Agent [baseline] (1.271 s) : 0, 1270861 Total [baseline] (10.605 s) : 0, 10604913 Agent [candidate] (1.269 s) : 0, 1269260 Total [candidate] (10.638 s) : 0, 10637535 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.071 s |-| |Agent|appsec|1.202 s |131.23 ms (12.3%)| |Agent|iast|1.19 s |119.13 ms (11.1%)| |Agent|profiling|1.271 s |199.697 ms (18.6%)| |Total|tracing|10.387 s |-| |Total|appsec|10.613 s |225.378 ms (2.2%)| |Total|iast|10.806 s |419.109 ms (4.0%)| |Total|profiling|10.605 s |217.78 ms (2.1%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.068 s |-| |Agent|appsec|1.195 s |127.208 ms (11.9%)| |Agent|iast|1.189 s |121.907 ms (11.4%)| |Agent|profiling|1.269 s |201.689 ms (18.9%)| |Total|tracing|10.372 s |-| |Total|appsec|10.624 s |251.822 ms (2.4%)| |Total|iast|10.827 s |455.337 ms (4.4%)| |Total|profiling|10.638 s |265.723 ms (2.6%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~8aada56dfc, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (684.347 ms) : 0, 684347 BytebuddyAgent [candidate] (681.939 ms) : 0, 681939 GlobalTracer [baseline] (310.716 ms) : 0, 310716 GlobalTracer [candidate] (311.504 ms) : 0, 311504 AppSec [baseline] (54.096 ms) : 0, 54096 AppSec [candidate] (52.055 ms) : 0, 52055 Remote Config [baseline] (667.842 µs) : 0, 668 Remote Config [candidate] (693.591 µs) : 0, 694 Telemetry [baseline] (7.661 ms) : 0, 7661 Telemetry [candidate] (7.63 ms) : 0, 7630 section appsec BytebuddyAgent [baseline] (702.581 ms) : 0, 702581 BytebuddyAgent [candidate] (696.771 ms) : 0, 696771 GlobalTracer [baseline] (303.596 ms) : 0, 303596 GlobalTracer [candidate] (303.239 ms) : 0, 303239 AppSec [baseline] (164.018 ms) : 0, 164018 AppSec [candidate] (161.493 ms) : 0, 161493 Remote Config [baseline] (656.176 µs) : 0, 656 Remote Config [candidate] (630.39 µs) : 0, 630 Telemetry [baseline] (7.838 ms) : 0, 7838 Telemetry [candidate] (8.334 ms) : 0, 8334 IAST [baseline] (20.132 ms) : 0, 20132 IAST [candidate] (21.385 ms) : 0, 21385 section iast BytebuddyAgent [baseline] (792.681 ms) : 0, 792681 BytebuddyAgent [candidate] (791.831 ms) : 0, 791831 GlobalTracer [baseline] (298.352 ms) : 0, 298352 GlobalTracer [candidate] (299.378 ms) : 0, 299378 AppSec [baseline] (54.364 ms) : 0, 54364 AppSec [candidate] (53.929 ms) : 0, 53929 Remote Config [baseline] (606.668 µs) : 0, 607 Remote Config [candidate] (598.651 µs) : 0, 599 Telemetry [baseline] (7.009 ms) : 0, 7009 Telemetry [candidate] (7.378 ms) : 0, 7378 IAST [baseline] (23.621 ms) : 0, 23621 IAST [candidate] (22.69 ms) : 0, 22690 section profiling BytebuddyAgent [baseline] (677.222 ms) : 0, 677222 BytebuddyAgent [candidate] (676.746 ms) : 0, 676746 GlobalTracer [baseline] (394.804 ms) : 0, 394804 GlobalTracer [candidate] (395.994 ms) : 0, 395994 AppSec [baseline] (54.867 ms) : 0, 54867 AppSec [candidate] (52.666 ms) : 0, 52666 Remote Config [baseline] (648.911 µs) : 0, 649 Remote Config [candidate] (725.035 µs) : 0, 725 Telemetry [baseline] (7.513 ms) : 0, 7513 Telemetry [candidate] (7.487 ms) : 0, 7487 ProfilingAgent [baseline] (97.043 ms) : 0, 97043 ProfilingAgent [candidate] (97.332 ms) : 0, 97332 Profiling [baseline] (97.066 ms) : 0, 97066 Profiling [candidate] (97.357 ms) : 0, 97357 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~8aada56dfc, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section tracing Agent [baseline] (1.066 s) : 0, 1065933 Total [baseline] (8.539 s) : 0, 8539308 Agent [candidate] (1.076 s) : 0, 1076193 Total [candidate] (8.55 s) : 0, 8549545 section iast Agent [baseline] (1.196 s) : 0, 1196199 Total [baseline] (9.012 s) : 0, 9011896 Agent [candidate] (1.188 s) : 0, 1187910 Total [candidate] (9.022 s) : 0, 9021724 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.192 s) : 0, 1192255 Total [baseline] (9.017 s) : 0, 9016929 Agent [candidate] (1.185 s) : 0, 1184625 Total [candidate] (8.963 s) : 0, 8962646 section iast_TELEMETRY_OFF Agent [baseline] (1.193 s) : 0, 1193132 Total [baseline] (8.997 s) : 0, 8996575 Agent [candidate] (1.184 s) : 0, 1183738 Total [candidate] (8.977 s) : 0, 8976978 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.066 s |-| |Agent|iast|1.196 s |130.266 ms (12.2%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.192 s |126.321 ms (11.9%)| |Agent|iast_TELEMETRY_OFF|1.193 s |127.199 ms (11.9%)| |Total|tracing|8.539 s |-| |Total|iast|9.012 s |472.589 ms (5.5%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.017 s |477.621 ms (5.6%)| |Total|iast_TELEMETRY_OFF|8.997 s |457.268 ms (5.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.076 s |-| |Agent|iast|1.188 s |111.718 ms (10.4%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.185 s |108.433 ms (10.1%)| |Agent|iast_TELEMETRY_OFF|1.184 s |107.545 ms (10.0%)| |Total|tracing|8.55 s |-| |Total|iast|9.022 s |472.18 ms (5.5%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.963 s |413.102 ms (4.8%)| |Total|iast_TELEMETRY_OFF|8.977 s |427.433 ms (5.0%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~8aada56dfc, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (680.39 ms) : 0, 680390 BytebuddyAgent [candidate] (687.926 ms) : 0, 687926 GlobalTracer [baseline] (309.933 ms) : 0, 309933 GlobalTracer [candidate] (313.983 ms) : 0, 313983 AppSec [baseline] (53.75 ms) : 0, 53750 AppSec [candidate] (52.203 ms) : 0, 52203 Remote Config [baseline] (673.209 µs) : 0, 673 Remote Config [candidate] (688.078 µs) : 0, 688 Telemetry [baseline] (7.615 ms) : 0, 7615 Telemetry [candidate] (7.541 ms) : 0, 7541 section iast BytebuddyAgent [baseline] (796.849 ms) : 0, 796849 BytebuddyAgent [candidate] (790.166 ms) : 0, 790166 GlobalTracer [baseline] (299.859 ms) : 0, 299859 GlobalTracer [candidate] (299.314 ms) : 0, 299314 AppSec [baseline] (56.493 ms) : 0, 56493 AppSec [candidate] (54.699 ms) : 0, 54699 Remote Config [baseline] (609.745 µs) : 0, 610 Remote Config [candidate] (612.931 µs) : 0, 613 Telemetry [baseline] (6.966 ms) : 0, 6966 Telemetry [candidate] (7.412 ms) : 0, 7412 IAST [baseline] (21.69 ms) : 0, 21690 IAST [candidate] (22.03 ms) : 0, 22030 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (792.376 ms) : 0, 792376 BytebuddyAgent [candidate] (787.611 ms) : 0, 787611 GlobalTracer [baseline] (300.077 ms) : 0, 300077 GlobalTracer [candidate] (298.758 ms) : 0, 298758 AppSec [baseline] (54.009 ms) : 0, 54009 AppSec [candidate] (53.022 ms) : 0, 53022 Remote Config [baseline] (612.783 µs) : 0, 613 Remote Config [candidate] (588.756 µs) : 0, 589 Telemetry [baseline] (7.083 ms) : 0, 7083 Telemetry [candidate] (7.348 ms) : 0, 7348 IAST [baseline] (24.452 ms) : 0, 24452 IAST [candidate] (23.634 ms) : 0, 23634 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (793.038 ms) : 0, 793038 BytebuddyAgent [candidate] (786.858 ms) : 0, 786858 GlobalTracer [baseline] (300.096 ms) : 0, 300096 GlobalTracer [candidate] (299.263 ms) : 0, 299263 AppSec [baseline] (55.53 ms) : 0, 55530 AppSec [candidate] (53.126 ms) : 0, 53126 Remote Config [baseline] (611.082 µs) : 0, 611 Remote Config [candidate] (575.928 µs) : 0, 576 Telemetry [baseline] (6.883 ms) : 0, 6883 Telemetry [candidate] (7.938 ms) : 0, 7938 IAST [baseline] (23.257 ms) : 0, 23257 IAST [candidate] (22.265 ms) : 0, 22265 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-23T17:53:58 2024-09-23T18:00:47
git_branch master mattalp/backport-systest-bump-v1.39.x
git_commit_date 1727095368 1727113343
git_commit_sha 27f522f863 8aada56dfc
release_version 1.40.0-SNAPSHOT~27f522f863 1.40.0-SNAPSHOT~8aada56dfc
start_time 2024-09-23T17:53:44 2024-09-23T18:00:33
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727114795 |1727114795 | |ci_job_id |648625371 |648625371 | |ci_pipeline_id|44939332 |44939332 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 1 performance regressions! Performance is the same for 11 metrics, 16 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:petclinic:profiling worse
[+45.846µs; +98.756µs] or [+3.093%; +6.663%]		 unstable
[-784.776op/s; +310.702op/s] or [-24.524%; +9.709%]		 1.554ms 2962.963op/s 1.482ms 3200.000op/s
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~8aada56dfc, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section baseline no_agent (371.529 µs) : 350, 393 . : milestone, 372, iast (489.651 µs) : 468, 511 . : milestone, 490, iast_FULL (555.08 µs) : 534, 576 . : milestone, 555, iast_GLOBAL (506.762 µs) : 485, 529 . : milestone, 507, iast_HARDCODED_SECRET_DISABLED (490.559 µs) : 469, 512 . : milestone, 491, iast_INACTIVE (449.069 µs) : 428, 470 . : milestone, 449, iast_TELEMETRY_OFF (478.314 µs) : 456, 501 . : milestone, 478, tracing (442.799 µs) : 423, 463 . : milestone, 443, section candidate no_agent (370.191 µs) : 350, 391 . : milestone, 370, iast (486.393 µs) : 464, 508 . : milestone, 486, iast_FULL (561.673 µs) : 540, 583 . : milestone, 562, iast_GLOBAL (513.915 µs) : 491, 537 . : milestone, 514, iast_HARDCODED_SECRET_DISABLED (477.597 µs) : 456, 499 . : milestone, 478, iast_INACTIVE (446.498 µs) : 426, 467 . : milestone, 446, iast_TELEMETRY_OFF (477.339 µs) : 455, 500 . : milestone, 477, tracing (441.667 µs) : 421, 462 . : milestone, 442, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|371.529 µs [349.917 µs, 393.142 µs]|-| |iast|489.651 µs [468.394 µs, 510.908 µs]|118.121 µs (31.8%)| |iast_FULL|555.08 µs [533.768 µs, 576.392 µs]|183.551 µs (49.4%)| |iast_GLOBAL|506.762 µs [484.522 µs, 529.003 µs]|135.233 µs (36.4%)| |iast_HARDCODED_SECRET_DISABLED|490.559 µs [468.882 µs, 512.237 µs]|119.03 µs (32.0%)| |iast_INACTIVE|449.069 µs [428.07 µs, 470.068 µs]|77.539 µs (20.9%)| |iast_TELEMETRY_OFF|478.314 µs [455.62 µs, 501.007 µs]|106.784 µs (28.7%)| |tracing|442.799 µs [422.667 µs, 462.931 µs]|71.27 µs (19.2%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|370.191 µs [349.541 µs, 390.84 µs]|-| |iast|486.393 µs [464.313 µs, 508.474 µs]|116.203 µs (31.4%)| |iast_FULL|561.673 µs [540.13 µs, 583.217 µs]|191.483 µs (51.7%)| |iast_GLOBAL|513.915 µs [490.993 µs, 536.838 µs]|143.725 µs (38.8%)| |iast_HARDCODED_SECRET_DISABLED|477.597 µs [456.386 µs, 498.807 µs]|107.406 µs (29.0%)| |iast_INACTIVE|446.498 µs [426.154 µs, 466.843 µs]|76.307 µs (20.6%)| |iast_TELEMETRY_OFF|477.339 µs [454.726 µs, 499.951 µs]|107.148 µs (28.9%)| |tracing|441.667 µs [421.209 µs, 462.125 µs]|71.477 µs (19.3%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~8aada56dfc, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section baseline no_agent (1.334 ms) : 1315, 1352 . : milestone, 1334, appsec (1.716 ms) : 1692, 1739 . : milestone, 1716, appsec_no_iast (1.728 ms) : 1705, 1752 . : milestone, 1728, iast (1.471 ms) : 1449, 1493 . : milestone, 1471, profiling (1.482 ms) : 1457, 1507 . : milestone, 1482, tracing (1.458 ms) : 1434, 1483 . : milestone, 1458, section candidate no_agent (1.346 ms) : 1327, 1365 . : milestone, 1346, appsec (1.734 ms) : 1708, 1761 . : milestone, 1734, appsec_no_iast (1.754 ms) : 1730, 1778 . : milestone, 1754, iast (1.471 ms) : 1450, 1493 . : milestone, 1471, profiling (1.554 ms) : 1530, 1579 . : milestone, 1554, tracing (1.459 ms) : 1435, 1483 . : milestone, 1459, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.334 ms [1.315 ms, 1.352 ms]|-| |appsec|1.716 ms [1.692 ms, 1.739 ms]|381.865 µs (28.6%)| |appsec_no_iast|1.728 ms [1.705 ms, 1.752 ms]|394.814 µs (29.6%)| |iast|1.471 ms [1.449 ms, 1.493 ms]|137.23 µs (10.3%)| |profiling|1.482 ms [1.457 ms, 1.507 ms]|148.505 µs (11.1%)| |tracing|1.458 ms [1.434 ms, 1.483 ms]|124.479 µs (9.3%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.346 ms [1.327 ms, 1.365 ms]|-| |appsec|1.734 ms [1.708 ms, 1.761 ms]|388.124 µs (28.8%)| |appsec_no_iast|1.754 ms [1.73 ms, 1.778 ms]|408.04 µs (30.3%)| |iast|1.471 ms [1.45 ms, 1.493 ms]|125.121 µs (9.3%)| |profiling|1.554 ms [1.53 ms, 1.579 ms]|208.239 µs (15.5%)| |tracing|1.459 ms [1.435 ms, 1.483 ms]|112.976 µs (8.4%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/backport-systest-bump-v1.39.x
git_commit_date 1727095368 1727113343
git_commit_sha 27f522f863 8aada56dfc
release_version 1.40.0-SNAPSHOT~27f522f863 1.40.0-SNAPSHOT~8aada56dfc
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1727115314 |1727115314 | |ci_job_id |648625372 |648625372 | |ci_pipeline_id|44939332 |44939332 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~8aada56dfc, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section baseline no_agent (15.404 s) : 15404000, 15404000 . : milestone, 15404000, appsec (15.085 s) : 15085000, 15085000 . : milestone, 15085000, iast (18.744 s) : 18744000, 18744000 . : milestone, 18744000, iast_GLOBAL (18.088 s) : 18088000, 18088000 . : milestone, 18088000, profiling (15.287 s) : 15287000, 15287000 . : milestone, 15287000, tracing (15.357 s) : 15357000, 15357000 . : milestone, 15357000, section candidate no_agent (15.076 s) : 15076000, 15076000 . : milestone, 15076000, appsec (15.172 s) : 15172000, 15172000 . : milestone, 15172000, iast (18.623 s) : 18623000, 18623000 . : milestone, 18623000, iast_GLOBAL (17.949 s) : 17949000, 17949000 . : milestone, 17949000, profiling (15.172 s) : 15172000, 15172000 . : milestone, 15172000, tracing (15.092 s) : 15092000, 15092000 . : milestone, 15092000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.404 s [15.404 s, 15.404 s]|-| |appsec|15.085 s [15.085 s, 15.085 s]|-319.0 ms (-2.1%)| |iast|18.744 s [18.744 s, 18.744 s]|3.34 s (21.7%)| |iast_GLOBAL|18.088 s [18.088 s, 18.088 s]|2.684 s (17.4%)| |profiling|15.287 s [15.287 s, 15.287 s]|-117.0 ms (-0.8%)| |tracing|15.357 s [15.357 s, 15.357 s]|-47.0 ms (-0.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.076 s [15.076 s, 15.076 s]|-| |appsec|15.172 s [15.172 s, 15.172 s]|96.0 ms (0.6%)| |iast|18.623 s [18.623 s, 18.623 s]|3.547 s (23.5%)| |iast_GLOBAL|17.949 s [17.949 s, 17.949 s]|2.873 s (19.1%)| |profiling|15.172 s [15.172 s, 15.172 s]|96.0 ms (0.6%)| |tracing|15.092 s [15.092 s, 15.092 s]|16.0 ms (0.1%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~8aada56dfc, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section baseline no_agent (1.46 ms) : 1449, 1471 . : milestone, 1460, appsec (2.313 ms) : 2272, 2353 . : milestone, 2313, iast (2.058 ms) : 2007, 2109 . : milestone, 2058, iast_GLOBAL (2.096 ms) : 2045, 2147 . : milestone, 2096, profiling (1.918 ms) : 1879, 1958 . : milestone, 1918, tracing (1.898 ms) : 1859, 1936 . : milestone, 1898, section candidate no_agent (1.467 ms) : 1456, 1479 . : milestone, 1467, appsec (2.276 ms) : 2236, 2316 . : milestone, 2276, iast (2.027 ms) : 1979, 2076 . : milestone, 2027, iast_GLOBAL (2.092 ms) : 2042, 2142 . : milestone, 2092, profiling (1.916 ms) : 1876, 1955 . : milestone, 1916, tracing (1.901 ms) : 1863, 1939 . : milestone, 1901, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.46 ms [1.449 ms, 1.471 ms]|-| |appsec|2.313 ms [2.272 ms, 2.353 ms]|852.595 µs (58.4%)| |iast|2.058 ms [2.007 ms, 2.109 ms]|598.014 µs (41.0%)| |iast_GLOBAL|2.096 ms [2.045 ms, 2.147 ms]|635.75 µs (43.5%)| |profiling|1.918 ms [1.879 ms, 1.958 ms]|458.342 µs (31.4%)| |tracing|1.898 ms [1.859 ms, 1.936 ms]|437.627 µs (30.0%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.467 ms [1.456 ms, 1.479 ms]|-| |appsec|2.276 ms [2.236 ms, 2.316 ms]|808.463 µs (55.1%)| |iast|2.027 ms [1.979 ms, 2.076 ms]|559.739 µs (38.1%)| |iast_GLOBAL|2.092 ms [2.042 ms, 2.142 ms]|624.847 µs (42.6%)| |profiling|1.916 ms [1.876 ms, 1.955 ms]|448.404 µs (30.6%)| |tracing|1.901 ms [1.863 ms, 1.939 ms]|433.54 µs (29.5%)|