search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

[🍒 7635] Add support of spring boot nested jar for SymDB #7678

Closed jpbempel closed 1 month ago

jpbempel commented 1 month ago

This is a cherry-pick of #7635

What Does This Do

Spring boot use a special jar organisation for nested ones. It uses a new jar protocol for URL: jar:nested:

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 1 month ago

Debugger benchmarks

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
ci_job_date 1727185480 1727185856
end_time 2024-09-24T13:45:55 2024-09-24T13:52:11
git_branch master jpbempel/backport-7635
git_commit_sha 0dcde7931e 546c0ccf5ac993df9ae08fa9f6f6bf900a88755e
start_time 2024-09-24T13:44:41 2024-09-24T13:50:57
See matching parameters | |Baseline |Candidate | |----------------------|----------------------------------------------|----------------------------------------------| |ci_job_id |649698771 |649698771 | |ci_pipeline_id |45010264 |45010264 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |git_commit_date|1727184597 |1727184597 |

Summary

Found 0 performance improvements and 3 performance regressions! Performance is the same for 6 metrics, 6 unstable metrics.

scenario Δ mean agg_http_req_duration_min Δ mean agg_http_req_duration_p50 Δ mean agg_http_req_duration_p75 Δ mean agg_http_req_duration_p99 Δ mean throughput
scenario:loop worse
[+158.585µs; +182.118µs] or [+1.561%; +1.793%]		 worse
[+118.574µs; +205.225µs] or [+1.147%; +1.985%]		 worse
[+108.323µs; +241.144µs] or [+1.039%; +2.313%]		 unsure
[+28.592µs; +512.581µs] or [+0.266%; +4.763%]		 unsure
[-3.031op/s; -0.563op/s] or [-3.167%; -0.588%]
See unchanged results |scenario |Δ mean agg_http_req_duration_min |Δ mean agg_http_req_duration_p50 |Δ mean agg_http_req_duration_p75 |Δ mean agg_http_req_duration_p99 |Δ mean throughput | |----------------|----------------------------------------------------------------|-----------------------------------------------------------------|-----------------------------------------------------------------|-------------------------------------------------------------------|---------------------------------------------------------------------| |scenario:noprobe|unstable
[-47.057µs; +19.367µs] or [-17.287%; +7.115%]|unstable
[-64.441µs; +31.839µs] or [-20.588%; +10.172%]|unstable
[-73.504µs; +39.595µs] or [-22.477%; +12.108%]|unstable
[-483.741µs; +198.619µs] or [-63.447%; +26.051%]|same | |scenario:basic |same |same |same |unstable
[-68.442µs; +35.364µs] or [-12.694%; +6.559%] |unstable
[-173.234op/s; +173.234op/s] or [-6.756%; +6.756%]|
Request duration reports for reports ```mermaid gantt title reports - request duration [CI 0.99] : candidate=None, baseline=None dateFormat X axisFormat %s section baseline noprobe (313.01 µs) : 254, 372 . : milestone, 313, basic (303.718 µs) : 291, 317 . : milestone, 304, loop (10.338 ms) : 10293, 10383 . : milestone, 10338, section candidate noprobe (296.709 µs) : 270, 323 . : milestone, 297, basic (301.784 µs) : 294, 310 . : milestone, 302, loop (10.5 ms) : 10465, 10535 . : milestone, 10500, ``` * **baseline** results |Scenario|Request median duration [CI 0.99]| |---|---| |noprobe|313.01 µs [253.685 µs, 372.335 µs]| |basic|303.718 µs [290.691 µs, 316.746 µs]| |loop|10.338 ms [10.293 ms, 10.383 ms]| * **candidate** results |Scenario|Request median duration [CI 0.99]| |---|---| |noprobe|296.709 µs [270.297 µs, 323.121 µs]| |basic|301.784 µs [294.044 µs, 309.525 µs]| |loop|10.5 ms [10.465 ms, 10.535 ms]|
pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/backport-7635
git_commit_date 1727166392 1727184597
git_commit_sha 0dcde7931e 546c0ccf5a
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~546c0ccf5a
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727187125 |1727187125 | |ci_job_id |649698763 |649698763 | |ci_pipeline_id|45010264 |45010264 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 3 performance improvements and 3 performance regressions! Performance is the same for 39 metrics, 18 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:AppSec better
[-2.602ms; -1.141ms] or [-4.788%; -2.100%]		 52.465ms 54.337ms
scenario:startup:petclinic:iast:Telemetry worse
[+151.194µs; +417.625µs] or [+2.118%; +5.850%]		 7.424ms 7.139ms
scenario:startup:petclinic:profiling:AppSec better
[-2.518ms; -1.857ms] or [-4.595%; -3.388%]		 52.612ms 54.800ms
scenario:startup:petclinic:profiling:Remote Config worse
[+47.639µs; +81.264µs] or [+7.257%; +12.380%]		 720.862µs 656.410µs
scenario:startup:petclinic:tracing:AppSec better
[-2.576ms; -1.222ms] or [-4.753%; -2.255%]		 52.290ms 54.188ms
scenario:startup:petclinic:tracing:Remote Config worse
[+20.596µs; +59.582µs] or [+3.085%; +8.923%]		 707.810µs 667.721µs
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~546c0ccf5a, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section tracing Agent [baseline] (1.067 s) : 0, 1067390 Total [baseline] (10.476 s) : 0, 10476318 Agent [candidate] (1.072 s) : 0, 1072151 Total [candidate] (10.405 s) : 0, 10405260 section appsec Agent [baseline] (1.213 s) : 0, 1212973 Total [baseline] (10.679 s) : 0, 10679275 Agent [candidate] (1.2 s) : 0, 1199932 Total [candidate] (10.664 s) : 0, 10664272 section iast Agent [baseline] (1.201 s) : 0, 1201396 Total [baseline] (10.956 s) : 0, 10955952 Agent [candidate] (1.19 s) : 0, 1189880 Total [candidate] (10.847 s) : 0, 10847379 section profiling Agent [baseline] (1.267 s) : 0, 1266786 Total [baseline] (10.592 s) : 0, 10592086 Agent [candidate] (1.265 s) : 0, 1264731 Total [candidate] (10.576 s) : 0, 10576238 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.067 s |-| |Agent|appsec|1.213 s |145.584 ms (13.6%)| |Agent|iast|1.201 s |134.006 ms (12.6%)| |Agent|profiling|1.267 s |199.396 ms (18.7%)| |Total|tracing|10.476 s |-| |Total|appsec|10.679 s |202.958 ms (1.9%)| |Total|iast|10.956 s |479.634 ms (4.6%)| |Total|profiling|10.592 s |115.768 ms (1.1%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.072 s |-| |Agent|appsec|1.2 s |127.781 ms (11.9%)| |Agent|iast|1.19 s |117.729 ms (11.0%)| |Agent|profiling|1.265 s |192.579 ms (18.0%)| |Total|tracing|10.405 s |-| |Total|appsec|10.664 s |259.013 ms (2.5%)| |Total|iast|10.847 s |442.119 ms (4.2%)| |Total|profiling|10.576 s |170.978 ms (1.6%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~546c0ccf5a, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (680.729 ms) : 0, 680729 BytebuddyAgent [candidate] (684.498 ms) : 0, 684498 GlobalTracer [baseline] (310.49 ms) : 0, 310490 GlobalTracer [candidate] (313.105 ms) : 0, 313105 AppSec [baseline] (54.188 ms) : 0, 54188 AppSec [candidate] (52.29 ms) : 0, 52290 Remote Config [baseline] (667.721 µs) : 0, 668 Remote Config [candidate] (707.81 µs) : 0, 708 Telemetry [baseline] (7.643 ms) : 0, 7643 Telemetry [candidate] (7.65 ms) : 0, 7650 section appsec BytebuddyAgent [baseline] (708.549 ms) : 0, 708549 BytebuddyAgent [candidate] (699.327 ms) : 0, 699327 GlobalTracer [baseline] (307.047 ms) : 0, 307047 GlobalTracer [candidate] (304.926 ms) : 0, 304926 AppSec [baseline] (163.446 ms) : 0, 163446 AppSec [candidate] (161.851 ms) : 0, 161851 Remote Config [baseline] (645.244 µs) : 0, 645 Remote Config [candidate] (638.943 µs) : 0, 639 Telemetry [baseline] (8.835 ms) : 0, 8835 Telemetry [candidate] (9.44 ms) : 0, 9440 IAST [baseline] (21.244 ms) : 0, 21244 IAST [candidate] (20.036 ms) : 0, 20036 section iast BytebuddyAgent [baseline] (799.61 ms) : 0, 799610 BytebuddyAgent [candidate] (791.464 ms) : 0, 791464 GlobalTracer [baseline] (300.65 ms) : 0, 300650 GlobalTracer [candidate] (299.719 ms) : 0, 299719 AppSec [baseline] (54.582 ms) : 0, 54582 AppSec [candidate] (54.961 ms) : 0, 54961 Remote Config [baseline] (648.946 µs) : 0, 649 Remote Config [candidate] (605.582 µs) : 0, 606 Telemetry [baseline] (7.139 ms) : 0, 7139 Telemetry [candidate] (7.424 ms) : 0, 7424 IAST [baseline] (24.931 ms) : 0, 24931 IAST [candidate] (21.919 ms) : 0, 21919 section profiling BytebuddyAgent [baseline] (674.477 ms) : 0, 674477 BytebuddyAgent [candidate] (674.151 ms) : 0, 674151 GlobalTracer [baseline] (394.234 ms) : 0, 394234 GlobalTracer [candidate] (394.465 ms) : 0, 394465 AppSec [baseline] (54.8 ms) : 0, 54800 AppSec [candidate] (52.612 ms) : 0, 52612 Remote Config [baseline] (656.41 µs) : 0, 656 Remote Config [candidate] (720.862 µs) : 0, 721 Telemetry [baseline] (7.439 ms) : 0, 7439 Telemetry [candidate] (7.55 ms) : 0, 7550 ProfilingAgent [baseline] (96.459 ms) : 0, 96459 ProfilingAgent [candidate] (96.921 ms) : 0, 96921 Profiling [baseline] (96.483 ms) : 0, 96483 Profiling [candidate] (96.944 ms) : 0, 96944 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~546c0ccf5a, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section tracing Agent [baseline] (1.069 s) : 0, 1068632 Total [baseline] (8.548 s) : 0, 8547946 Agent [candidate] (1.074 s) : 0, 1073642 Total [candidate] (8.612 s) : 0, 8612494 section iast Agent [baseline] (1.204 s) : 0, 1203911 Total [baseline] (9.087 s) : 0, 9087428 Agent [candidate] (1.19 s) : 0, 1189987 Total [candidate] (9.009 s) : 0, 9008703 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.219 s) : 0, 1218607 Total [baseline] (9.032 s) : 0, 9031565 Agent [candidate] (1.204 s) : 0, 1204455 Total [candidate] (8.996 s) : 0, 8996106 section iast_TELEMETRY_OFF Agent [baseline] (1.19 s) : 0, 1189870 Total [baseline] (9.005 s) : 0, 9004965 Agent [candidate] (1.188 s) : 0, 1187739 Total [candidate] (8.998 s) : 0, 8997957 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.069 s |-| |Agent|iast|1.204 s |135.279 ms (12.7%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.219 s |149.975 ms (14.0%)| |Agent|iast_TELEMETRY_OFF|1.19 s |121.238 ms (11.3%)| |Total|tracing|8.548 s |-| |Total|iast|9.087 s |539.481 ms (6.3%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.032 s |483.619 ms (5.7%)| |Total|iast_TELEMETRY_OFF|9.005 s |457.019 ms (5.3%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.074 s |-| |Agent|iast|1.19 s |116.346 ms (10.8%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.204 s |130.813 ms (12.2%)| |Agent|iast_TELEMETRY_OFF|1.188 s |114.097 ms (10.6%)| |Total|tracing|8.612 s |-| |Total|iast|9.009 s |396.208 ms (4.6%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.996 s |383.612 ms (4.5%)| |Total|iast_TELEMETRY_OFF|8.998 s |385.462 ms (4.5%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~546c0ccf5a, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (681.451 ms) : 0, 681451 BytebuddyAgent [candidate] (685.782 ms) : 0, 685782 GlobalTracer [baseline] (310.807 ms) : 0, 310807 GlobalTracer [candidate] (313.096 ms) : 0, 313096 AppSec [baseline] (54.337 ms) : 0, 54337 AppSec [candidate] (52.465 ms) : 0, 52465 Remote Config [baseline] (669.117 µs) : 0, 669 Remote Config [candidate] (727.844 µs) : 0, 728 Telemetry [baseline] (7.675 ms) : 0, 7675 Telemetry [candidate] (7.656 ms) : 0, 7656 section iast BytebuddyAgent [baseline] (799.595 ms) : 0, 799595 BytebuddyAgent [candidate] (791.265 ms) : 0, 791265 GlobalTracer [baseline] (303.119 ms) : 0, 303119 GlobalTracer [candidate] (299.88 ms) : 0, 299880 AppSec [baseline] (55.527 ms) : 0, 55527 AppSec [candidate] (53.19 ms) : 0, 53190 IAST [baseline] (24.015 ms) : 0, 24015 IAST [candidate] (23.162 ms) : 0, 23162 Remote Config [baseline] (627.381 µs) : 0, 627 Remote Config [candidate] (599.887 µs) : 0, 600 Telemetry [baseline] (7.172 ms) : 0, 7172 Telemetry [candidate] (8.147 ms) : 0, 8147 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (811.865 ms) : 0, 811865 BytebuddyAgent [candidate] (801.335 ms) : 0, 801335 GlobalTracer [baseline] (305.232 ms) : 0, 305232 GlobalTracer [candidate] (303.337 ms) : 0, 303337 AppSec [baseline] (53.82 ms) : 0, 53820 AppSec [candidate] (53.019 ms) : 0, 53019 IAST [baseline] (25.773 ms) : 0, 25773 IAST [candidate] (23.961 ms) : 0, 23961 Remote Config [baseline] (659.246 µs) : 0, 659 Remote Config [candidate] (607.153 µs) : 0, 607 Telemetry [baseline] (7.187 ms) : 0, 7187 Telemetry [candidate] (8.245 ms) : 0, 8245 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (790.232 ms) : 0, 790232 BytebuddyAgent [candidate] (789.493 ms) : 0, 789493 GlobalTracer [baseline] (299.711 ms) : 0, 299711 GlobalTracer [candidate] (300.558 ms) : 0, 300558 AppSec [baseline] (54.388 ms) : 0, 54388 AppSec [candidate] (54.195 ms) : 0, 54195 IAST [baseline] (22.575 ms) : 0, 22575 IAST [candidate] (20.98 ms) : 0, 20980 Remote Config [baseline] (1.443 ms) : 0, 1443 Remote Config [candidate] (589.832 µs) : 0, 590 Telemetry [baseline] (7.747 ms) : 0, 7747 Telemetry [candidate] (8.069 ms) : 0, 8069 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-24T13:44:45 2024-09-24T13:51:36
git_branch master jpbempel/backport-7635
git_commit_date 1727166392 1727184597
git_commit_sha 0dcde7931e 546c0ccf5a
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~546c0ccf5a
start_time 2024-09-24T13:44:31 2024-09-24T13:51:22
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727186241 |1727186241 | |ci_job_id |649698765 |649698765 | |ci_pipeline_id|45010264 |45010264 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~546c0ccf5a, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section baseline no_agent (1.344 ms) : 1324, 1363 . : milestone, 1344, appsec (1.713 ms) : 1687, 1738 . : milestone, 1713, appsec_no_iast (1.726 ms) : 1701, 1750 . : milestone, 1726, iast (1.475 ms) : 1452, 1499 . : milestone, 1475, profiling (1.492 ms) : 1467, 1516 . : milestone, 1492, tracing (1.46 ms) : 1436, 1484 . : milestone, 1460, section candidate no_agent (1.342 ms) : 1323, 1362 . : milestone, 1342, appsec (1.724 ms) : 1699, 1748 . : milestone, 1724, appsec_no_iast (1.725 ms) : 1700, 1749 . : milestone, 1725, iast (1.481 ms) : 1459, 1503 . : milestone, 1481, profiling (1.48 ms) : 1457, 1503 . : milestone, 1480, tracing (1.475 ms) : 1451, 1500 . : milestone, 1475, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.344 ms [1.324 ms, 1.363 ms]|-| |appsec|1.713 ms [1.687 ms, 1.738 ms]|368.921 µs (27.5%)| |appsec_no_iast|1.726 ms [1.701 ms, 1.75 ms]|381.923 µs (28.4%)| |iast|1.475 ms [1.452 ms, 1.499 ms]|131.747 µs (9.8%)| |profiling|1.492 ms [1.467 ms, 1.516 ms]|147.874 µs (11.0%)| |tracing|1.46 ms [1.436 ms, 1.484 ms]|116.127 µs (8.6%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.342 ms [1.323 ms, 1.362 ms]|-| |appsec|1.724 ms [1.699 ms, 1.748 ms]|381.229 µs (28.4%)| |appsec_no_iast|1.725 ms [1.7 ms, 1.749 ms]|382.229 µs (28.5%)| |iast|1.481 ms [1.459 ms, 1.503 ms]|138.438 µs (10.3%)| |profiling|1.48 ms [1.457 ms, 1.503 ms]|137.755 µs (10.3%)| |tracing|1.475 ms [1.451 ms, 1.5 ms]|132.939 µs (9.9%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~546c0ccf5a, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section baseline no_agent (374.231 µs) : 355, 394 . : milestone, 374, iast (487.383 µs) : 466, 509 . : milestone, 487, iast_FULL (562.296 µs) : 541, 584 . : milestone, 562, iast_GLOBAL (512.027 µs) : 491, 534 . : milestone, 512, iast_HARDCODED_SECRET_DISABLED (490.264 µs) : 469, 511 . : milestone, 490, iast_INACTIVE (453.106 µs) : 433, 474 . : milestone, 453, iast_TELEMETRY_OFF (486.412 µs) : 463, 510 . : milestone, 486, tracing (445.233 µs) : 425, 466 . : milestone, 445, section candidate no_agent (375.262 µs) : 356, 395 . : milestone, 375, iast (488.616 µs) : 466, 511 . : milestone, 489, iast_FULL (555.213 µs) : 534, 577 . : milestone, 555, iast_GLOBAL (506.206 µs) : 485, 527 . : milestone, 506, iast_HARDCODED_SECRET_DISABLED (489.314 µs) : 467, 511 . : milestone, 489, iast_INACTIVE (451.727 µs) : 431, 473 . : milestone, 452, iast_TELEMETRY_OFF (477.874 µs) : 455, 500 . : milestone, 478, tracing (448.208 µs) : 428, 469 . : milestone, 448, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|374.231 µs [354.522 µs, 393.939 µs]|-| |iast|487.383 µs [465.613 µs, 509.152 µs]|113.152 µs (30.2%)| |iast_FULL|562.296 µs [540.996 µs, 583.595 µs]|188.065 µs (50.3%)| |iast_GLOBAL|512.027 µs [490.5 µs, 533.554 µs]|137.796 µs (36.8%)| |iast_HARDCODED_SECRET_DISABLED|490.264 µs [469.168 µs, 511.361 µs]|116.034 µs (31.0%)| |iast_INACTIVE|453.106 µs [432.614 µs, 473.599 µs]|78.876 µs (21.1%)| |iast_TELEMETRY_OFF|486.412 µs [463.206 µs, 509.619 µs]|112.182 µs (30.0%)| |tracing|445.233 µs [424.574 µs, 465.891 µs]|71.002 µs (19.0%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|375.262 µs [355.511 µs, 395.012 µs]|-| |iast|488.616 µs [465.788 µs, 511.443 µs]|113.354 µs (30.2%)| |iast_FULL|555.213 µs [533.874 µs, 576.553 µs]|179.952 µs (48.0%)| |iast_GLOBAL|506.206 µs [485.465 µs, 526.947 µs]|130.944 µs (34.9%)| |iast_HARDCODED_SECRET_DISABLED|489.314 µs [467.352 µs, 511.276 µs]|114.052 µs (30.4%)| |iast_INACTIVE|451.727 µs [430.7 µs, 472.754 µs]|76.465 µs (20.4%)| |iast_TELEMETRY_OFF|477.874 µs [455.468 µs, 500.28 µs]|102.612 µs (27.3%)| |tracing|448.208 µs [427.526 µs, 468.889 µs]|72.946 µs (19.4%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master jpbempel/backport-7635
git_commit_date 1727166392 1727184597
git_commit_sha 0dcde7931e 546c0ccf5a
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~546c0ccf5a
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1727186868 |1727186868 | |ci_job_id |649698766 |649698766 | |ci_pipeline_id|45010264 |45010264 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~546c0ccf5a, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section baseline no_agent (15.491 s) : 15491000, 15491000 . : milestone, 15491000, appsec (14.964 s) : 14964000, 14964000 . : milestone, 14964000, iast (18.79 s) : 18790000, 18790000 . : milestone, 18790000, iast_GLOBAL (17.918 s) : 17918000, 17918000 . : milestone, 17918000, profiling (15.4 s) : 15400000, 15400000 . : milestone, 15400000, tracing (14.965 s) : 14965000, 14965000 . : milestone, 14965000, section candidate no_agent (14.896 s) : 14896000, 14896000 . : milestone, 14896000, appsec (15.056 s) : 15056000, 15056000 . : milestone, 15056000, iast (18.857 s) : 18857000, 18857000 . : milestone, 18857000, iast_GLOBAL (18.058 s) : 18058000, 18058000 . : milestone, 18058000, profiling (15.298 s) : 15298000, 15298000 . : milestone, 15298000, tracing (15.077 s) : 15077000, 15077000 . : milestone, 15077000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.491 s [15.491 s, 15.491 s]|-| |appsec|14.964 s [14.964 s, 14.964 s]|-527.0 ms (-3.4%)| |iast|18.79 s [18.79 s, 18.79 s]|3.299 s (21.3%)| |iast_GLOBAL|17.918 s [17.918 s, 17.918 s]|2.427 s (15.7%)| |profiling|15.4 s [15.4 s, 15.4 s]|-91.0 ms (-0.6%)| |tracing|14.965 s [14.965 s, 14.965 s]|-526.0 ms (-3.4%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.896 s [14.896 s, 14.896 s]|-| |appsec|15.056 s [15.056 s, 15.056 s]|160.0 ms (1.1%)| |iast|18.857 s [18.857 s, 18.857 s]|3.961 s (26.6%)| |iast_GLOBAL|18.058 s [18.058 s, 18.058 s]|3.162 s (21.2%)| |profiling|15.298 s [15.298 s, 15.298 s]|402.0 ms (2.7%)| |tracing|15.077 s [15.077 s, 15.077 s]|181.0 ms (1.2%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~546c0ccf5a, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section baseline no_agent (1.471 ms) : 1460, 1483 . : milestone, 1471, appsec (2.329 ms) : 2288, 2370 . : milestone, 2329, iast (2.067 ms) : 2017, 2117 . : milestone, 2067, iast_GLOBAL (2.106 ms) : 2056, 2157 . : milestone, 2106, profiling (1.938 ms) : 1897, 1980 . : milestone, 1938, tracing (1.909 ms) : 1870, 1947 . : milestone, 1909, section candidate no_agent (1.466 ms) : 1454, 1477 . : milestone, 1466, appsec (2.306 ms) : 2265, 2347 . : milestone, 2306, iast (2.044 ms) : 1995, 2093 . : milestone, 2044, iast_GLOBAL (2.105 ms) : 2055, 2155 . : milestone, 2105, profiling (1.929 ms) : 1889, 1970 . : milestone, 1929, tracing (1.896 ms) : 1858, 1934 . : milestone, 1896, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.471 ms [1.46 ms, 1.483 ms]|-| |appsec|2.329 ms [2.288 ms, 2.37 ms]|857.676 µs (58.3%)| |iast|2.067 ms [2.017 ms, 2.117 ms]|595.676 µs (40.5%)| |iast_GLOBAL|2.106 ms [2.056 ms, 2.157 ms]|635.0 µs (43.2%)| |profiling|1.938 ms [1.897 ms, 1.98 ms]|467.097 µs (31.7%)| |tracing|1.909 ms [1.87 ms, 1.947 ms]|437.487 µs (29.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.466 ms [1.454 ms, 1.477 ms]|-| |appsec|2.306 ms [2.265 ms, 2.347 ms]|840.52 µs (57.4%)| |iast|2.044 ms [1.995 ms, 2.093 ms]|578.475 µs (39.5%)| |iast_GLOBAL|2.105 ms [2.055 ms, 2.155 ms]|639.321 µs (43.6%)| |profiling|1.929 ms [1.889 ms, 1.97 ms]|463.722 µs (31.6%)| |tracing|1.896 ms [1.858 ms, 1.934 ms]|430.483 µs (29.4%)|