search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
572 stars 284 forks source link

Smoke test for the Ebean ORM #7594

Open Mariovido opened 2 weeks ago

Mariovido commented 2 weeks ago

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: APPSEC-54675

pr-commenter[bot] commented 2 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/ebean_check
git_commit_date 1727691229 1727692661
git_commit_sha 70ac474684 e5d0c51427
release_version 1.40.0-SNAPSHOT~70ac474684 1.40.0-SNAPSHOT~e5d0c51427
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727700695 |1727700695 | |ci_job_id |655404546 |655404546 | |ci_pipeline_id|45403195 |45403195 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 52 metrics, 11 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section tracing Agent [baseline] (1.071 s) : 0, 1070969 Total [baseline] (10.431 s) : 0, 10431149 Agent [candidate] (1.068 s) : 0, 1068239 Total [candidate] (10.395 s) : 0, 10395251 section appsec Agent [baseline] (1.203 s) : 0, 1203260 Total [baseline] (10.593 s) : 0, 10592915 Agent [candidate] (1.206 s) : 0, 1205517 Total [candidate] (10.589 s) : 0, 10589118 section iast Agent [baseline] (1.197 s) : 0, 1197069 Total [baseline] (10.907 s) : 0, 10906798 Agent [candidate] (1.197 s) : 0, 1196608 Total [candidate] (10.859 s) : 0, 10858780 section profiling Agent [baseline] (1.264 s) : 0, 1264372 Total [baseline] (10.548 s) : 0, 10547842 Agent [candidate] (1.267 s) : 0, 1267499 Total [candidate] (10.613 s) : 0, 10612556 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.071 s |-| |Agent|appsec|1.203 s |132.291 ms (12.4%)| |Agent|iast|1.197 s |126.1 ms (11.8%)| |Agent|profiling|1.264 s |193.403 ms (18.1%)| |Total|tracing|10.431 s |-| |Total|appsec|10.593 s |161.765 ms (1.6%)| |Total|iast|10.907 s |475.648 ms (4.6%)| |Total|profiling|10.548 s |116.693 ms (1.1%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.068 s |-| |Agent|appsec|1.206 s |137.278 ms (12.9%)| |Agent|iast|1.197 s |128.369 ms (12.0%)| |Agent|profiling|1.267 s |199.26 ms (18.7%)| |Total|tracing|10.395 s |-| |Total|appsec|10.589 s |193.867 ms (1.9%)| |Total|iast|10.859 s |463.529 ms (4.5%)| |Total|profiling|10.613 s |217.305 ms (2.1%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (683.664 ms) : 0, 683664 BytebuddyAgent [candidate] (681.758 ms) : 0, 681758 GlobalTracer [baseline] (311.111 ms) : 0, 311111 GlobalTracer [candidate] (310.567 ms) : 0, 310567 AppSec [baseline] (54.131 ms) : 0, 54131 AppSec [candidate] (53.96 ms) : 0, 53960 Remote Config [baseline] (667.736 µs) : 0, 668 Remote Config [candidate] (659.414 µs) : 0, 659 Telemetry [baseline] (7.671 ms) : 0, 7671 Telemetry [candidate] (7.584 ms) : 0, 7584 section appsec BytebuddyAgent [baseline] (699.149 ms) : 0, 699149 BytebuddyAgent [candidate] (700.108 ms) : 0, 700108 GlobalTracer [baseline] (307.006 ms) : 0, 307006 GlobalTracer [candidate] (308.014 ms) : 0, 308014 AppSec [baseline] (163.091 ms) : 0, 163091 AppSec [candidate] (163.313 ms) : 0, 163313 Remote Config [baseline] (635.485 µs) : 0, 635 Remote Config [candidate] (636.763 µs) : 0, 637 Telemetry [baseline] (8.879 ms) : 0, 8879 Telemetry [candidate] (8.887 ms) : 0, 8887 IAST [baseline] (21.582 ms) : 0, 21582 IAST [candidate] (21.648 ms) : 0, 21648 section iast BytebuddyAgent [baseline] (797.315 ms) : 0, 797315 BytebuddyAgent [candidate] (795.938 ms) : 0, 795938 GlobalTracer [baseline] (300.089 ms) : 0, 300089 GlobalTracer [candidate] (300.105 ms) : 0, 300105 AppSec [baseline] (55.284 ms) : 0, 55284 AppSec [candidate] (54.204 ms) : 0, 54204 Remote Config [baseline] (640.153 µs) : 0, 640 Remote Config [candidate] (624.707 µs) : 0, 625 Telemetry [baseline] (7.048 ms) : 0, 7048 Telemetry [candidate] (7.107 ms) : 0, 7107 IAST [baseline] (22.928 ms) : 0, 22928 IAST [candidate] (24.887 ms) : 0, 24887 section profiling BytebuddyAgent [baseline] (674.198 ms) : 0, 674198 BytebuddyAgent [candidate] (675.468 ms) : 0, 675468 GlobalTracer [baseline] (392.344 ms) : 0, 392344 GlobalTracer [candidate] (393.508 ms) : 0, 393508 AppSec [baseline] (54.542 ms) : 0, 54542 AppSec [candidate] (54.727 ms) : 0, 54727 Remote Config [baseline] (646.845 µs) : 0, 647 Remote Config [candidate] (649.847 µs) : 0, 650 Telemetry [baseline] (7.441 ms) : 0, 7441 Telemetry [candidate] (7.484 ms) : 0, 7484 ProfilingAgent [baseline] (96.521 ms) : 0, 96521 ProfilingAgent [candidate] (96.954 ms) : 0, 96954 Profiling [baseline] (96.545 ms) : 0, 96545 Profiling [candidate] (96.977 ms) : 0, 96977 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section tracing Agent [baseline] (1.08 s) : 0, 1080409 Total [baseline] (8.62 s) : 0, 8619858 Agent [candidate] (1.067 s) : 0, 1067050 Total [candidate] (8.52 s) : 0, 8519602 section iast Agent [baseline] (1.191 s) : 0, 1191412 Total [baseline] (9.04 s) : 0, 9039748 Agent [candidate] (1.193 s) : 0, 1193198 Total [candidate] (9.062 s) : 0, 9062205 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.193 s) : 0, 1193276 Total [baseline] (9.092 s) : 0, 9091608 Agent [candidate] (1.197 s) : 0, 1196671 Total [candidate] (9.057 s) : 0, 9056738 section iast_TELEMETRY_OFF Agent [baseline] (1.199 s) : 0, 1199086 Total [baseline] (9.102 s) : 0, 9101950 Agent [candidate] (1.192 s) : 0, 1192402 Total [candidate] (9.09 s) : 0, 9090051 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.08 s |-| |Agent|iast|1.191 s |111.003 ms (10.3%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.193 s |112.867 ms (10.4%)| |Agent|iast_TELEMETRY_OFF|1.199 s |118.678 ms (11.0%)| |Total|tracing|8.62 s |-| |Total|iast|9.04 s |419.889 ms (4.9%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.092 s |471.749 ms (5.5%)| |Total|iast_TELEMETRY_OFF|9.102 s |482.091 ms (5.6%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.067 s |-| |Agent|iast|1.193 s |126.148 ms (11.8%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.197 s |129.621 ms (12.1%)| |Agent|iast_TELEMETRY_OFF|1.192 s |125.352 ms (11.7%)| |Total|tracing|8.52 s |-| |Total|iast|9.062 s |542.603 ms (6.4%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.057 s |537.136 ms (6.3%)| |Total|iast_TELEMETRY_OFF|9.09 s |570.449 ms (6.7%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (691.702 ms) : 0, 691702 BytebuddyAgent [candidate] (681.433 ms) : 0, 681433 GlobalTracer [baseline] (312.363 ms) : 0, 312363 GlobalTracer [candidate] (309.59 ms) : 0, 309590 AppSec [baseline] (54.059 ms) : 0, 54059 AppSec [candidate] (54.001 ms) : 0, 54001 Remote Config [baseline] (669.228 µs) : 0, 669 Remote Config [candidate] (655.766 µs) : 0, 656 Telemetry [baseline] (7.756 ms) : 0, 7756 Telemetry [candidate] (7.668 ms) : 0, 7668 section iast BytebuddyAgent [baseline] (793.509 ms) : 0, 793509 BytebuddyAgent [candidate] (794.373 ms) : 0, 794373 GlobalTracer [baseline] (298.386 ms) : 0, 298386 GlobalTracer [candidate] (299.301 ms) : 0, 299301 AppSec [baseline] (53.764 ms) : 0, 53764 AppSec [candidate] (54.569 ms) : 0, 54569 IAST [baseline] (24.478 ms) : 0, 24478 IAST [candidate] (23.601 ms) : 0, 23601 Remote Config [baseline] (619.55 µs) : 0, 620 Remote Config [candidate] (619.827 µs) : 0, 620 Telemetry [baseline] (6.99 ms) : 0, 6990 Telemetry [candidate] (6.989 ms) : 0, 6989 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (794.774 ms) : 0, 794774 BytebuddyAgent [candidate] (796.027 ms) : 0, 796027 GlobalTracer [baseline] (298.824 ms) : 0, 298824 GlobalTracer [candidate] (300.446 ms) : 0, 300446 AppSec [baseline] (54.525 ms) : 0, 54525 AppSec [candidate] (54.182 ms) : 0, 54182 IAST [baseline] (23.678 ms) : 0, 23678 IAST [candidate] (24.545 ms) : 0, 24545 Remote Config [baseline] (621.13 µs) : 0, 621 Remote Config [candidate] (605.465 µs) : 0, 605 Telemetry [baseline] (7.105 ms) : 0, 7105 Telemetry [candidate] (7.038 ms) : 0, 7038 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (797.906 ms) : 0, 797906 BytebuddyAgent [candidate] (792.897 ms) : 0, 792897 GlobalTracer [baseline] (301.352 ms) : 0, 301352 GlobalTracer [candidate] (299.922 ms) : 0, 299922 AppSec [baseline] (55.646 ms) : 0, 55646 AppSec [candidate] (54.225 ms) : 0, 54225 IAST [baseline] (22.675 ms) : 0, 22675 IAST [candidate] (24.081 ms) : 0, 24081 Remote Config [baseline] (618.612 µs) : 0, 619 Remote Config [candidate] (620.291 µs) : 0, 620 Telemetry [baseline] (6.999 ms) : 0, 6999 Telemetry [candidate] (6.876 ms) : 0, 6876 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-30T12:19:27 2024-09-30T12:26:20
git_branch master mario.vidal/ebean_check
git_commit_date 1727691229 1727692661
git_commit_sha 70ac474684 e5d0c51427
release_version 1.40.0-SNAPSHOT~70ac474684 1.40.0-SNAPSHOT~e5d0c51427
start_time 2024-09-30T12:19:14 2024-09-30T12:26:06
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727699528 |1727699528 | |ci_job_id |655404556 |655404556 | |ci_pipeline_id|45403195 |45403195 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section baseline no_agent (1.338 ms) : 1319, 1357 . : milestone, 1338, appsec (1.745 ms) : 1721, 1769 . : milestone, 1745, appsec_no_iast (1.736 ms) : 1713, 1760 . : milestone, 1736, iast (1.474 ms) : 1452, 1496 . : milestone, 1474, profiling (1.523 ms) : 1497, 1548 . : milestone, 1523, tracing (1.479 ms) : 1455, 1503 . : milestone, 1479, section candidate no_agent (1.342 ms) : 1322, 1361 . : milestone, 1342, appsec (1.726 ms) : 1702, 1750 . : milestone, 1726, appsec_no_iast (1.727 ms) : 1703, 1751 . : milestone, 1727, iast (1.486 ms) : 1464, 1508 . : milestone, 1486, profiling (1.561 ms) : 1535, 1587 . : milestone, 1561, tracing (1.47 ms) : 1445, 1494 . : milestone, 1470, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.338 ms [1.319 ms, 1.357 ms]|-| |appsec|1.745 ms [1.721 ms, 1.769 ms]|407.156 µs (30.4%)| |appsec_no_iast|1.736 ms [1.713 ms, 1.76 ms]|398.531 µs (29.8%)| |iast|1.474 ms [1.452 ms, 1.496 ms]|136.03 µs (10.2%)| |profiling|1.523 ms [1.497 ms, 1.548 ms]|184.941 µs (13.8%)| |tracing|1.479 ms [1.455 ms, 1.503 ms]|141.033 µs (10.5%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.342 ms [1.322 ms, 1.361 ms]|-| |appsec|1.726 ms [1.702 ms, 1.75 ms]|384.017 µs (28.6%)| |appsec_no_iast|1.727 ms [1.703 ms, 1.751 ms]|385.516 µs (28.7%)| |iast|1.486 ms [1.464 ms, 1.508 ms]|144.343 µs (10.8%)| |profiling|1.561 ms [1.535 ms, 1.587 ms]|219.545 µs (16.4%)| |tracing|1.47 ms [1.445 ms, 1.494 ms]|127.991 µs (9.5%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section baseline no_agent (372.623 µs) : 352, 393 . : milestone, 373, iast (490.693 µs) : 469, 513 . : milestone, 491, iast_FULL (551.073 µs) : 530, 572 . : milestone, 551, iast_GLOBAL (508.476 µs) : 487, 530 . : milestone, 508, iast_HARDCODED_SECRET_DISABLED (488.918 µs) : 468, 510 . : milestone, 489, iast_INACTIVE (450.39 µs) : 429, 472 . : milestone, 450, iast_TELEMETRY_OFF (480.052 µs) : 459, 501 . : milestone, 480, tracing (445.288 µs) : 424, 467 . : milestone, 445, section candidate no_agent (368.638 µs) : 349, 388 . : milestone, 369, iast (486.856 µs) : 465, 508 . : milestone, 487, iast_FULL (555.96 µs) : 535, 577 . : milestone, 556, iast_GLOBAL (514.569 µs) : 492, 537 . : milestone, 515, iast_HARDCODED_SECRET_DISABLED (484.405 µs) : 463, 505 . : milestone, 484, iast_INACTIVE (453.156 µs) : 432, 475 . : milestone, 453, iast_TELEMETRY_OFF (476.338 µs) : 455, 498 . : milestone, 476, tracing (442.876 µs) : 422, 464 . : milestone, 443, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|372.623 µs [351.881 µs, 393.365 µs]|-| |iast|490.693 µs [468.858 µs, 512.528 µs]|118.07 µs (31.7%)| |iast_FULL|551.073 µs [529.895 µs, 572.252 µs]|178.45 µs (47.9%)| |iast_GLOBAL|508.476 µs [487.306 µs, 529.647 µs]|135.853 µs (36.5%)| |iast_HARDCODED_SECRET_DISABLED|488.918 µs [467.548 µs, 510.289 µs]|116.295 µs (31.2%)| |iast_INACTIVE|450.39 µs [429.144 µs, 471.635 µs]|77.766 µs (20.9%)| |iast_TELEMETRY_OFF|480.052 µs [458.964 µs, 501.139 µs]|107.428 µs (28.8%)| |tracing|445.288 µs [424.029 µs, 466.546 µs]|72.665 µs (19.5%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|368.638 µs [348.783 µs, 388.493 µs]|-| |iast|486.856 µs [465.455 µs, 508.256 µs]|118.218 µs (32.1%)| |iast_FULL|555.96 µs [534.782 µs, 577.137 µs]|187.322 µs (50.8%)| |iast_GLOBAL|514.569 µs [492.066 µs, 537.073 µs]|145.932 µs (39.6%)| |iast_HARDCODED_SECRET_DISABLED|484.405 µs [463.374 µs, 505.437 µs]|115.767 µs (31.4%)| |iast_INACTIVE|453.156 µs [431.598 µs, 474.715 µs]|84.519 µs (22.9%)| |iast_TELEMETRY_OFF|476.338 µs [455.077 µs, 497.599 µs]|107.7 µs (29.2%)| |tracing|442.876 µs [422.24 µs, 463.511 µs]|74.238 µs (20.1%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/ebean_check
git_commit_date 1727691229 1727692661
git_commit_sha 70ac474684 e5d0c51427
release_version 1.40.0-SNAPSHOT~70ac474684 1.40.0-SNAPSHOT~e5d0c51427
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1727694849 |1727694849 | |ci_job_id |655309171 |655309171 | |ci_pipeline_id|45403195 |45403195 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section baseline no_agent (1.469 ms) : 1458, 1481 . : milestone, 1469, appsec (2.313 ms) : 2272, 2353 . : milestone, 2313, iast (2.082 ms) : 2030, 2134 . : milestone, 2082, iast_GLOBAL (2.108 ms) : 2056, 2159 . : milestone, 2108, profiling (1.946 ms) : 1904, 1987 . : milestone, 1946, tracing (1.91 ms) : 1871, 1949 . : milestone, 1910, section candidate no_agent (1.467 ms) : 1456, 1479 . : milestone, 1467, appsec (2.332 ms) : 2292, 2373 . : milestone, 2332, iast (2.072 ms) : 2020, 2123 . : milestone, 2072, iast_GLOBAL (2.118 ms) : 2066, 2169 . : milestone, 2118, profiling (1.942 ms) : 1901, 1983 . : milestone, 1942, tracing (1.909 ms) : 1871, 1948 . : milestone, 1909, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.469 ms [1.458 ms, 1.481 ms]|-| |appsec|2.313 ms [2.272 ms, 2.353 ms]|843.342 µs (57.4%)| |iast|2.082 ms [2.03 ms, 2.134 ms]|612.547 µs (41.7%)| |iast_GLOBAL|2.108 ms [2.056 ms, 2.159 ms]|638.14 µs (43.4%)| |profiling|1.946 ms [1.904 ms, 1.987 ms]|476.373 µs (32.4%)| |tracing|1.91 ms [1.871 ms, 1.949 ms]|440.38 µs (30.0%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.467 ms [1.456 ms, 1.479 ms]|-| |appsec|2.332 ms [2.292 ms, 2.373 ms]|865.315 µs (59.0%)| |iast|2.072 ms [2.02 ms, 2.123 ms]|604.666 µs (41.2%)| |iast_GLOBAL|2.118 ms [2.066 ms, 2.169 ms]|650.427 µs (44.3%)| |profiling|1.942 ms [1.901 ms, 1.983 ms]|475.28 µs (32.4%)| |tracing|1.909 ms [1.871 ms, 1.948 ms]|442.042 µs (30.1%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~e5d0c51427, baseline=1.40.0-SNAPSHOT~70ac474684 dateFormat X axisFormat %s section baseline no_agent (15.107 s) : 15107000, 15107000 . : milestone, 15107000, appsec (15.065 s) : 15065000, 15065000 . : milestone, 15065000, iast (18.804 s) : 18804000, 18804000 . : milestone, 18804000, iast_GLOBAL (18.09 s) : 18090000, 18090000 . : milestone, 18090000, profiling (15.205 s) : 15205000, 15205000 . : milestone, 15205000, tracing (15.416 s) : 15416000, 15416000 . : milestone, 15416000, section candidate no_agent (15.175 s) : 15175000, 15175000 . : milestone, 15175000, appsec (15.281 s) : 15281000, 15281000 . : milestone, 15281000, iast (18.79 s) : 18790000, 18790000 . : milestone, 18790000, iast_GLOBAL (17.885 s) : 17885000, 17885000 . : milestone, 17885000, profiling (15.959 s) : 15959000, 15959000 . : milestone, 15959000, tracing (15.631 s) : 15631000, 15631000 . : milestone, 15631000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.107 s [15.107 s, 15.107 s]|-| |appsec|15.065 s [15.065 s, 15.065 s]|-42.0 ms (-0.3%)| |iast|18.804 s [18.804 s, 18.804 s]|3.697 s (24.5%)| |iast_GLOBAL|18.09 s [18.09 s, 18.09 s]|2.983 s (19.7%)| |profiling|15.205 s [15.205 s, 15.205 s]|98.0 ms (0.6%)| |tracing|15.416 s [15.416 s, 15.416 s]|309.0 ms (2.0%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.175 s [15.175 s, 15.175 s]|-| |appsec|15.281 s [15.281 s, 15.281 s]|106.0 ms (0.7%)| |iast|18.79 s [18.79 s, 18.79 s]|3.615 s (23.8%)| |iast_GLOBAL|17.885 s [17.885 s, 17.885 s]|2.71 s (17.9%)| |profiling|15.959 s [15.959 s, 15.959 s]|784.0 ms (5.2%)| |tracing|15.631 s [15.631 s, 15.631 s]|456.0 ms (3.0%)|
pr-commenter[bot] commented 2 weeks ago

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/ebean_check
git_commit_date 1725526572 1726125387
git_commit_sha 7497a93de3ad13abb7be0efd9c27514a6d489c94 f5b5636947d402ad285293e7e7fc239931286cdc
See matching parameters | |Baseline |Candidate | |---------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |ci_job_date |1726126490 |1726126490 | |ci_job_id |636562320 |636562320 | |ci_pipeline_id|44149378 |44149378 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | |jdkVersion |11.0.21 |11.0.21 | |jmhVersion |1.36 |1.36 | |jvm |/usr/lib/jvm/java-11-openjdk-amd64/bin/java |/usr/lib/jvm/java-11-openjdk-amd64/bin/java | |jvmArgs |-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant|-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant| |vmName |OpenJDK 64-Bit Server VM |OpenJDK 64-Bit Server VM | |vmVersion |11.0.21+9-post-Ubuntu-0ubuntu122.04 |11.0.21+9-post-Ubuntu-0ubuntu122.04 |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results |scenario |Δ mean throughput| |--------------------------------------------------------------------------------|-----------------| |scenario:not-instrumented/KafkaProduceBenchmark.benchProduce |same | |scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce|same | |scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce |same |
pr-commenter[bot] commented 2 weeks ago

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mario.vidal/ebean_check
git_commit_date 1725526572 1726125387
git_commit_sha 7497a93de3ad13abb7be0efd9c27514a6d489c94 f5b5636947d402ad285293e7e7fc239931286cdc
See matching parameters | |Baseline |Candidate | |---------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |ci_job_date |1726126540 |1726126540 | |ci_job_id |636562321 |636562321 | |ci_pipeline_id|44149378 |44149378 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | |jdkVersion |11.0.21 |11.0.21 | |jmhVersion |1.36 |1.36 | |jvm |/usr/lib/jvm/java-11-openjdk-amd64/bin/java |/usr/lib/jvm/java-11-openjdk-amd64/bin/java | |jvmArgs |-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant|-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant| |vmName |OpenJDK 64-Bit Server VM |OpenJDK 64-Bit Server VM | |vmVersion |11.0.21+9-post-Ubuntu-0ubuntu122.04 |11.0.21+9-post-Ubuntu-0ubuntu122.04 |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results |scenario |Δ mean throughput| |---------------------------------------------------------------------------------|-----------------| |scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume |same | |scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume|same | |scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume |same |
github-actions[bot] commented 4 hours ago

Hi! 👋 Looks like you updated a Git Submodule. If this was not intentional please make sure to:

github-actions[bot] commented 3 hours ago

Hi! 👋 Looks like you updated a Git Submodule. If this was not intentional please make sure to:

github-actions[bot] commented 3 hours ago

Hi! 👋 Looks like you updated a Git Submodule. If this was not intentional please make sure to: