search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
572 stars 284 forks source link

Kafka-clients 3.8 support #7626

Open nayeem-kamal opened 2 weeks ago

nayeem-kamal commented 2 weeks ago

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 2 weeks ago

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/spring-kafka-fix
git_commit_date 1727189655 1727275310
git_commit_sha 043adb202c2809a558081ba8bd6d767e3ae61707 855401d49cea5f16c42932ad9c964154bfab590e
See matching parameters | |Baseline |Candidate | |---------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |ci_job_date |1727276490 |1727276490 | |ci_job_id |651370588 |651370588 | |ci_pipeline_id|45124595 |45124595 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | |jdkVersion |11.0.21 |11.0.21 | |jmhVersion |1.36 |1.36 | |jvm |/usr/lib/jvm/java-11-openjdk-amd64/bin/java |/usr/lib/jvm/java-11-openjdk-amd64/bin/java | |jvmArgs |-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant|-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant| |vmName |OpenJDK 64-Bit Server VM |OpenJDK 64-Bit Server VM | |vmVersion |11.0.21+9-post-Ubuntu-0ubuntu122.04 |11.0.21+9-post-Ubuntu-0ubuntu122.04 |

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 1 metrics, 0 unstable metrics.

scenario Δ mean throughput
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce worse
[-53590.335op/s; -48818.173op/s] or [-31.008%; -28.247%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce worse
[-39178.843op/s; -35674.587op/s] or [-32.898%; -29.955%]
See unchanged results |scenario |Δ mean throughput| |------------------------------------------------------------|-----------------| |scenario:not-instrumented/KafkaProduceBenchmark.benchProduce|same |
pr-commenter[bot] commented 2 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/spring-kafka-fix
git_commit_date 1727189655 1727275310
git_commit_sha 043adb202c 855401d49c
release_version 1.40.0-SNAPSHOT~043adb202c 1.40.0-SNAPSHOT~855401d49c
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727277732 |1727277732 | |ci_job_id |651370582 |651370582 | |ci_pipeline_id|45124595 |45124595 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~855401d49c, baseline=1.40.0-SNAPSHOT~043adb202c dateFormat X axisFormat %s section tracing Agent [baseline] (1.068 s) : 0, 1067863 Total [baseline] (8.581 s) : 0, 8581371 Agent [candidate] (1.068 s) : 0, 1067891 Total [candidate] (8.581 s) : 0, 8580748 section iast Agent [baseline] (1.189 s) : 0, 1188723 Total [baseline] (9.005 s) : 0, 9004990 Agent [candidate] (1.194 s) : 0, 1194246 Total [candidate] (9.031 s) : 0, 9031500 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.191 s) : 0, 1191454 Total [baseline] (9.008 s) : 0, 9007611 Agent [candidate] (1.195 s) : 0, 1194824 Total [candidate] (9.062 s) : 0, 9062214 section iast_TELEMETRY_OFF Agent [baseline] (1.188 s) : 0, 1188470 Total [baseline] (9.051 s) : 0, 9050591 Agent [candidate] (1.194 s) : 0, 1194081 Total [candidate] (9.035 s) : 0, 9034628 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.068 s |-| |Agent|iast|1.189 s |120.86 ms (11.3%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.191 s |123.591 ms (11.6%)| |Agent|iast_TELEMETRY_OFF|1.188 s |120.607 ms (11.3%)| |Total|tracing|8.581 s |-| |Total|iast|9.005 s |423.618 ms (4.9%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.008 s |426.24 ms (5.0%)| |Total|iast_TELEMETRY_OFF|9.051 s |469.219 ms (5.5%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.068 s |-| |Agent|iast|1.194 s |126.355 ms (11.8%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.195 s |126.934 ms (11.9%)| |Agent|iast_TELEMETRY_OFF|1.194 s |126.19 ms (11.8%)| |Total|tracing|8.581 s |-| |Total|iast|9.031 s |450.752 ms (5.3%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.062 s |481.465 ms (5.6%)| |Total|iast_TELEMETRY_OFF|9.035 s |453.88 ms (5.3%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~855401d49c, baseline=1.40.0-SNAPSHOT~043adb202c dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (680.978 ms) : 0, 680978 BytebuddyAgent [candidate] (681.299 ms) : 0, 681299 GlobalTracer [baseline] (311.001 ms) : 0, 311001 GlobalTracer [candidate] (310.831 ms) : 0, 310831 AppSec [baseline] (53.88 ms) : 0, 53880 AppSec [candidate] (53.848 ms) : 0, 53848 Remote Config [baseline] (660.437 µs) : 0, 660 Remote Config [candidate] (666.595 µs) : 0, 667 Telemetry [baseline] (7.634 ms) : 0, 7634 Telemetry [candidate] (7.546 ms) : 0, 7546 section iast BytebuddyAgent [baseline] (790.158 ms) : 0, 790158 BytebuddyAgent [candidate] (794.65 ms) : 0, 794650 GlobalTracer [baseline] (298.882 ms) : 0, 298882 GlobalTracer [candidate] (299.751 ms) : 0, 299751 AppSec [baseline] (56.482 ms) : 0, 56482 AppSec [candidate] (54.522 ms) : 0, 54522 IAST [baseline] (21.869 ms) : 0, 21869 IAST [candidate] (23.888 ms) : 0, 23888 Remote Config [baseline] (607.882 µs) : 0, 608 Remote Config [candidate] (608.048 µs) : 0, 608 Telemetry [baseline] (6.975 ms) : 0, 6975 Telemetry [candidate] (7.081 ms) : 0, 7081 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (792.397 ms) : 0, 792397 BytebuddyAgent [candidate] (794.273 ms) : 0, 794273 GlobalTracer [baseline] (299.734 ms) : 0, 299734 GlobalTracer [candidate] (300.729 ms) : 0, 300729 AppSec [baseline] (53.832 ms) : 0, 53832 AppSec [candidate] (52.362 ms) : 0, 52362 IAST [baseline] (23.932 ms) : 0, 23932 IAST [candidate] (25.034 ms) : 0, 25034 Remote Config [baseline] (645.405 µs) : 0, 645 Remote Config [candidate] (617.606 µs) : 0, 618 Telemetry [baseline] (7.123 ms) : 0, 7123 Telemetry [candidate] (7.996 ms) : 0, 7996 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (788.908 ms) : 0, 788908 BytebuddyAgent [candidate] (793.322 ms) : 0, 793322 GlobalTracer [baseline] (300.511 ms) : 0, 300511 GlobalTracer [candidate] (301.403 ms) : 0, 301403 AppSec [baseline] (55.095 ms) : 0, 55095 AppSec [candidate] (55.567 ms) : 0, 55567 IAST [baseline] (21.77 ms) : 0, 21770 IAST [candidate] (22.454 ms) : 0, 22454 Remote Config [baseline] (1.369 ms) : 0, 1369 Remote Config [candidate] (598.075 µs) : 0, 598 Telemetry [baseline] (7.033 ms) : 0, 7033 Telemetry [candidate] (6.896 ms) : 0, 6896 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~855401d49c, baseline=1.40.0-SNAPSHOT~043adb202c dateFormat X axisFormat %s section tracing Agent [baseline] (1.065 s) : 0, 1065030 Total [baseline] (10.477 s) : 0, 10476869 Agent [candidate] (1.075 s) : 0, 1074922 Total [candidate] (10.339 s) : 0, 10339471 section appsec Agent [baseline] (1.205 s) : 0, 1205012 Total [baseline] (10.66 s) : 0, 10659842 Agent [candidate] (1.214 s) : 0, 1213843 Total [candidate] (10.701 s) : 0, 10700906 section iast Agent [baseline] (1.192 s) : 0, 1191925 Total [baseline] (10.837 s) : 0, 10837123 Agent [candidate] (1.196 s) : 0, 1196054 Total [candidate] (10.812 s) : 0, 10812303 section profiling Agent [baseline] (1.27 s) : 0, 1270020 Total [baseline] (10.646 s) : 0, 10646119 Agent [candidate] (1.28 s) : 0, 1279881 Total [candidate] (10.642 s) : 0, 10642456 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.065 s |-| |Agent|appsec|1.205 s |139.983 ms (13.1%)| |Agent|iast|1.192 s |126.896 ms (11.9%)| |Agent|profiling|1.27 s |204.99 ms (19.2%)| |Total|tracing|10.477 s |-| |Total|appsec|10.66 s |182.973 ms (1.7%)| |Total|iast|10.837 s |360.254 ms (3.4%)| |Total|profiling|10.646 s |169.251 ms (1.6%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.075 s |-| |Agent|appsec|1.214 s |138.921 ms (12.9%)| |Agent|iast|1.196 s |121.132 ms (11.3%)| |Agent|profiling|1.28 s |204.959 ms (19.1%)| |Total|tracing|10.339 s |-| |Total|appsec|10.701 s |361.435 ms (3.5%)| |Total|iast|10.812 s |472.832 ms (4.6%)| |Total|profiling|10.642 s |302.985 ms (2.9%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~855401d49c, baseline=1.40.0-SNAPSHOT~043adb202c dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (678.768 ms) : 0, 678768 BytebuddyAgent [candidate] (685.811 ms) : 0, 685811 GlobalTracer [baseline] (310.396 ms) : 0, 310396 GlobalTracer [candidate] (312.792 ms) : 0, 312792 AppSec [baseline] (53.831 ms) : 0, 53831 AppSec [candidate] (54.26 ms) : 0, 54260 Remote Config [baseline] (668.932 µs) : 0, 669 Remote Config [candidate] (679.011 µs) : 0, 679 Telemetry [baseline] (7.712 ms) : 0, 7712 Telemetry [candidate] (7.587 ms) : 0, 7587 section appsec BytebuddyAgent [baseline] (703.922 ms) : 0, 703922 BytebuddyAgent [candidate] (710.433 ms) : 0, 710433 GlobalTracer [baseline] (304.929 ms) : 0, 304929 GlobalTracer [candidate] (306.047 ms) : 0, 306047 AppSec [baseline] (162.973 ms) : 0, 162973 AppSec [candidate] (163.109 ms) : 0, 163109 Remote Config [baseline] (638.338 µs) : 0, 638 Remote Config [candidate] (655.385 µs) : 0, 655 Telemetry [baseline] (8.88 ms) : 0, 8880 Telemetry [candidate] (9.253 ms) : 0, 9253 IAST [baseline] (19.83 ms) : 0, 19830 IAST [candidate] (20.99 ms) : 0, 20990 section iast BytebuddyAgent [baseline] (792.863 ms) : 0, 792863 BytebuddyAgent [candidate] (795.625 ms) : 0, 795625 GlobalTracer [baseline] (299.797 ms) : 0, 299797 GlobalTracer [candidate] (300.7 ms) : 0, 300700 AppSec [baseline] (54.386 ms) : 0, 54386 AppSec [candidate] (55.696 ms) : 0, 55696 Remote Config [baseline] (589.235 µs) : 0, 589 Remote Config [candidate] (589.468 µs) : 0, 589 Telemetry [baseline] (6.972 ms) : 0, 6972 Telemetry [candidate] (6.976 ms) : 0, 6976 IAST [baseline] (23.585 ms) : 0, 23585 IAST [candidate] (22.69 ms) : 0, 22690 section profiling ProfilingAgent [baseline] (96.767 ms) : 0, 96767 ProfilingAgent [candidate] (97.763 ms) : 0, 97763 BytebuddyAgent [baseline] (675.35 ms) : 0, 675350 BytebuddyAgent [candidate] (681.393 ms) : 0, 681393 GlobalTracer [baseline] (396.322 ms) : 0, 396322 GlobalTracer [candidate] (398.449 ms) : 0, 398449 AppSec [baseline] (54.588 ms) : 0, 54588 AppSec [candidate] (54.948 ms) : 0, 54948 Remote Config [baseline] (643.491 µs) : 0, 643 Remote Config [candidate] (659.243 µs) : 0, 659 Telemetry [baseline] (7.511 ms) : 0, 7511 Telemetry [candidate] (7.573 ms) : 0, 7573 Profiling [baseline] (96.79 ms) : 0, 96790 Profiling [candidate] (97.787 ms) : 0, 97787 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-25T14:54:48 2024-09-25T15:01:40
git_branch master nayeem-kamal/spring-kafka-fix
git_commit_date 1727189655 1727275310
git_commit_sha 043adb202c 855401d49c
release_version 1.40.0-SNAPSHOT~043adb202c 1.40.0-SNAPSHOT~855401d49c
start_time 2024-09-25T14:54:35 2024-09-25T15:01:27
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727276847 |1727276847 | |ci_job_id |651370583 |651370583 | |ci_pipeline_id|45124595 |45124595 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~855401d49c, baseline=1.40.0-SNAPSHOT~043adb202c dateFormat X axisFormat %s section baseline no_agent (376.29 µs) : 355, 397 . : milestone, 376, iast (483.887 µs) : 462, 505 . : milestone, 484, iast_FULL (551.662 µs) : 531, 573 . : milestone, 552, iast_GLOBAL (517.519 µs) : 496, 540 . : milestone, 518, iast_HARDCODED_SECRET_DISABLED (492.019 µs) : 471, 513 . : milestone, 492, iast_INACTIVE (446.863 µs) : 426, 468 . : milestone, 447, iast_TELEMETRY_OFF (477.14 µs) : 454, 500 . : milestone, 477, tracing (443.884 µs) : 423, 465 . : milestone, 444, section candidate no_agent (373.451 µs) : 354, 393 . : milestone, 373, iast (488.917 µs) : 467, 511 . : milestone, 489, iast_FULL (556.856 µs) : 536, 578 . : milestone, 557, iast_GLOBAL (513.96 µs) : 491, 536 . : milestone, 514, iast_HARDCODED_SECRET_DISABLED (482.124 µs) : 461, 503 . : milestone, 482, iast_INACTIVE (449.961 µs) : 429, 471 . : milestone, 450, iast_TELEMETRY_OFF (477.682 µs) : 455, 500 . : milestone, 478, tracing (457.091 µs) : 435, 479 . : milestone, 457, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|376.29 µs [355.341 µs, 397.24 µs]|-| |iast|483.887 µs [462.492 µs, 505.283 µs]|107.597 µs (28.6%)| |iast_FULL|551.662 µs [530.753 µs, 572.571 µs]|175.372 µs (46.6%)| |iast_GLOBAL|517.519 µs [495.52 µs, 539.518 µs]|141.229 µs (37.5%)| |iast_HARDCODED_SECRET_DISABLED|492.019 µs [471.007 µs, 513.03 µs]|115.729 µs (30.8%)| |iast_INACTIVE|446.863 µs [426.155 µs, 467.571 µs]|70.573 µs (18.8%)| |iast_TELEMETRY_OFF|477.14 µs [454.441 µs, 499.84 µs]|100.85 µs (26.8%)| |tracing|443.884 µs [423.262 µs, 464.505 µs]|67.593 µs (18.0%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|373.451 µs [354.118 µs, 392.784 µs]|-| |iast|488.917 µs [467.273 µs, 510.562 µs]|115.466 µs (30.9%)| |iast_FULL|556.856 µs [535.7 µs, 578.012 µs]|183.405 µs (49.1%)| |iast_GLOBAL|513.96 µs [491.457 µs, 536.464 µs]|140.509 µs (37.6%)| |iast_HARDCODED_SECRET_DISABLED|482.124 µs [460.963 µs, 503.285 µs]|108.673 µs (29.1%)| |iast_INACTIVE|449.961 µs [428.628 µs, 471.295 µs]|76.51 µs (20.5%)| |iast_TELEMETRY_OFF|477.682 µs [455.111 µs, 500.253 µs]|104.231 µs (27.9%)| |tracing|457.091 µs [434.873 µs, 479.308 µs]|83.64 µs (22.4%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~855401d49c, baseline=1.40.0-SNAPSHOT~043adb202c dateFormat X axisFormat %s section baseline no_agent (1.328 ms) : 1309, 1348 . : milestone, 1328, appsec (1.724 ms) : 1701, 1748 . : milestone, 1724, appsec_no_iast (1.725 ms) : 1701, 1749 . : milestone, 1725, iast (1.466 ms) : 1443, 1488 . : milestone, 1466, profiling (1.533 ms) : 1507, 1558 . : milestone, 1533, tracing (1.464 ms) : 1440, 1487 . : milestone, 1464, section candidate no_agent (1.339 ms) : 1319, 1358 . : milestone, 1339, appsec (1.739 ms) : 1715, 1762 . : milestone, 1739, appsec_no_iast (1.732 ms) : 1708, 1755 . : milestone, 1732, iast (1.481 ms) : 1458, 1503 . : milestone, 1481, profiling (1.48 ms) : 1456, 1505 . : milestone, 1480, tracing (1.466 ms) : 1442, 1490 . : milestone, 1466, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.328 ms [1.309 ms, 1.348 ms]|-| |appsec|1.724 ms [1.701 ms, 1.748 ms]|395.699 µs (29.8%)| |appsec_no_iast|1.725 ms [1.701 ms, 1.749 ms]|396.317 µs (29.8%)| |iast|1.466 ms [1.443 ms, 1.488 ms]|137.242 µs (10.3%)| |profiling|1.533 ms [1.507 ms, 1.558 ms]|204.099 µs (15.4%)| |tracing|1.464 ms [1.44 ms, 1.487 ms]|135.048 µs (10.2%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.339 ms [1.319 ms, 1.358 ms]|-| |appsec|1.739 ms [1.715 ms, 1.762 ms]|400.053 µs (29.9%)| |appsec_no_iast|1.732 ms [1.708 ms, 1.755 ms]|392.965 µs (29.4%)| |iast|1.481 ms [1.458 ms, 1.503 ms]|141.975 µs (10.6%)| |profiling|1.48 ms [1.456 ms, 1.505 ms]|141.609 µs (10.6%)| |tracing|1.466 ms [1.442 ms, 1.49 ms]|127.372 µs (9.5%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/spring-kafka-fix
git_commit_date 1727189655 1727275310
git_commit_sha 043adb202c 855401d49c
release_version 1.40.0-SNAPSHOT~043adb202c 1.40.0-SNAPSHOT~855401d49c
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1727277381 |1727277381 | |ci_job_id |651370585 |651370585 | |ci_pipeline_id|45124595 |45124595 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~855401d49c, baseline=1.40.0-SNAPSHOT~043adb202c dateFormat X axisFormat %s section baseline no_agent (1.463 ms) : 1451, 1474 . : milestone, 1463, appsec (2.328 ms) : 2287, 2369 . : milestone, 2328, iast (2.051 ms) : 2000, 2102 . : milestone, 2051, iast_GLOBAL (2.102 ms) : 2051, 2153 . : milestone, 2102, profiling (1.934 ms) : 1892, 1976 . : milestone, 1934, tracing (1.908 ms) : 1869, 1946 . : milestone, 1908, section candidate no_agent (1.464 ms) : 1453, 1476 . : milestone, 1464, appsec (2.323 ms) : 2282, 2364 . : milestone, 2323, iast (2.054 ms) : 2004, 2105 . : milestone, 2054, iast_GLOBAL (2.11 ms) : 2058, 2161 . : milestone, 2110, profiling (1.938 ms) : 1896, 1980 . : milestone, 1938, tracing (1.9 ms) : 1861, 1938 . : milestone, 1900, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.463 ms [1.451 ms, 1.474 ms]|-| |appsec|2.328 ms [2.287 ms, 2.369 ms]|865.458 µs (59.2%)| |iast|2.051 ms [2.0 ms, 2.102 ms]|587.862 µs (40.2%)| |iast_GLOBAL|2.102 ms [2.051 ms, 2.153 ms]|639.102 µs (43.7%)| |profiling|1.934 ms [1.892 ms, 1.976 ms]|471.192 µs (32.2%)| |tracing|1.908 ms [1.869 ms, 1.946 ms]|445.019 µs (30.4%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.464 ms [1.453 ms, 1.476 ms]|-| |appsec|2.323 ms [2.282 ms, 2.364 ms]|858.554 µs (58.6%)| |iast|2.054 ms [2.004 ms, 2.105 ms]|589.869 µs (40.3%)| |iast_GLOBAL|2.11 ms [2.058 ms, 2.161 ms]|645.198 µs (44.1%)| |profiling|1.938 ms [1.896 ms, 1.98 ms]|473.553 µs (32.3%)| |tracing|1.9 ms [1.861 ms, 1.938 ms]|435.22 µs (29.7%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~855401d49c, baseline=1.40.0-SNAPSHOT~043adb202c dateFormat X axisFormat %s section baseline no_agent (15.193 s) : 15193000, 15193000 . : milestone, 15193000, appsec (15.201 s) : 15201000, 15201000 . : milestone, 15201000, iast (18.917 s) : 18917000, 18917000 . : milestone, 18917000, iast_GLOBAL (18.07 s) : 18070000, 18070000 . : milestone, 18070000, profiling (15.776 s) : 15776000, 15776000 . : milestone, 15776000, tracing (15.053 s) : 15053000, 15053000 . : milestone, 15053000, section candidate no_agent (15.039 s) : 15039000, 15039000 . : milestone, 15039000, appsec (15.023 s) : 15023000, 15023000 . : milestone, 15023000, iast (18.85 s) : 18850000, 18850000 . : milestone, 18850000, iast_GLOBAL (18.109 s) : 18109000, 18109000 . : milestone, 18109000, profiling (15.184 s) : 15184000, 15184000 . : milestone, 15184000, tracing (15.229 s) : 15229000, 15229000 . : milestone, 15229000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.193 s [15.193 s, 15.193 s]|-| |appsec|15.201 s [15.201 s, 15.201 s]|8.0 ms (0.1%)| |iast|18.917 s [18.917 s, 18.917 s]|3.724 s (24.5%)| |iast_GLOBAL|18.07 s [18.07 s, 18.07 s]|2.877 s (18.9%)| |profiling|15.776 s [15.776 s, 15.776 s]|583.0 ms (3.8%)| |tracing|15.053 s [15.053 s, 15.053 s]|-140.0 ms (-0.9%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.039 s [15.039 s, 15.039 s]|-| |appsec|15.023 s [15.023 s, 15.023 s]|-16.0 ms (-0.1%)| |iast|18.85 s [18.85 s, 18.85 s]|3.811 s (25.3%)| |iast_GLOBAL|18.109 s [18.109 s, 18.109 s]|3.07 s (20.4%)| |profiling|15.184 s [15.184 s, 15.184 s]|145.0 ms (1.0%)| |tracing|15.229 s [15.229 s, 15.229 s]|190.0 ms (1.3%)|
pr-commenter[bot] commented 2 weeks ago

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/spring-kafka-fix
git_commit_date 1727189655 1727275310
git_commit_sha 043adb202c2809a558081ba8bd6d767e3ae61707 855401d49cea5f16c42932ad9c964154bfab590e
See matching parameters | |Baseline |Candidate | |---------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |ci_job_date |1727276515 |1727276515 | |ci_job_id |651370589 |651370589 | |ci_pipeline_id|45124595 |45124595 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | |jdkVersion |11.0.21 |11.0.21 | |jmhVersion |1.36 |1.36 | |jvm |/usr/lib/jvm/java-11-openjdk-amd64/bin/java |/usr/lib/jvm/java-11-openjdk-amd64/bin/java | |jvmArgs |-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant|-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant| |vmName |OpenJDK 64-Bit Server VM |OpenJDK 64-Bit Server VM | |vmVersion |11.0.21+9-post-Ubuntu-0ubuntu122.04 |11.0.21+9-post-Ubuntu-0ubuntu122.04 |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results |scenario |Δ mean throughput| |---------------------------------------------------------------------------------|-----------------| |scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume |same | |scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume|same | |scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume |same |