search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

TEST spring kafka fix singledir #7649

Closed nayeem-kamal closed 3 weeks ago

nayeem-kamal commented 1 month ago

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 1 month ago

Kafka / producer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/spring-kafka-fix-singledir
git_commit_date 1725466409 1726753039
git_commit_sha 235737f59b9514593fd1400d9f2fc393776b856e 6a59de1f209ed1cee750c82f1cc96adac2559e2f
See matching parameters | |Baseline |Candidate | |---------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |ci_job_date |1726774846 |1726774846 | |ci_job_id |645627889 |645627889 | |ci_pipeline_id|44739544 |44739544 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | |jdkVersion |11.0.21 |11.0.21 | |jmhVersion |1.36 |1.36 | |jvm |/usr/lib/jvm/java-11-openjdk-amd64/bin/java |/usr/lib/jvm/java-11-openjdk-amd64/bin/java | |jvmArgs |-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant|-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/producer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant| |vmName |OpenJDK 64-Bit Server VM |OpenJDK 64-Bit Server VM | |vmVersion |11.0.21+9-post-Ubuntu-0ubuntu122.04 |11.0.21+9-post-Ubuntu-0ubuntu122.04 |

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 1 metrics, 0 unstable metrics.

scenario Δ mean throughput
scenario:only-tracing-dsm-disabled-benchmarks/KafkaProduceBenchmark.benchProduce worse
[-57217.838op/s; -52375.277op/s] or [-32.798%; -30.022%]
scenario:only-tracing-dsm-enabled-benchmarks/KafkaProduceBenchmark.benchProduce worse
[-42486.754op/s; -37605.673op/s] or [-35.098%; -31.066%]
See unchanged results |scenario |Δ mean throughput| |------------------------------------------------------------|-----------------| |scenario:not-instrumented/KafkaProduceBenchmark.benchProduce|same |
pr-commenter[bot] commented 1 month ago

Kafka / consumer-benchmark

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/spring-kafka-fix-singledir
git_commit_date 1725466409 1726753039
git_commit_sha 235737f59b9514593fd1400d9f2fc393776b856e 6a59de1f209ed1cee750c82f1cc96adac2559e2f
See matching parameters | |Baseline |Candidate | |---------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------| |ci_job_date |1726774885 |1726774885 | |ci_job_id |645627890 |645627890 | |ci_pipeline_id|44739544 |44739544 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz | |jdkVersion |11.0.21 |11.0.21 | |jmhVersion |1.36 |1.36 | |jvm |/usr/lib/jvm/java-11-openjdk-amd64/bin/java |/usr/lib/jvm/java-11-openjdk-amd64/bin/java | |jvmArgs |-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant|-Dfile.encoding=UTF-8 -Djava.io.tmpdir=/go/src/github.com/DataDog/apm-reliability/dd-trace-java/platform/src/consumer-benchmark/build/tmp/jmh -Duser.country=US -Duser.language=en -Duser.variant| |vmName |OpenJDK 64-Bit Server VM |OpenJDK 64-Bit Server VM | |vmVersion |11.0.21+9-post-Ubuntu-0ubuntu122.04 |11.0.21+9-post-Ubuntu-0ubuntu122.04 |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 3 metrics, 0 unstable metrics.

See unchanged results |scenario |Δ mean throughput | |---------------------------------------------------------------------------------|---------------------------------------------------------------------| |scenario:not-instrumented/KafkaConsumerBenchmark.benchConsume |same | |scenario:only-tracing-dsm-disabled-benchmarks/KafkaConsumerBenchmark.benchConsume|unsure
[+1028.916op/s; +8223.513op/s] or [+0.333%; +2.660%]| |scenario:only-tracing-dsm-enabled-benchmarks/KafkaConsumerBenchmark.benchConsume |same |
pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/spring-kafka-fix-singledir
git_commit_date 1726749615 1726753039
git_commit_sha b4718bd887 6a59de1f20
release_version 1.40.0-SNAPSHOT~b4718bd887 1.40.0-SNAPSHOT~6a59de1f20
See matching parameters | |Baseline |Candidate | |---------------------|---------------------------------------------|---------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726776964 |1726776964 | |ci_job_id |645627885 |645627885 | |ci_pipeline_id|44739544 |44739544 | |cpu_model |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 4 performance improvements and 2 performance regressions! Performance is the same for 45 metrics, 12 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:tracing:AppSec better
[-3.445ms; -1.745ms] or [-4.553%; -2.306%]		 73.069ms 75.664ms
scenario:startup:insecure-bank:tracing:Telemetry better
[-594.468µs; -235.512µs] or [-5.939%; -2.353%]		 9.594ms 10.009ms
scenario:startup:petclinic:profiling:AppSec better
[-3.887ms; -2.367ms] or [-5.068%; -3.086%]		 73.565ms 76.692ms
scenario:startup:petclinic:profiling:Remote Config worse
[+35.349µs; +94.064µs] or [+4.286%; +11.406%]		 889.436µs 824.729µs
scenario:startup:petclinic:tracing:AppSec better
[-2.663ms; -1.595ms] or [-3.526%; -2.112%]		 73.408ms 75.538ms
scenario:startup:petclinic:tracing:Remote Config worse
[+31.002µs; +54.451µs] or [+3.792%; +6.660%]		 860.351µs 817.625µs
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~6a59de1f20, baseline=1.40.0-SNAPSHOT~b4718bd887 dateFormat X axisFormat %s section tracing Agent [baseline] (1.577 s) : 0, 1576722 Total [baseline] (11.866 s) : 0, 11865987 Agent [candidate] (1.574 s) : 0, 1573758 Total [candidate] (11.886 s) : 0, 11886182 section iast Agent [baseline] (1.736 s) : 0, 1736244 Total [baseline] (12.525 s) : 0, 12525195 Agent [candidate] (1.74 s) : 0, 1739598 Total [candidate] (12.579 s) : 0, 12579188 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.743 s) : 0, 1742774 Total [baseline] (12.519 s) : 0, 12518699 Agent [candidate] (1.741 s) : 0, 1740777 Total [candidate] (12.562 s) : 0, 12562122 section iast_TELEMETRY_OFF Agent [baseline] (1.73 s) : 0, 1729661 Total [baseline] (12.482 s) : 0, 12481734 Agent [candidate] (1.735 s) : 0, 1734783 Total [candidate] (12.553 s) : 0, 12553351 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.577 s |-| |Agent|iast|1.736 s |159.522 ms (10.1%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.743 s |166.052 ms (10.5%)| |Agent|iast_TELEMETRY_OFF|1.73 s |152.939 ms (9.7%)| |Total|tracing|11.866 s |-| |Total|iast|12.525 s |659.208 ms (5.6%)| |Total|iast_HARDCODED_SECRET_DISABLED|12.519 s |652.713 ms (5.5%)| |Total|iast_TELEMETRY_OFF|12.482 s |615.747 ms (5.2%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.574 s |-| |Agent|iast|1.74 s |165.84 ms (10.5%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.741 s |167.019 ms (10.6%)| |Agent|iast_TELEMETRY_OFF|1.735 s |161.025 ms (10.2%)| |Total|tracing|11.886 s |-| |Total|iast|12.579 s |693.006 ms (5.8%)| |Total|iast_HARDCODED_SECRET_DISABLED|12.562 s |675.94 ms (5.7%)| |Total|iast_TELEMETRY_OFF|12.553 s |667.169 ms (5.6%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~6a59de1f20, baseline=1.40.0-SNAPSHOT~b4718bd887 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (1.01 s) : 0, 1009690 BytebuddyAgent [candidate] (1.009 s) : 0, 1008925 GlobalTracer [baseline] (460.121 ms) : 0, 460121 GlobalTracer [candidate] (460.906 ms) : 0, 460906 AppSec [baseline] (75.664 ms) : 0, 75664 AppSec [candidate] (73.069 ms) : 0, 73069 Remote Config [baseline] (829.724 µs) : 0, 830 Remote Config [candidate] (860.47 µs) : 0, 860 Telemetry [baseline] (10.009 ms) : 0, 10009 Telemetry [candidate] (9.594 ms) : 0, 9594 section iast BytebuddyAgent [baseline] (1.162 s) : 0, 1162123 BytebuddyAgent [candidate] (1.167 s) : 0, 1167177 GlobalTracer [baseline] (437.911 ms) : 0, 437911 GlobalTracer [candidate] (439.051 ms) : 0, 439051 AppSec [baseline] (72.982 ms) : 0, 72982 AppSec [candidate] (71.227 ms) : 0, 71227 IAST [baseline] (32.758 ms) : 0, 32758 IAST [candidate] (31.338 ms) : 0, 31338 Remote Config [baseline] (788.094 µs) : 0, 788 Remote Config [candidate] (835.66 µs) : 0, 836 Telemetry [baseline] (9.363 ms) : 0, 9363 Telemetry [candidate] (9.497 ms) : 0, 9497 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (1.167 s) : 0, 1167452 BytebuddyAgent [candidate] (1.166 s) : 0, 1165942 GlobalTracer [baseline] (439.482 ms) : 0, 439482 GlobalTracer [candidate] (439.438 ms) : 0, 439438 AppSec [baseline] (74.136 ms) : 0, 74136 AppSec [candidate] (73.731 ms) : 0, 73731 IAST [baseline] (30.951 ms) : 0, 30951 IAST [candidate] (30.614 ms) : 0, 30614 Remote Config [baseline] (849.564 µs) : 0, 850 Remote Config [candidate] (884.486 µs) : 0, 884 Telemetry [baseline] (9.537 ms) : 0, 9537 Telemetry [candidate] (9.704 ms) : 0, 9704 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (1.157 s) : 0, 1156936 BytebuddyAgent [candidate] (1.163 s) : 0, 1163229 GlobalTracer [baseline] (437.872 ms) : 0, 437872 GlobalTracer [candidate] (439.071 ms) : 0, 439071 AppSec [baseline] (73.946 ms) : 0, 73946 AppSec [candidate] (70.683 ms) : 0, 70683 IAST [baseline] (29.678 ms) : 0, 29678 IAST [candidate] (29.322 ms) : 0, 29322 Remote Config [baseline] (1.577 ms) : 0, 1577 Remote Config [candidate] (789.25 µs) : 0, 789 Telemetry [baseline] (9.355 ms) : 0, 9355 Telemetry [candidate] (11.214 ms) : 0, 11214 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~6a59de1f20, baseline=1.40.0-SNAPSHOT~b4718bd887 dateFormat X axisFormat %s section tracing Agent [baseline] (1.571 s) : 0, 1570783 Total [baseline] (14.305 s) : 0, 14304765 Agent [candidate] (1.574 s) : 0, 1573504 Total [candidate] (14.374 s) : 0, 14374487 section appsec Agent [baseline] (1.774 s) : 0, 1773716 Total [baseline] (14.673 s) : 0, 14673301 Agent [candidate] (1.77 s) : 0, 1770216 Total [candidate] (14.649 s) : 0, 14648558 section iast Agent [baseline] (1.748 s) : 0, 1748247 Total [baseline] (14.863 s) : 0, 14862612 Agent [candidate] (1.736 s) : 0, 1735953 Total [candidate] (14.942 s) : 0, 14942406 section profiling Agent [baseline] (1.899 s) : 0, 1898750 Total [baseline] (14.631 s) : 0, 14631136 Agent [candidate] (1.89 s) : 0, 1889848 Total [candidate] (14.517 s) : 0, 14516741 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.571 s |-| |Agent|appsec|1.774 s |202.933 ms (12.9%)| |Agent|iast|1.748 s |177.463 ms (11.3%)| |Agent|profiling|1.899 s |327.967 ms (20.9%)| |Total|tracing|14.305 s |-| |Total|appsec|14.673 s |368.536 ms (2.6%)| |Total|iast|14.863 s |557.847 ms (3.9%)| |Total|profiling|14.631 s |326.372 ms (2.3%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.574 s |-| |Agent|appsec|1.77 s |196.712 ms (12.5%)| |Agent|iast|1.736 s |162.448 ms (10.3%)| |Agent|profiling|1.89 s |316.344 ms (20.1%)| |Total|tracing|14.374 s |-| |Total|appsec|14.649 s |274.071 ms (1.9%)| |Total|iast|14.942 s |567.919 ms (4.0%)| |Total|profiling|14.517 s |142.254 ms (1.0%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~6a59de1f20, baseline=1.40.0-SNAPSHOT~b4718bd887 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (1.005 s) : 0, 1005079 BytebuddyAgent [candidate] (1.007 s) : 0, 1007420 GlobalTracer [baseline] (459.169 ms) : 0, 459169 GlobalTracer [candidate] (461.809 ms) : 0, 461809 AppSec [baseline] (75.538 ms) : 0, 75538 AppSec [candidate] (73.408 ms) : 0, 73408 Remote Config [baseline] (817.625 µs) : 0, 818 Remote Config [candidate] (860.351 µs) : 0, 860 Telemetry [baseline] (9.893 ms) : 0, 9893 Telemetry [candidate] (9.598 ms) : 0, 9598 section appsec BytebuddyAgent [baseline] (1.036 s) : 0, 1036373 BytebuddyAgent [candidate] (1.035 s) : 0, 1034625 GlobalTracer [baseline] (449.477 ms) : 0, 449477 GlobalTracer [candidate] (450.689 ms) : 0, 450689 AppSec [baseline] (241.857 ms) : 0, 241857 AppSec [candidate] (240.082 ms) : 0, 240082 IAST [baseline] (24.739 ms) : 0, 24739 IAST [candidate] (24.797 ms) : 0, 24797 Remote Config [baseline] (790.578 µs) : 0, 791 Remote Config [candidate] (793.576 µs) : 0, 794 Telemetry [baseline] (12.57 ms) : 0, 12570 Telemetry [candidate] (11.271 ms) : 0, 11271 section iast BytebuddyAgent [baseline] (1.17 s) : 0, 1170127 BytebuddyAgent [candidate] (1.163 s) : 0, 1163178 GlobalTracer [baseline] (441.782 ms) : 0, 441782 GlobalTracer [candidate] (438.096 ms) : 0, 438096 AppSec [baseline] (74.372 ms) : 0, 74372 AppSec [candidate] (69.875 ms) : 0, 69875 IAST [baseline] (31.285 ms) : 0, 31285 IAST [candidate] (33.904 ms) : 0, 33904 Remote Config [baseline] (776.845 µs) : 0, 777 Remote Config [candidate] (959.718 µs) : 0, 960 Telemetry [baseline] (9.526 ms) : 0, 9526 Telemetry [candidate] (9.495 ms) : 0, 9495 section profiling BytebuddyAgent [baseline] (1.001 s) : 0, 1001284 BytebuddyAgent [candidate] (997.496 ms) : 0, 997496 GlobalTracer [baseline] (590.76 ms) : 0, 590760 GlobalTracer [candidate] (588.802 ms) : 0, 588802 AppSec [baseline] (76.692 ms) : 0, 76692 AppSec [candidate] (73.565 ms) : 0, 73565 Remote Config [baseline] (824.729 µs) : 0, 825 Remote Config [candidate] (889.436 µs) : 0, 889 Telemetry [baseline] (9.631 ms) : 0, 9631 Telemetry [candidate] (9.629 ms) : 0, 9629 ProfilingAgent [baseline] (162.419 ms) : 0, 162419 ProfilingAgent [candidate] (162.487 ms) : 0, 162487 Profiling [baseline] (162.476 ms) : 0, 162476 Profiling [candidate] (162.544 ms) : 0, 162544 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-19T19:34:04 2024-09-19T19:40:54
git_branch master nayeem-kamal/spring-kafka-fix-singledir
git_commit_date 1726749615 1726753039
git_commit_sha b4718bd887 6a59de1f20
release_version 1.40.0-SNAPSHOT~b4718bd887 1.40.0-SNAPSHOT~6a59de1f20
start_time 2024-09-19T19:33:51 2024-09-19T19:40:41
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726775201 |1726775201 | |ci_job_id |645627886 |645627886 | |ci_pipeline_id|44739544 |44739544 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~6a59de1f20, baseline=1.40.0-SNAPSHOT~b4718bd887 dateFormat X axisFormat %s section baseline no_agent (1.335 ms) : 1315, 1354 . : milestone, 1335, appsec (1.708 ms) : 1685, 1731 . : milestone, 1708, appsec_no_iast (1.729 ms) : 1704, 1753 . : milestone, 1729, iast (1.468 ms) : 1445, 1490 . : milestone, 1468, profiling (1.465 ms) : 1440, 1490 . : milestone, 1465, tracing (1.462 ms) : 1438, 1486 . : milestone, 1462, section candidate no_agent (1.339 ms) : 1320, 1359 . : milestone, 1339, appsec (1.728 ms) : 1704, 1752 . : milestone, 1728, appsec_no_iast (1.731 ms) : 1707, 1755 . : milestone, 1731, iast (1.491 ms) : 1468, 1514 . : milestone, 1491, profiling (1.481 ms) : 1458, 1504 . : milestone, 1481, tracing (1.469 ms) : 1445, 1493 . : milestone, 1469, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.335 ms [1.315 ms, 1.354 ms]|-| |appsec|1.708 ms [1.685 ms, 1.731 ms]|373.6 µs (28.0%)| |appsec_no_iast|1.729 ms [1.704 ms, 1.753 ms]|394.16 µs (29.5%)| |iast|1.468 ms [1.445 ms, 1.49 ms]|133.286 µs (10.0%)| |profiling|1.465 ms [1.44 ms, 1.49 ms]|130.729 µs (9.8%)| |tracing|1.462 ms [1.438 ms, 1.486 ms]|127.647 µs (9.6%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.339 ms [1.32 ms, 1.359 ms]|-| |appsec|1.728 ms [1.704 ms, 1.752 ms]|388.347 µs (29.0%)| |appsec_no_iast|1.731 ms [1.707 ms, 1.755 ms]|391.702 µs (29.2%)| |iast|1.491 ms [1.468 ms, 1.514 ms]|151.504 µs (11.3%)| |profiling|1.481 ms [1.458 ms, 1.504 ms]|141.783 µs (10.6%)| |tracing|1.469 ms [1.445 ms, 1.493 ms]|129.678 µs (9.7%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~6a59de1f20, baseline=1.40.0-SNAPSHOT~b4718bd887 dateFormat X axisFormat %s section baseline no_agent (371.421 µs) : 352, 391 . : milestone, 371, iast (481.474 µs) : 460, 503 . : milestone, 481, iast_FULL (549.866 µs) : 529, 571 . : milestone, 550, iast_GLOBAL (507.388 µs) : 486, 529 . : milestone, 507, iast_HARDCODED_SECRET_DISABLED (498.962 µs) : 477, 521 . : milestone, 499, iast_INACTIVE (444.445 µs) : 424, 465 . : milestone, 444, iast_TELEMETRY_OFF (480.872 µs) : 458, 504 . : milestone, 481, tracing (450.622 µs) : 429, 472 . : milestone, 451, section candidate no_agent (376.859 µs) : 357, 397 . : milestone, 377, iast (486.641 µs) : 465, 508 . : milestone, 487, iast_FULL (548.941 µs) : 528, 570 . : milestone, 549, iast_GLOBAL (513.464 µs) : 491, 536 . : milestone, 513, iast_HARDCODED_SECRET_DISABLED (493.08 µs) : 471, 515 . : milestone, 493, iast_INACTIVE (445.937 µs) : 425, 467 . : milestone, 446, iast_TELEMETRY_OFF (482.58 µs) : 459, 506 . : milestone, 483, tracing (445.382 µs) : 425, 466 . : milestone, 445, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|371.421 µs [351.88 µs, 390.961 µs]|-| |iast|481.474 µs [460.103 µs, 502.845 µs]|110.053 µs (29.6%)| |iast_FULL|549.866 µs [528.671 µs, 571.061 µs]|178.445 µs (48.0%)| |iast_GLOBAL|507.388 µs [485.944 µs, 528.832 µs]|135.967 µs (36.6%)| |iast_HARDCODED_SECRET_DISABLED|498.962 µs [476.661 µs, 521.263 µs]|127.541 µs (34.3%)| |iast_INACTIVE|444.445 µs [424.006 µs, 464.884 µs]|73.024 µs (19.7%)| |iast_TELEMETRY_OFF|480.872 µs [457.708 µs, 504.037 µs]|109.452 µs (29.5%)| |tracing|450.622 µs [429.171 µs, 472.073 µs]|79.201 µs (21.3%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|376.859 µs [356.986 µs, 396.732 µs]|-| |iast|486.641 µs [465.131 µs, 508.15 µs]|109.782 µs (29.1%)| |iast_FULL|548.941 µs [527.606 µs, 570.275 µs]|172.082 µs (45.7%)| |iast_GLOBAL|513.464 µs [490.957 µs, 535.971 µs]|136.606 µs (36.2%)| |iast_HARDCODED_SECRET_DISABLED|493.08 µs [471.431 µs, 514.728 µs]|116.221 µs (30.8%)| |iast_INACTIVE|445.937 µs [424.874 µs, 466.999 µs]|69.078 µs (18.3%)| |iast_TELEMETRY_OFF|482.58 µs [459.342 µs, 505.819 µs]|105.722 µs (28.1%)| |tracing|445.382 µs [424.644 µs, 466.12 µs]|68.524 µs (18.2%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nayeem-kamal/spring-kafka-fix-singledir
git_commit_date 1726749615 1726753039
git_commit_sha b4718bd887 6a59de1f20
release_version 1.40.0-SNAPSHOT~b4718bd887 1.40.0-SNAPSHOT~6a59de1f20
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1726775727 |1726775727 | |ci_job_id |645627887 |645627887 | |ci_pipeline_id|44739544 |44739544 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~6a59de1f20, baseline=1.40.0-SNAPSHOT~b4718bd887 dateFormat X axisFormat %s section baseline no_agent (1.463 ms) : 1452, 1474 . : milestone, 1463, appsec (2.331 ms) : 2291, 2372 . : milestone, 2331, iast (2.041 ms) : 1992, 2089 . : milestone, 2041, iast_GLOBAL (2.099 ms) : 2048, 2149 . : milestone, 2099, profiling (1.922 ms) : 1882, 1961 . : milestone, 1922, tracing (1.9 ms) : 1861, 1938 . : milestone, 1900, section candidate no_agent (1.461 ms) : 1449, 1472 . : milestone, 1461, appsec (2.303 ms) : 2262, 2344 . : milestone, 2303, iast (2.054 ms) : 2005, 2103 . : milestone, 2054, iast_GLOBAL (2.083 ms) : 2033, 2132 . : milestone, 2083, profiling (1.931 ms) : 1889, 1973 . : milestone, 1931, tracing (1.906 ms) : 1868, 1944 . : milestone, 1906, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.463 ms [1.452 ms, 1.474 ms]|-| |appsec|2.331 ms [2.291 ms, 2.372 ms]|868.35 µs (59.4%)| |iast|2.041 ms [1.992 ms, 2.089 ms]|577.936 µs (39.5%)| |iast_GLOBAL|2.099 ms [2.048 ms, 2.149 ms]|635.625 µs (43.4%)| |profiling|1.922 ms [1.882 ms, 1.961 ms]|458.684 µs (31.4%)| |tracing|1.9 ms [1.861 ms, 1.938 ms]|436.744 µs (29.9%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.461 ms [1.449 ms, 1.472 ms]|-| |appsec|2.303 ms [2.262 ms, 2.344 ms]|842.269 µs (57.7%)| |iast|2.054 ms [2.005 ms, 2.103 ms]|593.431 µs (40.6%)| |iast_GLOBAL|2.083 ms [2.033 ms, 2.132 ms]|621.925 µs (42.6%)| |profiling|1.931 ms [1.889 ms, 1.973 ms]|470.562 µs (32.2%)| |tracing|1.906 ms [1.868 ms, 1.944 ms]|445.319 µs (30.5%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~6a59de1f20, baseline=1.40.0-SNAPSHOT~b4718bd887 dateFormat X axisFormat %s section baseline no_agent (15.061 s) : 15061000, 15061000 . : milestone, 15061000, appsec (15.365 s) : 15365000, 15365000 . : milestone, 15365000, iast (18.668 s) : 18668000, 18668000 . : milestone, 18668000, iast_GLOBAL (18.03 s) : 18030000, 18030000 . : milestone, 18030000, profiling (15.229 s) : 15229000, 15229000 . : milestone, 15229000, tracing (15.254 s) : 15254000, 15254000 . : milestone, 15254000, section candidate no_agent (15.797 s) : 15797000, 15797000 . : milestone, 15797000, appsec (15.315 s) : 15315000, 15315000 . : milestone, 15315000, iast (18.85 s) : 18850000, 18850000 . : milestone, 18850000, iast_GLOBAL (17.876 s) : 17876000, 17876000 . : milestone, 17876000, profiling (15.249 s) : 15249000, 15249000 . : milestone, 15249000, tracing (15.065 s) : 15065000, 15065000 . : milestone, 15065000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.061 s [15.061 s, 15.061 s]|-| |appsec|15.365 s [15.365 s, 15.365 s]|304.0 ms (2.0%)| |iast|18.668 s [18.668 s, 18.668 s]|3.607 s (23.9%)| |iast_GLOBAL|18.03 s [18.03 s, 18.03 s]|2.969 s (19.7%)| |profiling|15.229 s [15.229 s, 15.229 s]|168.0 ms (1.1%)| |tracing|15.254 s [15.254 s, 15.254 s]|193.0 ms (1.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.797 s [15.797 s, 15.797 s]|-| |appsec|15.315 s [15.315 s, 15.315 s]|-482.0 ms (-3.1%)| |iast|18.85 s [18.85 s, 18.85 s]|3.053 s (19.3%)| |iast_GLOBAL|17.876 s [17.876 s, 17.876 s]|2.079 s (13.2%)| |profiling|15.249 s [15.249 s, 15.249 s]|-548.0 ms (-3.5%)| |tracing|15.065 s [15.065 s, 15.065 s]|-732.0 ms (-4.6%)|