search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Update system-tests to 23522fc5c6b1d7e8e1809d58d42e84ca1430b898 #7770

Closed smola closed 3 weeks ago

smola commented 1 month ago

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-20241016
git_commit_date 1729072260 1729072346
git_commit_sha e08f541bb5 b9ca2837a1
release_version 1.41.0-SNAPSHOT~e08f541bb5 1.41.0-SNAPSHOT~b9ca2837a1
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729074662 |1729074662 | |ci_job_id |673683515 |673683515 | |ci_pipeline_id|46697841 |46697841 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 8 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~b9ca2837a1, baseline=1.41.0-SNAPSHOT~e08f541bb5 dateFormat X axisFormat %s section tracing Agent [baseline] (1.077 s) : 0, 1077468 Total [baseline] (10.379 s) : 0, 10379210 Agent [candidate] (1.07 s) : 0, 1070372 Total [candidate] (10.426 s) : 0, 10425766 section appsec Agent [baseline] (1.207 s) : 0, 1206666 Total [baseline] (10.65 s) : 0, 10649872 Agent [candidate] (1.208 s) : 0, 1207853 Total [candidate] (10.565 s) : 0, 10564858 section iast Agent [baseline] (1.196 s) : 0, 1196064 Total [baseline] (10.841 s) : 0, 10840741 Agent [candidate] (1.197 s) : 0, 1197224 Total [candidate] (10.789 s) : 0, 10789174 section profiling Agent [baseline] (1.266 s) : 0, 1266414 Total [baseline] (10.648 s) : 0, 10647864 Agent [candidate] (1.267 s) : 0, 1267225 Total [candidate] (10.712 s) : 0, 10712069 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.077 s |-| |Agent|appsec|1.207 s |129.198 ms (12.0%)| |Agent|iast|1.196 s |118.596 ms (11.0%)| |Agent|profiling|1.266 s |188.947 ms (17.5%)| |Total|tracing|10.379 s |-| |Total|appsec|10.65 s |270.663 ms (2.6%)| |Total|iast|10.841 s |461.532 ms (4.4%)| |Total|profiling|10.648 s |268.654 ms (2.6%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.07 s |-| |Agent|appsec|1.208 s |137.481 ms (12.8%)| |Agent|iast|1.197 s |126.851 ms (11.9%)| |Agent|profiling|1.267 s |196.852 ms (18.4%)| |Total|tracing|10.426 s |-| |Total|appsec|10.565 s |139.092 ms (1.3%)| |Total|iast|10.789 s |363.409 ms (3.5%)| |Total|profiling|10.712 s |286.303 ms (2.7%)| ```mermaid gantt title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~b9ca2837a1, baseline=1.41.0-SNAPSHOT~e08f541bb5 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (687.119 ms) : 0, 687119 BytebuddyAgent [candidate] (681.992 ms) : 0, 681992 GlobalTracer [baseline] (314.277 ms) : 0, 314277 GlobalTracer [candidate] (312.99 ms) : 0, 312990 AppSec [baseline] (54.161 ms) : 0, 54161 AppSec [candidate] (53.617 ms) : 0, 53617 Remote Config [baseline] (669.347 µs) : 0, 669 Remote Config [candidate] (669.448 µs) : 0, 669 Telemetry [baseline] (7.498 ms) : 0, 7498 Telemetry [candidate] (7.438 ms) : 0, 7438 section appsec BytebuddyAgent [baseline] (700.607 ms) : 0, 700607 BytebuddyAgent [candidate] (701.755 ms) : 0, 701755 GlobalTracer [baseline] (310.552 ms) : 0, 310552 GlobalTracer [candidate] (309.895 ms) : 0, 309895 AppSec [baseline] (162.169 ms) : 0, 162169 AppSec [candidate] (164.023 ms) : 0, 164023 IAST [baseline] (21.618 ms) : 0, 21618 IAST [candidate] (20.101 ms) : 0, 20101 Remote Config [baseline] (637.449 µs) : 0, 637 Remote Config [candidate] (637.935 µs) : 0, 638 Telemetry [baseline] (8.209 ms) : 0, 8209 Telemetry [candidate] (7.783 ms) : 0, 7783 section iast BytebuddyAgent [baseline] (795.851 ms) : 0, 795851 BytebuddyAgent [candidate] (796.895 ms) : 0, 796895 GlobalTracer [baseline] (300.554 ms) : 0, 300554 GlobalTracer [candidate] (300.947 ms) : 0, 300947 AppSec [baseline] (57.152 ms) : 0, 57152 AppSec [candidate] (57.758 ms) : 0, 57758 IAST [baseline] (21.224 ms) : 0, 21224 IAST [candidate] (20.322 ms) : 0, 20322 Remote Config [baseline] (594.916 µs) : 0, 595 Remote Config [candidate] (597.869 µs) : 0, 598 Telemetry [baseline] (7.076 ms) : 0, 7076 Telemetry [candidate] (7.053 ms) : 0, 7053 section profiling BytebuddyAgent [baseline] (675.002 ms) : 0, 675002 BytebuddyAgent [candidate] (675.478 ms) : 0, 675478 GlobalTracer [baseline] (394.337 ms) : 0, 394337 GlobalTracer [candidate] (394.798 ms) : 0, 394798 AppSec [baseline] (54.557 ms) : 0, 54557 AppSec [candidate] (54.42 ms) : 0, 54420 Remote Config [baseline] (651.168 µs) : 0, 651 Remote Config [candidate] (649.193 µs) : 0, 649 Telemetry [baseline] (7.402 ms) : 0, 7402 Telemetry [candidate] (7.391 ms) : 0, 7391 ProfilingAgent [baseline] (95.902 ms) : 0, 95902 ProfilingAgent [candidate] (95.868 ms) : 0, 95868 Profiling [baseline] (95.926 ms) : 0, 95926 Profiling [candidate] (95.891 ms) : 0, 95891 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~b9ca2837a1, baseline=1.41.0-SNAPSHOT~e08f541bb5 dateFormat X axisFormat %s section tracing Agent [baseline] (1.086 s) : 0, 1085936 Total [baseline] (8.601 s) : 0, 8600722 Agent [candidate] (1.067 s) : 0, 1067351 Total [candidate] (8.514 s) : 0, 8514487 section iast Agent [baseline] (1.206 s) : 0, 1206165 Total [baseline] (9.133 s) : 0, 9133125 Agent [candidate] (1.199 s) : 0, 1198564 Total [candidate] (9.059 s) : 0, 9058517 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.195 s) : 0, 1195253 Total [baseline] (9.052 s) : 0, 9051664 Agent [candidate] (1.214 s) : 0, 1214044 Total [candidate] (9.075 s) : 0, 9074831 section iast_TELEMETRY_OFF Agent [baseline] (1.202 s) : 0, 1201919 Total [baseline] (9.067 s) : 0, 9067230 Agent [candidate] (1.203 s) : 0, 1202744 Total [candidate] (9.078 s) : 0, 9078358 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.086 s |-| |Agent|iast|1.206 s |120.229 ms (11.1%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.195 s |109.318 ms (10.1%)| |Agent|iast_TELEMETRY_OFF|1.202 s |115.983 ms (10.7%)| |Total|tracing|8.601 s |-| |Total|iast|9.133 s |532.402 ms (6.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.052 s |450.942 ms (5.2%)| |Total|iast_TELEMETRY_OFF|9.067 s |466.508 ms (5.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.067 s |-| |Agent|iast|1.199 s |131.213 ms (12.3%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.214 s |146.693 ms (13.7%)| |Agent|iast_TELEMETRY_OFF|1.203 s |135.392 ms (12.7%)| |Total|tracing|8.514 s |-| |Total|iast|9.059 s |544.029 ms (6.4%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.075 s |560.343 ms (6.6%)| |Total|iast_TELEMETRY_OFF|9.078 s |563.87 ms (6.6%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~b9ca2837a1, baseline=1.41.0-SNAPSHOT~e08f541bb5 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (691.72 ms) : 0, 691720 BytebuddyAgent [candidate] (680.161 ms) : 0, 680161 GlobalTracer [baseline] (317.456 ms) : 0, 317456 GlobalTracer [candidate] (311.781 ms) : 0, 311781 AppSec [baseline] (54.608 ms) : 0, 54608 AppSec [candidate] (53.66 ms) : 0, 53660 Remote Config [baseline] (687.186 µs) : 0, 687 Remote Config [candidate] (661.548 µs) : 0, 662 Telemetry [baseline] (7.667 ms) : 0, 7667 Telemetry [candidate] (7.485 ms) : 0, 7485 section iast BytebuddyAgent [baseline] (803.088 ms) : 0, 803088 BytebuddyAgent [candidate] (797.844 ms) : 0, 797844 GlobalTracer [baseline] (302.212 ms) : 0, 302212 GlobalTracer [candidate] (301.024 ms) : 0, 301024 AppSec [baseline] (57.039 ms) : 0, 57039 AppSec [candidate] (55.493 ms) : 0, 55493 IAST [baseline] (22.289 ms) : 0, 22289 IAST [candidate] (22.81 ms) : 0, 22810 Remote Config [baseline] (621.043 µs) : 0, 621 Remote Config [candidate] (606.882 µs) : 0, 607 Telemetry [baseline] (7.175 ms) : 0, 7175 Telemetry [candidate] (7.059 ms) : 0, 7059 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (794.698 ms) : 0, 794698 BytebuddyAgent [candidate] (808.67 ms) : 0, 808670 GlobalTracer [baseline] (300.821 ms) : 0, 300821 GlobalTracer [candidate] (304.965 ms) : 0, 304965 AppSec [baseline] (57.044 ms) : 0, 57044 AppSec [candidate] (56.163 ms) : 0, 56163 IAST [baseline] (21.338 ms) : 0, 21338 IAST [candidate] (22.771 ms) : 0, 22771 Remote Config [baseline] (605.627 µs) : 0, 606 Remote Config [candidate] (593.456 µs) : 0, 593 Telemetry [baseline] (7.123 ms) : 0, 7123 Telemetry [candidate] (7.051 ms) : 0, 7051 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (799.826 ms) : 0, 799826 BytebuddyAgent [candidate] (799.941 ms) : 0, 799941 GlobalTracer [baseline] (302.598 ms) : 0, 302598 GlobalTracer [candidate] (303.308 ms) : 0, 303308 AppSec [baseline] (53.473 ms) : 0, 53473 AppSec [candidate] (54.64 ms) : 0, 54640 IAST [baseline] (24.787 ms) : 0, 24787 IAST [candidate] (23.363 ms) : 0, 23363 Remote Config [baseline] (589.716 µs) : 0, 590 Remote Config [candidate] (605.803 µs) : 0, 606 Telemetry [baseline] (6.868 ms) : 0, 6868 Telemetry [candidate] (7.069 ms) : 0, 7069 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-16T10:03:34 2024-10-16T10:10:25
git_branch master smola/system-tests-20241016
git_commit_date 1729072260 1729072346
git_commit_sha e08f541bb5 b9ca2837a1
release_version 1.41.0-SNAPSHOT~e08f541bb5 1.41.0-SNAPSHOT~b9ca2837a1
start_time 2024-10-16T10:03:20 2024-10-16T10:10:12
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729073773 |1729073773 | |ci_job_id |673683516 |673683516 | |ci_pipeline_id|46697841 |46697841 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~b9ca2837a1, baseline=1.41.0-SNAPSHOT~e08f541bb5 dateFormat X axisFormat %s section baseline no_agent (1.335 ms) : 1316, 1355 . : milestone, 1335, appsec (1.723 ms) : 1698, 1747 . : milestone, 1723, appsec_no_iast (1.715 ms) : 1691, 1739 . : milestone, 1715, iast (1.483 ms) : 1460, 1506 . : milestone, 1483, profiling (1.539 ms) : 1514, 1563 . : milestone, 1539, tracing (1.453 ms) : 1428, 1478 . : milestone, 1453, section candidate no_agent (1.34 ms) : 1320, 1359 . : milestone, 1340, appsec (1.693 ms) : 1670, 1716 . : milestone, 1693, appsec_no_iast (1.729 ms) : 1706, 1753 . : milestone, 1729, iast (1.486 ms) : 1464, 1509 . : milestone, 1486, profiling (1.515 ms) : 1490, 1540 . : milestone, 1515, tracing (1.454 ms) : 1430, 1478 . : milestone, 1454, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.335 ms [1.316 ms, 1.355 ms]|-| |appsec|1.723 ms [1.698 ms, 1.747 ms]|387.329 µs (29.0%)| |appsec_no_iast|1.715 ms [1.691 ms, 1.739 ms]|379.32 µs (28.4%)| |iast|1.483 ms [1.46 ms, 1.506 ms]|147.544 µs (11.0%)| |profiling|1.539 ms [1.514 ms, 1.563 ms]|203.334 µs (15.2%)| |tracing|1.453 ms [1.428 ms, 1.478 ms]|117.265 µs (8.8%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.34 ms [1.32 ms, 1.359 ms]|-| |appsec|1.693 ms [1.67 ms, 1.716 ms]|353.236 µs (26.4%)| |appsec_no_iast|1.729 ms [1.706 ms, 1.753 ms]|389.585 µs (29.1%)| |iast|1.486 ms [1.464 ms, 1.509 ms]|146.546 µs (10.9%)| |profiling|1.515 ms [1.49 ms, 1.54 ms]|175.622 µs (13.1%)| |tracing|1.454 ms [1.43 ms, 1.478 ms]|114.095 µs (8.5%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~b9ca2837a1, baseline=1.41.0-SNAPSHOT~e08f541bb5 dateFormat X axisFormat %s section baseline no_agent (370.229 µs) : 351, 390 . : milestone, 370, iast (486.617 µs) : 465, 508 . : milestone, 487, iast_FULL (550.44 µs) : 529, 572 . : milestone, 550, iast_GLOBAL (507.507 µs) : 486, 529 . : milestone, 508, iast_HARDCODED_SECRET_DISABLED (483.559 µs) : 462, 505 . : milestone, 484, iast_INACTIVE (439.511 µs) : 419, 460 . : milestone, 440, iast_TELEMETRY_OFF (474.247 µs) : 452, 496 . : milestone, 474, tracing (445.1 µs) : 424, 466 . : milestone, 445, section candidate no_agent (372.124 µs) : 353, 392 . : milestone, 372, iast (478.926 µs) : 458, 500 . : milestone, 479, iast_FULL (554.677 µs) : 533, 576 . : milestone, 555, iast_GLOBAL (515.045 µs) : 491, 539 . : milestone, 515, iast_HARDCODED_SECRET_DISABLED (480.237 µs) : 459, 501 . : milestone, 480, iast_INACTIVE (444.526 µs) : 424, 465 . : milestone, 445, iast_TELEMETRY_OFF (469.42 µs) : 448, 491 . : milestone, 469, tracing (441.097 µs) : 420, 462 . : milestone, 441, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|370.229 µs [350.696 µs, 389.762 µs]|-| |iast|486.617 µs [465.232 µs, 508.002 µs]|116.388 µs (31.4%)| |iast_FULL|550.44 µs [529.133 µs, 571.747 µs]|180.212 µs (48.7%)| |iast_GLOBAL|507.507 µs [485.942 µs, 529.072 µs]|137.278 µs (37.1%)| |iast_HARDCODED_SECRET_DISABLED|483.559 µs [461.826 µs, 505.292 µs]|113.33 µs (30.6%)| |iast_INACTIVE|439.511 µs [419.14 µs, 459.881 µs]|69.282 µs (18.7%)| |iast_TELEMETRY_OFF|474.247 µs [452.431 µs, 496.063 µs]|104.018 µs (28.1%)| |tracing|445.1 µs [423.767 µs, 466.434 µs]|74.872 µs (20.2%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|372.124 µs [352.516 µs, 391.731 µs]|-| |iast|478.926 µs [457.805 µs, 500.047 µs]|106.802 µs (28.7%)| |iast_FULL|554.677 µs [533.244 µs, 576.11 µs]|182.553 µs (49.1%)| |iast_GLOBAL|515.045 µs [491.415 µs, 538.675 µs]|142.921 µs (38.4%)| |iast_HARDCODED_SECRET_DISABLED|480.237 µs [459.303 µs, 501.17 µs]|108.113 µs (29.1%)| |iast_INACTIVE|444.526 µs [423.741 µs, 465.311 µs]|72.402 µs (19.5%)| |iast_TELEMETRY_OFF|469.42 µs [448.123 µs, 490.718 µs]|97.296 µs (26.1%)| |tracing|441.097 µs [420.387 µs, 461.808 µs]|68.974 µs (18.5%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/system-tests-20241016
git_commit_date 1729072260 1729072346
git_commit_sha e08f541bb5 b9ca2837a1
release_version 1.41.0-SNAPSHOT~e08f541bb5 1.41.0-SNAPSHOT~b9ca2837a1
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1729074190 |1729074190 | |ci_job_id |673683517 |673683517 | |ci_pipeline_id|46697841 |46697841 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~b9ca2837a1, baseline=1.41.0-SNAPSHOT~e08f541bb5 dateFormat X axisFormat %s section baseline no_agent (1.462 ms) : 1451, 1474 . : milestone, 1462, appsec (2.304 ms) : 2263, 2345 . : milestone, 2304, iast (2.063 ms) : 2012, 2115 . : milestone, 2063, iast_GLOBAL (2.102 ms) : 2050, 2154 . : milestone, 2102, profiling (1.924 ms) : 1883, 1965 . : milestone, 1924, tracing (1.905 ms) : 1865, 1944 . : milestone, 1905, section candidate no_agent (1.468 ms) : 1456, 1479 . : milestone, 1468, appsec (2.31 ms) : 2269, 2351 . : milestone, 2310, iast (2.064 ms) : 2012, 2116 . : milestone, 2064, iast_GLOBAL (2.11 ms) : 2058, 2163 . : milestone, 2110, profiling (1.933 ms) : 1891, 1975 . : milestone, 1933, tracing (1.9 ms) : 1861, 1939 . : milestone, 1900, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.462 ms [1.451 ms, 1.474 ms]|-| |appsec|2.304 ms [2.263 ms, 2.345 ms]|841.74 µs (57.6%)| |iast|2.063 ms [2.012 ms, 2.115 ms]|601.193 µs (41.1%)| |iast_GLOBAL|2.102 ms [2.05 ms, 2.154 ms]|640.266 µs (43.8%)| |profiling|1.924 ms [1.883 ms, 1.965 ms]|462.249 µs (31.6%)| |tracing|1.905 ms [1.865 ms, 1.944 ms]|442.509 µs (30.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.468 ms [1.456 ms, 1.479 ms]|-| |appsec|2.31 ms [2.269 ms, 2.351 ms]|842.468 µs (57.4%)| |iast|2.064 ms [2.012 ms, 2.116 ms]|596.007 µs (40.6%)| |iast_GLOBAL|2.11 ms [2.058 ms, 2.163 ms]|642.709 µs (43.8%)| |profiling|1.933 ms [1.891 ms, 1.975 ms]|465.295 µs (31.7%)| |tracing|1.9 ms [1.861 ms, 1.939 ms]|432.17 µs (29.4%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~b9ca2837a1, baseline=1.41.0-SNAPSHOT~e08f541bb5 dateFormat X axisFormat %s section baseline no_agent (15.744 s) : 15744000, 15744000 . : milestone, 15744000, appsec (15.081 s) : 15081000, 15081000 . : milestone, 15081000, iast (18.868 s) : 18868000, 18868000 . : milestone, 18868000, iast_GLOBAL (18.089 s) : 18089000, 18089000 . : milestone, 18089000, profiling (15.303 s) : 15303000, 15303000 . : milestone, 15303000, tracing (15.246 s) : 15246000, 15246000 . : milestone, 15246000, section candidate no_agent (15.502 s) : 15502000, 15502000 . : milestone, 15502000, appsec (15.002 s) : 15002000, 15002000 . : milestone, 15002000, iast (18.88 s) : 18880000, 18880000 . : milestone, 18880000, iast_GLOBAL (18.094 s) : 18094000, 18094000 . : milestone, 18094000, profiling (15.296 s) : 15296000, 15296000 . : milestone, 15296000, tracing (15.208 s) : 15208000, 15208000 . : milestone, 15208000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.744 s [15.744 s, 15.744 s]|-| |appsec|15.081 s [15.081 s, 15.081 s]|-663.0 ms (-4.2%)| |iast|18.868 s [18.868 s, 18.868 s]|3.124 s (19.8%)| |iast_GLOBAL|18.089 s [18.089 s, 18.089 s]|2.345 s (14.9%)| |profiling|15.303 s [15.303 s, 15.303 s]|-441.0 ms (-2.8%)| |tracing|15.246 s [15.246 s, 15.246 s]|-498.0 ms (-3.2%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.502 s [15.502 s, 15.502 s]|-| |appsec|15.002 s [15.002 s, 15.002 s]|-500.0 ms (-3.2%)| |iast|18.88 s [18.88 s, 18.88 s]|3.378 s (21.8%)| |iast_GLOBAL|18.094 s [18.094 s, 18.094 s]|2.592 s (16.7%)| |profiling|15.296 s [15.296 s, 15.296 s]|-206.0 ms (-1.3%)| |tracing|15.208 s [15.208 s, 15.208 s]|-294.0 ms (-1.9%)|
smola commented 3 weeks ago

See https://github.com/DataDog/dd-trace-java/pull/7819