search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

[🍒 7655] Update libsqreen library to 11.0.1 fixing fingerprint generation #7669

Closed smola closed 1 month ago

smola commented 1 month ago

What Does This Do

(cherry picked from commit 0eb6f8c7c991183359caa33bde353a64312bbf5b)

(#7655)

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/backport-7655
git_commit_date 1727095368 1727100057
git_commit_sha 27f522f863 b2c3aeca88
release_version 1.40.0-SNAPSHOT~27f522f863 1.40.0-SNAPSHOT~b2c3aeca88
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727102527 |1727102527 | |ci_job_id |648196689 |648196689 | |ci_pipeline_id|44912667 |44912667 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 1 performance improvements and 4 performance regressions! Performance is the same for 45 metrics, 13 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:insecure-bank:iast:Telemetry worse
[+178.750µs; +583.949µs] or [+2.515%; +8.217%]		 7.488ms 7.107ms
scenario:startup:insecure-bank:iast_HARDCODED_SECRET_DISABLED:Telemetry worse
[+250.298µs; +391.076µs] or [+3.517%; +5.495%]		 7.437ms 7.116ms
scenario:startup:insecure-bank:tracing:Remote Config worse
[+18.680µs; +59.813µs] or [+2.793%; +8.942%]		 708.158µs 668.911µs
scenario:startup:petclinic:profiling:Remote Config worse
[+42.945µs; +83.111µs] or [+6.533%; +12.642%]		 720.428µs 657.400µs
scenario:startup:petclinic:tracing:AppSec better
[-3.284ms; -1.223ms] or [-6.040%; -2.250%]		 52.122ms 54.376ms
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~b2c3aeca88, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section tracing Agent [baseline] (1.069 s) : 0, 1068516 Total [baseline] (8.594 s) : 0, 8593988 Agent [candidate] (1.07 s) : 0, 1069951 Total [candidate] (8.593 s) : 0, 8592927 section iast Agent [baseline] (1.203 s) : 0, 1203325 Total [baseline] (9.022 s) : 0, 9022400 Agent [candidate] (1.198 s) : 0, 1197851 Total [candidate] (9.047 s) : 0, 9046920 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.204 s) : 0, 1203626 Total [baseline] (8.998 s) : 0, 8998160 Agent [candidate] (1.192 s) : 0, 1192195 Total [candidate] (8.98 s) : 0, 8979672 section iast_TELEMETRY_OFF Agent [baseline] (1.191 s) : 0, 1191483 Total [baseline] (9.011 s) : 0, 9011440 Agent [candidate] (1.196 s) : 0, 1195811 Total [candidate] (9.08 s) : 0, 9080031 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.069 s |-| |Agent|iast|1.203 s |134.809 ms (12.6%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.204 s |135.11 ms (12.6%)| |Agent|iast_TELEMETRY_OFF|1.191 s |122.967 ms (11.5%)| |Total|tracing|8.594 s |-| |Total|iast|9.022 s |428.412 ms (5.0%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.998 s |404.172 ms (4.7%)| |Total|iast_TELEMETRY_OFF|9.011 s |417.453 ms (4.9%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.07 s |-| |Agent|iast|1.198 s |127.9 ms (12.0%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.192 s |122.244 ms (11.4%)| |Agent|iast_TELEMETRY_OFF|1.196 s |125.86 ms (11.8%)| |Total|tracing|8.593 s |-| |Total|iast|9.047 s |453.992 ms (5.3%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.98 s |386.744 ms (4.5%)| |Total|iast_TELEMETRY_OFF|9.08 s |487.104 ms (5.7%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~b2c3aeca88, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (681.588 ms) : 0, 681588 BytebuddyAgent [candidate] (682.018 ms) : 0, 682018 GlobalTracer [baseline] (310.715 ms) : 0, 310715 GlobalTracer [candidate] (313.292 ms) : 0, 313292 AppSec [baseline] (54.196 ms) : 0, 54196 AppSec [candidate] (52.489 ms) : 0, 52489 Remote Config [baseline] (668.911 µs) : 0, 669 Remote Config [candidate] (708.158 µs) : 0, 708 Telemetry [baseline] (7.635 ms) : 0, 7635 Telemetry [candidate] (7.678 ms) : 0, 7678 section iast BytebuddyAgent [baseline] (800.889 ms) : 0, 800889 BytebuddyAgent [candidate] (797.285 ms) : 0, 797285 GlobalTracer [baseline] (301.829 ms) : 0, 301829 GlobalTracer [candidate] (301.033 ms) : 0, 301033 AppSec [baseline] (55.122 ms) : 0, 55122 AppSec [candidate] (54.477 ms) : 0, 54477 IAST [baseline] (23.888 ms) : 0, 23888 IAST [candidate] (23.134 ms) : 0, 23134 Remote Config [baseline] (611.99 µs) : 0, 612 Remote Config [candidate] (622.387 µs) : 0, 622 Telemetry [baseline] (7.107 ms) : 0, 7107 Telemetry [candidate] (7.488 ms) : 0, 7488 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (801.076 ms) : 0, 801076 BytebuddyAgent [candidate] (792.324 ms) : 0, 792324 GlobalTracer [baseline] (301.748 ms) : 0, 301748 GlobalTracer [candidate] (300.574 ms) : 0, 300574 AppSec [baseline] (56.961 ms) : 0, 56961 AppSec [candidate] (52.772 ms) : 0, 52772 IAST [baseline] (22.129 ms) : 0, 22129 IAST [candidate] (24.603 ms) : 0, 24603 Remote Config [baseline] (645.575 µs) : 0, 646 Remote Config [candidate] (659.947 µs) : 0, 660 Telemetry [baseline] (7.116 ms) : 0, 7116 Telemetry [candidate] (7.437 ms) : 0, 7437 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (791.488 ms) : 0, 791488 BytebuddyAgent [candidate] (794.358 ms) : 0, 794358 GlobalTracer [baseline] (299.803 ms) : 0, 299803 GlobalTracer [candidate] (302.037 ms) : 0, 302037 AppSec [baseline] (56.334 ms) : 0, 56334 AppSec [candidate] (53.591 ms) : 0, 53591 IAST [baseline] (22.503 ms) : 0, 22503 IAST [candidate] (23.154 ms) : 0, 23154 Remote Config [baseline] (614.368 µs) : 0, 614 Remote Config [candidate] (624.519 µs) : 0, 625 Telemetry [baseline] (6.931 ms) : 0, 6931 Telemetry [candidate] (8.193 ms) : 0, 8193 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~b2c3aeca88, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section tracing Agent [baseline] (1.081 s) : 0, 1080577 Total [baseline] (10.481 s) : 0, 10480611 Agent [candidate] (1.068 s) : 0, 1068001 Total [candidate] (10.403 s) : 0, 10403473 section appsec Agent [baseline] (1.207 s) : 0, 1207222 Total [baseline] (10.638 s) : 0, 10637862 Agent [candidate] (1.197 s) : 0, 1197459 Total [candidate] (10.603 s) : 0, 10602833 section iast Agent [baseline] (1.201 s) : 0, 1201488 Total [baseline] (10.852 s) : 0, 10852025 Agent [candidate] (1.192 s) : 0, 1192270 Total [candidate] (10.867 s) : 0, 10867074 section profiling Agent [baseline] (1.27 s) : 0, 1269506 Total [baseline] (10.585 s) : 0, 10584649 Agent [candidate] (1.281 s) : 0, 1280688 Total [candidate] (10.627 s) : 0, 10627210 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.081 s |-| |Agent|appsec|1.207 s |126.645 ms (11.7%)| |Agent|iast|1.201 s |120.911 ms (11.2%)| |Agent|profiling|1.27 s |188.929 ms (17.5%)| |Total|tracing|10.481 s |-| |Total|appsec|10.638 s |157.251 ms (1.5%)| |Total|iast|10.852 s |371.414 ms (3.5%)| |Total|profiling|10.585 s |104.038 ms (1.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.068 s |-| |Agent|appsec|1.197 s |129.458 ms (12.1%)| |Agent|iast|1.192 s |124.269 ms (11.6%)| |Agent|profiling|1.281 s |212.687 ms (19.9%)| |Total|tracing|10.403 s |-| |Total|appsec|10.603 s |199.36 ms (1.9%)| |Total|iast|10.867 s |463.601 ms (4.5%)| |Total|profiling|10.627 s |223.737 ms (2.2%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~b2c3aeca88, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (689.903 ms) : 0, 689903 BytebuddyAgent [candidate] (681.911 ms) : 0, 681911 GlobalTracer [baseline] (313.912 ms) : 0, 313912 GlobalTracer [candidate] (311.909 ms) : 0, 311909 AppSec [baseline] (54.376 ms) : 0, 54376 AppSec [candidate] (52.122 ms) : 0, 52122 Remote Config [baseline] (680.41 µs) : 0, 680 Remote Config [candidate] (693.206 µs) : 0, 693 Telemetry [baseline] (7.825 ms) : 0, 7825 Telemetry [candidate] (7.594 ms) : 0, 7594 section appsec BytebuddyAgent [baseline] (705.343 ms) : 0, 705343 BytebuddyAgent [candidate] (698.204 ms) : 0, 698204 GlobalTracer [baseline] (304.964 ms) : 0, 304964 GlobalTracer [candidate] (303.997 ms) : 0, 303997 AppSec [baseline] (164.466 ms) : 0, 164466 AppSec [candidate] (160.377 ms) : 0, 160377 Remote Config [baseline] (640.033 µs) : 0, 640 Remote Config [candidate] (641.18 µs) : 0, 641 Telemetry [baseline] (8.181 ms) : 0, 8181 Telemetry [candidate] (10.17 ms) : 0, 10170 IAST [baseline] (19.78 ms) : 0, 19780 IAST [candidate] (20.745 ms) : 0, 20745 section iast BytebuddyAgent [baseline] (799.696 ms) : 0, 799696 BytebuddyAgent [candidate] (793.243 ms) : 0, 793243 GlobalTracer [baseline] (301.365 ms) : 0, 301365 GlobalTracer [candidate] (300.158 ms) : 0, 300158 AppSec [baseline] (54.922 ms) : 0, 54922 AppSec [candidate] (54.23 ms) : 0, 54230 Remote Config [baseline] (609.231 µs) : 0, 609 Remote Config [candidate] (596.025 µs) : 0, 596 Telemetry [baseline] (7.113 ms) : 0, 7113 Telemetry [candidate] (8.184 ms) : 0, 8184 IAST [baseline] (23.925 ms) : 0, 23925 IAST [candidate] (22.095 ms) : 0, 22095 section profiling BytebuddyAgent [baseline] (675.48 ms) : 0, 675480 BytebuddyAgent [candidate] (683.136 ms) : 0, 683136 GlobalTracer [baseline] (395.384 ms) : 0, 395384 GlobalTracer [candidate] (399.228 ms) : 0, 399228 AppSec [baseline] (55.094 ms) : 0, 55094 AppSec [candidate] (53.038 ms) : 0, 53038 Remote Config [baseline] (657.4 µs) : 0, 657 Remote Config [candidate] (720.428 µs) : 0, 720 Telemetry [baseline] (7.467 ms) : 0, 7467 Telemetry [candidate] (7.622 ms) : 0, 7622 ProfilingAgent [baseline] (96.63 ms) : 0, 96630 ProfilingAgent [candidate] (98.186 ms) : 0, 98186 Profiling [baseline] (96.653 ms) : 0, 96653 Profiling [candidate] (98.211 ms) : 0, 98211 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-23T14:12:35 2024-09-23T14:19:25
git_branch master smola/backport-7655
git_commit_date 1727095368 1727100057
git_commit_sha 27f522f863 b2c3aeca88
release_version 1.40.0-SNAPSHOT~27f522f863 1.40.0-SNAPSHOT~b2c3aeca88
start_time 2024-09-23T14:12:21 2024-09-23T14:19:11
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727101510 |1727101510 | |ci_job_id |648196690 |648196690 | |ci_pipeline_id|44912667 |44912667 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~b2c3aeca88, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section baseline no_agent (1.349 ms) : 1330, 1368 . : milestone, 1349, appsec (1.739 ms) : 1716, 1763 . : milestone, 1739, appsec_no_iast (1.715 ms) : 1691, 1740 . : milestone, 1715, iast (1.495 ms) : 1472, 1518 . : milestone, 1495, profiling (1.479 ms) : 1454, 1503 . : milestone, 1479, tracing (1.476 ms) : 1451, 1501 . : milestone, 1476, section candidate no_agent (1.342 ms) : 1323, 1362 . : milestone, 1342, appsec (1.725 ms) : 1701, 1749 . : milestone, 1725, appsec_no_iast (1.719 ms) : 1695, 1743 . : milestone, 1719, iast (1.486 ms) : 1463, 1509 . : milestone, 1486, profiling (1.465 ms) : 1442, 1488 . : milestone, 1465, tracing (1.448 ms) : 1424, 1473 . : milestone, 1448, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.349 ms [1.33 ms, 1.368 ms]|-| |appsec|1.739 ms [1.716 ms, 1.763 ms]|390.294 µs (28.9%)| |appsec_no_iast|1.715 ms [1.691 ms, 1.74 ms]|366.24 µs (27.1%)| |iast|1.495 ms [1.472 ms, 1.518 ms]|145.957 µs (10.8%)| |profiling|1.479 ms [1.454 ms, 1.503 ms]|129.476 µs (9.6%)| |tracing|1.476 ms [1.451 ms, 1.501 ms]|126.892 µs (9.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.342 ms [1.323 ms, 1.362 ms]|-| |appsec|1.725 ms [1.701 ms, 1.749 ms]|382.517 µs (28.5%)| |appsec_no_iast|1.719 ms [1.695 ms, 1.743 ms]|376.504 µs (28.0%)| |iast|1.486 ms [1.463 ms, 1.509 ms]|143.345 µs (10.7%)| |profiling|1.465 ms [1.442 ms, 1.488 ms]|122.813 µs (9.1%)| |tracing|1.448 ms [1.424 ms, 1.473 ms]|105.872 µs (7.9%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~b2c3aeca88, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section baseline no_agent (369.917 µs) : 349, 391 . : milestone, 370, iast (496.573 µs) : 474, 519 . : milestone, 497, iast_FULL (557.336 µs) : 536, 579 . : milestone, 557, iast_GLOBAL (503.734 µs) : 483, 525 . : milestone, 504, iast_HARDCODED_SECRET_DISABLED (482.288 µs) : 461, 503 . : milestone, 482, iast_INACTIVE (442.74 µs) : 422, 463 . : milestone, 443, iast_TELEMETRY_OFF (475.686 µs) : 453, 499 . : milestone, 476, tracing (443.736 µs) : 423, 464 . : milestone, 444, section candidate no_agent (373.884 µs) : 354, 393 . : milestone, 374, iast (485.357 µs) : 463, 507 . : milestone, 485, iast_FULL (553.014 µs) : 532, 574 . : milestone, 553, iast_GLOBAL (520.55 µs) : 498, 543 . : milestone, 521, iast_HARDCODED_SECRET_DISABLED (485.652 µs) : 464, 507 . : milestone, 486, iast_INACTIVE (448.59 µs) : 428, 470 . : milestone, 449, iast_TELEMETRY_OFF (474.742 µs) : 452, 497 . : milestone, 475, tracing (444.661 µs) : 424, 466 . : milestone, 445, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|369.917 µs [348.711 µs, 391.124 µs]|-| |iast|496.573 µs [474.308 µs, 518.838 µs]|126.656 µs (34.2%)| |iast_FULL|557.336 µs [535.974 µs, 578.698 µs]|187.419 µs (50.7%)| |iast_GLOBAL|503.734 µs [482.698 µs, 524.77 µs]|133.816 µs (36.2%)| |iast_HARDCODED_SECRET_DISABLED|482.288 µs [461.48 µs, 503.095 µs]|112.37 µs (30.4%)| |iast_INACTIVE|442.74 µs [422.186 µs, 463.294 µs]|72.823 µs (19.7%)| |iast_TELEMETRY_OFF|475.686 µs [452.528 µs, 498.844 µs]|105.769 µs (28.6%)| |tracing|443.736 µs [423.279 µs, 464.192 µs]|73.818 µs (20.0%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|373.884 µs [354.27 µs, 393.497 µs]|-| |iast|485.357 µs [463.316 µs, 507.398 µs]|111.473 µs (29.8%)| |iast_FULL|553.014 µs [531.728 µs, 574.3 µs]|179.13 µs (47.9%)| |iast_GLOBAL|520.55 µs [498.128 µs, 542.972 µs]|146.666 µs (39.2%)| |iast_HARDCODED_SECRET_DISABLED|485.652 µs [463.989 µs, 507.316 µs]|111.769 µs (29.9%)| |iast_INACTIVE|448.59 µs [427.602 µs, 469.578 µs]|74.706 µs (20.0%)| |iast_TELEMETRY_OFF|474.742 µs [452.253 µs, 497.232 µs]|100.859 µs (27.0%)| |tracing|444.661 µs [423.778 µs, 465.543 µs]|70.777 µs (18.9%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/backport-7655
git_commit_date 1727095368 1727100057
git_commit_sha 27f522f863 b2c3aeca88
release_version 1.40.0-SNAPSHOT~27f522f863 1.40.0-SNAPSHOT~b2c3aeca88
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1727102035 |1727102035 | |ci_job_id |648196692 |648196692 | |ci_pipeline_id|44912667 |44912667 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~b2c3aeca88, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section baseline no_agent (15.587 s) : 15587000, 15587000 . : milestone, 15587000, appsec (14.939 s) : 14939000, 14939000 . : milestone, 14939000, iast (18.823 s) : 18823000, 18823000 . : milestone, 18823000, iast_GLOBAL (17.777 s) : 17777000, 17777000 . : milestone, 17777000, profiling (15.851 s) : 15851000, 15851000 . : milestone, 15851000, tracing (15.171 s) : 15171000, 15171000 . : milestone, 15171000, section candidate no_agent (14.951 s) : 14951000, 14951000 . : milestone, 14951000, appsec (15.342 s) : 15342000, 15342000 . : milestone, 15342000, iast (18.755 s) : 18755000, 18755000 . : milestone, 18755000, iast_GLOBAL (17.862 s) : 17862000, 17862000 . : milestone, 17862000, profiling (15.167 s) : 15167000, 15167000 . : milestone, 15167000, tracing (15.005 s) : 15005000, 15005000 . : milestone, 15005000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.587 s [15.587 s, 15.587 s]|-| |appsec|14.939 s [14.939 s, 14.939 s]|-648.0 ms (-4.2%)| |iast|18.823 s [18.823 s, 18.823 s]|3.236 s (20.8%)| |iast_GLOBAL|17.777 s [17.777 s, 17.777 s]|2.19 s (14.1%)| |profiling|15.851 s [15.851 s, 15.851 s]|264.0 ms (1.7%)| |tracing|15.171 s [15.171 s, 15.171 s]|-416.0 ms (-2.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.951 s [14.951 s, 14.951 s]|-| |appsec|15.342 s [15.342 s, 15.342 s]|391.0 ms (2.6%)| |iast|18.755 s [18.755 s, 18.755 s]|3.804 s (25.4%)| |iast_GLOBAL|17.862 s [17.862 s, 17.862 s]|2.911 s (19.5%)| |profiling|15.167 s [15.167 s, 15.167 s]|216.0 ms (1.4%)| |tracing|15.005 s [15.005 s, 15.005 s]|54.0 ms (0.4%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~b2c3aeca88, baseline=1.40.0-SNAPSHOT~27f522f863 dateFormat X axisFormat %s section baseline no_agent (1.467 ms) : 1455, 1478 . : milestone, 1467, appsec (2.312 ms) : 2272, 2353 . : milestone, 2312, iast (2.047 ms) : 1997, 2097 . : milestone, 2047, iast_GLOBAL (2.093 ms) : 2042, 2144 . : milestone, 2093, profiling (1.933 ms) : 1892, 1975 . : milestone, 1933, tracing (1.897 ms) : 1859, 1934 . : milestone, 1897, section candidate no_agent (1.462 ms) : 1450, 1473 . : milestone, 1462, appsec (2.277 ms) : 2237, 2318 . : milestone, 2277, iast (2.027 ms) : 1979, 2075 . : milestone, 2027, iast_GLOBAL (2.082 ms) : 2032, 2132 . : milestone, 2082, profiling (1.924 ms) : 1884, 1964 . : milestone, 1924, tracing (1.89 ms) : 1852, 1928 . : milestone, 1890, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.467 ms [1.455 ms, 1.478 ms]|-| |appsec|2.312 ms [2.272 ms, 2.353 ms]|845.307 µs (57.6%)| |iast|2.047 ms [1.997 ms, 2.097 ms]|579.978 µs (39.5%)| |iast_GLOBAL|2.093 ms [2.042 ms, 2.144 ms]|626.538 µs (42.7%)| |profiling|1.933 ms [1.892 ms, 1.975 ms]|466.536 µs (31.8%)| |tracing|1.897 ms [1.859 ms, 1.934 ms]|429.923 µs (29.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.462 ms [1.45 ms, 1.473 ms]|-| |appsec|2.277 ms [2.237 ms, 2.318 ms]|815.605 µs (55.8%)| |iast|2.027 ms [1.979 ms, 2.075 ms]|565.567 µs (38.7%)| |iast_GLOBAL|2.082 ms [2.032 ms, 2.132 ms]|620.231 µs (42.4%)| |profiling|1.924 ms [1.884 ms, 1.964 ms]|461.956 µs (31.6%)| |tracing|1.89 ms [1.852 ms, 1.928 ms]|428.41 µs (29.3%)|