search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
573 stars 284 forks source link

Optimize CircleCI caches #7582

Open smola opened 3 weeks ago

smola commented 3 weeks ago

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 3 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/gradle-caches
git_commit_date 1725887583 1725890073
git_commit_sha 3fd417447a fedacb5428
release_version 1.40.0-SNAPSHOT~3fd417447a 1.40.0-SNAPSHOT~fedacb5428
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725892466 |1725892466 | |ci_job_id |631990185 |631990185 | |ci_pipeline_id|43858586 |43858586 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 46 metrics, 17 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~fedacb5428, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section tracing Agent [baseline] (1.048 s) : 0, 1048400 Total [baseline] (10.445 s) : 0, 10444958 Agent [candidate] (1.049 s) : 0, 1049072 Total [candidate] (10.394 s) : 0, 10393818 section appsec Agent [baseline] (1.19 s) : 0, 1189709 Total [baseline] (10.63 s) : 0, 10630440 Agent [candidate] (1.184 s) : 0, 1184326 Total [candidate] (10.552 s) : 0, 10552129 section iast Agent [baseline] (1.178 s) : 0, 1178043 Total [baseline] (10.829 s) : 0, 10829061 Agent [candidate] (1.184 s) : 0, 1183679 Total [candidate] (10.771 s) : 0, 10771419 section profiling Agent [baseline] (1.263 s) : 0, 1263001 Total [baseline] (10.715 s) : 0, 10715045 Agent [candidate] (1.25 s) : 0, 1250289 Total [candidate] (10.624 s) : 0, 10624422 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.048 s |-| |Agent|appsec|1.19 s |141.309 ms (13.5%)| |Agent|iast|1.178 s |129.644 ms (12.4%)| |Agent|profiling|1.263 s |214.602 ms (20.5%)| |Total|tracing|10.445 s |-| |Total|appsec|10.63 s |185.482 ms (1.8%)| |Total|iast|10.829 s |384.103 ms (3.7%)| |Total|profiling|10.715 s |270.087 ms (2.6%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.049 s |-| |Agent|appsec|1.184 s |135.255 ms (12.9%)| |Agent|iast|1.184 s |134.608 ms (12.8%)| |Agent|profiling|1.25 s |201.217 ms (19.2%)| |Total|tracing|10.394 s |-| |Total|appsec|10.552 s |158.311 ms (1.5%)| |Total|iast|10.771 s |377.601 ms (3.6%)| |Total|profiling|10.624 s |230.603 ms (2.2%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~fedacb5428, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (669.209 ms) : 0, 669209 BytebuddyAgent [candidate] (669.085 ms) : 0, 669085 GlobalTracer [baseline] (306.32 ms) : 0, 306320 GlobalTracer [candidate] (306.969 ms) : 0, 306969 AppSec [baseline] (51.227 ms) : 0, 51227 AppSec [candidate] (51.262 ms) : 0, 51262 Remote Config [baseline] (688.952 µs) : 0, 689 Remote Config [candidate] (694.788 µs) : 0, 695 Telemetry [baseline] (7.445 ms) : 0, 7445 Telemetry [candidate] (7.505 ms) : 0, 7505 section appsec BytebuddyAgent [baseline] (692.617 ms) : 0, 692617 BytebuddyAgent [candidate] (690.285 ms) : 0, 690285 GlobalTracer [baseline] (302.358 ms) : 0, 302358 GlobalTracer [candidate] (300.333 ms) : 0, 300333 AppSec [baseline] (162.098 ms) : 0, 162098 AppSec [candidate] (159.387 ms) : 0, 159387 IAST [baseline] (20.441 ms) : 0, 20441 IAST [candidate] (20.51 ms) : 0, 20510 Remote Config [baseline] (630.876 µs) : 0, 631 Remote Config [candidate] (630.969 µs) : 0, 631 Telemetry [baseline] (8.212 ms) : 0, 8212 Telemetry [candidate] (9.848 ms) : 0, 9848 section iast BytebuddyAgent [baseline] (782.65 ms) : 0, 782650 BytebuddyAgent [candidate] (788.007 ms) : 0, 788007 GlobalTracer [baseline] (297.294 ms) : 0, 297294 GlobalTracer [candidate] (298.27 ms) : 0, 298270 AppSec [baseline] (54.545 ms) : 0, 54545 AppSec [candidate] (52.218 ms) : 0, 52218 IAST [baseline] (21.985 ms) : 0, 21985 IAST [candidate] (22.645 ms) : 0, 22645 Remote Config [baseline] (600.187 µs) : 0, 600 Remote Config [candidate] (662.615 µs) : 0, 663 Telemetry [baseline] (7.362 ms) : 0, 7362 Telemetry [candidate] (8.163 ms) : 0, 8163 section profiling BytebuddyAgent [baseline] (674.651 ms) : 0, 674651 BytebuddyAgent [candidate] (668.507 ms) : 0, 668507 GlobalTracer [baseline] (393.187 ms) : 0, 393187 GlobalTracer [candidate] (388.875 ms) : 0, 388875 AppSec [baseline] (52.544 ms) : 0, 52544 AppSec [candidate] (51.785 ms) : 0, 51785 Remote Config [baseline] (690.496 µs) : 0, 690 Remote Config [candidate] (669.28 µs) : 0, 669 Telemetry [baseline] (7.405 ms) : 0, 7405 Telemetry [candidate] (7.341 ms) : 0, 7341 ProfilingAgent [baseline] (96.1 ms) : 0, 96100 ProfilingAgent [candidate] (94.995 ms) : 0, 94995 Profiling [baseline] (96.125 ms) : 0, 96125 Profiling [candidate] (95.019 ms) : 0, 95019 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~fedacb5428, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section tracing Agent [baseline] (1.058 s) : 0, 1058089 Total [baseline] (8.526 s) : 0, 8526268 Agent [candidate] (1.052 s) : 0, 1052467 Total [candidate] (8.504 s) : 0, 8504438 section iast Agent [baseline] (1.175 s) : 0, 1175010 Total [baseline] (8.972 s) : 0, 8971784 Agent [candidate] (1.172 s) : 0, 1171816 Total [candidate] (8.959 s) : 0, 8958963 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.183 s) : 0, 1183012 Total [baseline] (8.953 s) : 0, 8953028 Agent [candidate] (1.178 s) : 0, 1178313 Total [candidate] (8.97 s) : 0, 8969527 section iast_TELEMETRY_OFF Agent [baseline] (1.172 s) : 0, 1171925 Total [baseline] (8.938 s) : 0, 8937798 Agent [candidate] (1.172 s) : 0, 1171568 Total [candidate] (8.968 s) : 0, 8968222 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.058 s |-| |Agent|iast|1.175 s |116.921 ms (11.1%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.183 s |124.923 ms (11.8%)| |Agent|iast_TELEMETRY_OFF|1.172 s |113.836 ms (10.8%)| |Total|tracing|8.526 s |-| |Total|iast|8.972 s |445.517 ms (5.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.953 s |426.76 ms (5.0%)| |Total|iast_TELEMETRY_OFF|8.938 s |411.53 ms (4.8%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.052 s |-| |Agent|iast|1.172 s |119.349 ms (11.3%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.178 s |125.846 ms (12.0%)| |Agent|iast_TELEMETRY_OFF|1.172 s |119.101 ms (11.3%)| |Total|tracing|8.504 s |-| |Total|iast|8.959 s |454.526 ms (5.3%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.97 s |465.089 ms (5.5%)| |Total|iast_TELEMETRY_OFF|8.968 s |463.784 ms (5.5%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~fedacb5428, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (675.237 ms) : 0, 675237 BytebuddyAgent [candidate] (671.16 ms) : 0, 671160 GlobalTracer [baseline] (309.384 ms) : 0, 309384 GlobalTracer [candidate] (307.953 ms) : 0, 307953 AppSec [baseline] (51.643 ms) : 0, 51643 AppSec [candidate] (51.662 ms) : 0, 51662 Remote Config [baseline] (692.751 µs) : 0, 693 Remote Config [candidate] (692.579 µs) : 0, 693 Telemetry [baseline] (7.485 ms) : 0, 7485 Telemetry [candidate] (7.398 ms) : 0, 7398 section iast BytebuddyAgent [baseline] (781.302 ms) : 0, 781302 BytebuddyAgent [candidate] (779.484 ms) : 0, 779484 GlobalTracer [baseline] (296.253 ms) : 0, 296253 GlobalTracer [candidate] (295.244 ms) : 0, 295244 AppSec [baseline] (53.174 ms) : 0, 53174 AppSec [candidate] (51.363 ms) : 0, 51363 IAST [baseline] (22.714 ms) : 0, 22714 IAST [candidate] (21.889 ms) : 0, 21889 Remote Config [baseline] (606.489 µs) : 0, 606 Remote Config [candidate] (2.166 ms) : 0, 2166 Telemetry [baseline] (7.382 ms) : 0, 7382 Telemetry [candidate] (8.092 ms) : 0, 8092 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (787.089 ms) : 0, 787089 BytebuddyAgent [candidate] (784.875 ms) : 0, 784875 GlobalTracer [baseline] (297.542 ms) : 0, 297542 GlobalTracer [candidate] (296.176 ms) : 0, 296176 AppSec [baseline] (50.514 ms) : 0, 50514 AppSec [candidate] (51.914 ms) : 0, 51914 IAST [baseline] (25.408 ms) : 0, 25408 IAST [candidate] (22.799 ms) : 0, 22799 Remote Config [baseline] (594.145 µs) : 0, 594 Remote Config [candidate] (596.807 µs) : 0, 597 Telemetry [baseline] (8.158 ms) : 0, 8158 Telemetry [candidate] (8.261 ms) : 0, 8261 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (778.696 ms) : 0, 778696 BytebuddyAgent [candidate] (778.238 ms) : 0, 778238 GlobalTracer [baseline] (295.933 ms) : 0, 295933 GlobalTracer [candidate] (296.28 ms) : 0, 296280 AppSec [baseline] (51.608 ms) : 0, 51608 AppSec [candidate] (54.874 ms) : 0, 54874 IAST [baseline] (22.574 ms) : 0, 22574 IAST [candidate] (20.718 ms) : 0, 20718 Remote Config [baseline] (616.775 µs) : 0, 617 Remote Config [candidate] (590.308 µs) : 0, 590 Telemetry [baseline] (8.868 ms) : 0, 8868 Telemetry [candidate] (7.238 ms) : 0, 7238 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-09T14:05:16 2024-09-09T14:12:03
git_branch master smola/gradle-caches
git_commit_date 1725887583 1725890073
git_commit_sha 3fd417447a fedacb5428
release_version 1.40.0-SNAPSHOT~3fd417447a 1.40.0-SNAPSHOT~fedacb5428
start_time 2024-09-09T14:05:03 2024-09-09T14:11:50
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725891466 |1725891466 | |ci_job_id |631990187 |631990187 | |ci_pipeline_id|43858586 |43858586 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~fedacb5428, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section baseline no_agent (366.603 µs) : 346, 387 . : milestone, 367, iast (478.818 µs) : 458, 500 . : milestone, 479, iast_FULL (544.407 µs) : 523, 566 . : milestone, 544, iast_GLOBAL (500.056 µs) : 478, 522 . : milestone, 500, iast_HARDCODED_SECRET_DISABLED (471.764 µs) : 450, 494 . : milestone, 472, iast_INACTIVE (447.148 µs) : 425, 469 . : milestone, 447, iast_TELEMETRY_OFF (469.924 µs) : 447, 492 . : milestone, 470, tracing (429.222 µs) : 409, 449 . : milestone, 429, section candidate no_agent (364.741 µs) : 344, 385 . : milestone, 365, iast (483.06 µs) : 460, 506 . : milestone, 483, iast_FULL (543.628 µs) : 523, 564 . : milestone, 544, iast_GLOBAL (506.93 µs) : 485, 529 . : milestone, 507, iast_HARDCODED_SECRET_DISABLED (472.162 µs) : 451, 493 . : milestone, 472, iast_INACTIVE (440.376 µs) : 419, 462 . : milestone, 440, iast_TELEMETRY_OFF (470.781 µs) : 448, 493 . : milestone, 471, tracing (435.897 µs) : 415, 456 . : milestone, 436, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|366.603 µs [346.267 µs, 386.94 µs]|-| |iast|478.818 µs [457.648 µs, 499.989 µs]|112.215 µs (30.6%)| |iast_FULL|544.407 µs [523.068 µs, 565.746 µs]|177.804 µs (48.5%)| |iast_GLOBAL|500.056 µs [478.429 µs, 521.684 µs]|133.453 µs (36.4%)| |iast_HARDCODED_SECRET_DISABLED|471.764 µs [449.522 µs, 494.007 µs]|105.161 µs (28.7%)| |iast_INACTIVE|447.148 µs [425.155 µs, 469.141 µs]|80.545 µs (22.0%)| |iast_TELEMETRY_OFF|469.924 µs [447.351 µs, 492.497 µs]|103.321 µs (28.2%)| |tracing|429.222 µs [409.225 µs, 449.219 µs]|62.619 µs (17.1%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|364.741 µs [344.446 µs, 385.036 µs]|-| |iast|483.06 µs [460.36 µs, 505.761 µs]|118.319 µs (32.4%)| |iast_FULL|543.628 µs [522.77 µs, 564.485 µs]|178.887 µs (49.0%)| |iast_GLOBAL|506.93 µs [484.772 µs, 529.088 µs]|142.189 µs (39.0%)| |iast_HARDCODED_SECRET_DISABLED|472.162 µs [451.026 µs, 493.298 µs]|107.421 µs (29.5%)| |iast_INACTIVE|440.376 µs [418.612 µs, 462.14 µs]|75.635 µs (20.7%)| |iast_TELEMETRY_OFF|470.781 µs [448.129 µs, 493.434 µs]|106.04 µs (29.1%)| |tracing|435.897 µs [415.369 µs, 456.425 µs]|71.156 µs (19.5%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~fedacb5428, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section baseline no_agent (1.32 ms) : 1301, 1340 . : milestone, 1320, appsec (1.73 ms) : 1706, 1753 . : milestone, 1730, appsec_no_iast (1.718 ms) : 1694, 1742 . : milestone, 1718, iast (1.466 ms) : 1444, 1488 . : milestone, 1466, profiling (1.496 ms) : 1472, 1521 . : milestone, 1496, tracing (1.468 ms) : 1444, 1492 . : milestone, 1468, section candidate no_agent (1.338 ms) : 1319, 1358 . : milestone, 1338, appsec (1.697 ms) : 1673, 1722 . : milestone, 1697, appsec_no_iast (1.715 ms) : 1691, 1740 . : milestone, 1715, iast (1.459 ms) : 1436, 1481 . : milestone, 1459, profiling (1.502 ms) : 1478, 1527 . : milestone, 1502, tracing (1.453 ms) : 1428, 1478 . : milestone, 1453, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.32 ms [1.301 ms, 1.34 ms]|-| |appsec|1.73 ms [1.706 ms, 1.753 ms]|409.578 µs (31.0%)| |appsec_no_iast|1.718 ms [1.694 ms, 1.742 ms]|398.178 µs (30.2%)| |iast|1.466 ms [1.444 ms, 1.488 ms]|145.973 µs (11.1%)| |profiling|1.496 ms [1.472 ms, 1.521 ms]|176.369 µs (13.4%)| |tracing|1.468 ms [1.444 ms, 1.492 ms]|148.166 µs (11.2%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.338 ms [1.319 ms, 1.358 ms]|-| |appsec|1.697 ms [1.673 ms, 1.722 ms]|358.905 µs (26.8%)| |appsec_no_iast|1.715 ms [1.691 ms, 1.74 ms]|376.972 µs (28.2%)| |iast|1.459 ms [1.436 ms, 1.481 ms]|120.213 µs (9.0%)| |profiling|1.502 ms [1.478 ms, 1.527 ms]|164.046 µs (12.3%)| |tracing|1.453 ms [1.428 ms, 1.478 ms]|114.755 µs (8.6%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/gradle-caches
git_commit_date 1725887583 1725890073
git_commit_sha 3fd417447a fedacb5428
release_version 1.40.0-SNAPSHOT~3fd417447a 1.40.0-SNAPSHOT~fedacb5428
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1725891972 |1725891972 | |ci_job_id |631990189 |631990189 | |ci_pipeline_id|43858586 |43858586 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~fedacb5428, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section baseline no_agent (14.972 s) : 14972000, 14972000 . : milestone, 14972000, appsec (15.039 s) : 15039000, 15039000 . : milestone, 15039000, iast (18.844 s) : 18844000, 18844000 . : milestone, 18844000, iast_GLOBAL (17.785 s) : 17785000, 17785000 . : milestone, 17785000, profiling (15.879 s) : 15879000, 15879000 . : milestone, 15879000, tracing (15.223 s) : 15223000, 15223000 . : milestone, 15223000, section candidate no_agent (15.024 s) : 15024000, 15024000 . : milestone, 15024000, appsec (15.157 s) : 15157000, 15157000 . : milestone, 15157000, iast (18.931 s) : 18931000, 18931000 . : milestone, 18931000, iast_GLOBAL (18.013 s) : 18013000, 18013000 . : milestone, 18013000, profiling (15.421 s) : 15421000, 15421000 . : milestone, 15421000, tracing (15.255 s) : 15255000, 15255000 . : milestone, 15255000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.972 s [14.972 s, 14.972 s]|-| |appsec|15.039 s [15.039 s, 15.039 s]|67.0 ms (0.4%)| |iast|18.844 s [18.844 s, 18.844 s]|3.872 s (25.9%)| |iast_GLOBAL|17.785 s [17.785 s, 17.785 s]|2.813 s (18.8%)| |profiling|15.879 s [15.879 s, 15.879 s]|907.0 ms (6.1%)| |tracing|15.223 s [15.223 s, 15.223 s]|251.0 ms (1.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.024 s [15.024 s, 15.024 s]|-| |appsec|15.157 s [15.157 s, 15.157 s]|133.0 ms (0.9%)| |iast|18.931 s [18.931 s, 18.931 s]|3.907 s (26.0%)| |iast_GLOBAL|18.013 s [18.013 s, 18.013 s]|2.989 s (19.9%)| |profiling|15.421 s [15.421 s, 15.421 s]|397.0 ms (2.6%)| |tracing|15.255 s [15.255 s, 15.255 s]|231.0 ms (1.5%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~fedacb5428, baseline=1.40.0-SNAPSHOT~3fd417447a dateFormat X axisFormat %s section baseline no_agent (1.457 ms) : 1446, 1469 . : milestone, 1457, appsec (2.205 ms) : 2171, 2240 . : milestone, 2205, iast (1.986 ms) : 1942, 2030 . : milestone, 1986, iast_GLOBAL (2.021 ms) : 1977, 2066 . : milestone, 2021, profiling (1.852 ms) : 1818, 1887 . : milestone, 1852, tracing (1.834 ms) : 1801, 1867 . : milestone, 1834, section candidate no_agent (1.458 ms) : 1446, 1469 . : milestone, 1458, appsec (2.208 ms) : 2173, 2243 . : milestone, 2208, iast (1.952 ms) : 1910, 1994 . : milestone, 1952, iast_GLOBAL (2.016 ms) : 1972, 2060 . : milestone, 2016, profiling (1.845 ms) : 1811, 1879 . : milestone, 1845, tracing (1.831 ms) : 1798, 1864 . : milestone, 1831, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.457 ms [1.446 ms, 1.469 ms]|-| |appsec|2.205 ms [2.171 ms, 2.24 ms]|748.155 µs (51.3%)| |iast|1.986 ms [1.942 ms, 2.03 ms]|528.714 µs (36.3%)| |iast_GLOBAL|2.021 ms [1.977 ms, 2.066 ms]|563.966 µs (38.7%)| |profiling|1.852 ms [1.818 ms, 1.887 ms]|394.914 µs (27.1%)| |tracing|1.834 ms [1.801 ms, 1.867 ms]|377.072 µs (25.9%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.458 ms [1.446 ms, 1.469 ms]|-| |appsec|2.208 ms [2.173 ms, 2.243 ms]|750.124 µs (51.5%)| |iast|1.952 ms [1.91 ms, 1.994 ms]|494.315 µs (33.9%)| |iast_GLOBAL|2.016 ms [1.972 ms, 2.06 ms]|558.416 µs (38.3%)| |profiling|1.845 ms [1.811 ms, 1.879 ms]|386.885 µs (26.5%)| |tracing|1.831 ms [1.798 ms, 1.864 ms]|373.558 µs (25.6%)|