search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
572 stars 284 forks source link

[debug] add iast_NO_SAMPLING benchmark variant #7593

Closed smola closed 1 week ago

smola commented 2 weeks ago

What Does This Do

Motivation

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 2 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/iast-no-sampling-bench
git_commit_date 1726045162 1726048048
git_commit_sha 9a35dac495 e74f54b565
release_version 1.40.0-SNAPSHOT~9a35dac495 1.40.0-SNAPSHOT~e74f54b565
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726050306 |1726050306 | |ci_job_id |635139264 |635139264 | |ci_pipeline_id|44056668 |44056668 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics.

Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~e74f54b565, baseline=1.40.0-SNAPSHOT~9a35dac495 dateFormat X axisFormat %s section tracing Agent [baseline] (1.067 s) : 0, 1067013 Total [baseline] (8.505 s) : 0, 8505347 Agent [candidate] (1.062 s) : 0, 1062237 Total [candidate] (8.49 s) : 0, 8489976 section iast Agent [baseline] (1.204 s) : 0, 1203777 Total [baseline] (9.016 s) : 0, 9015586 Agent [candidate] (1.187 s) : 0, 1187106 Total [candidate] (9.016 s) : 0, 9015795 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.186 s) : 0, 1185737 Total [baseline] (8.972 s) : 0, 8972199 Agent [candidate] (1.189 s) : 0, 1188795 Total [candidate] (8.952 s) : 0, 8951664 section iast_TELEMETRY_OFF Agent [baseline] (1.184 s) : 0, 1183675 Total [baseline] (8.959 s) : 0, 8959418 Agent [candidate] (1.188 s) : 0, 1188233 Total [candidate] (8.986 s) : 0, 8986124 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.067 s |-| |Agent|iast|1.204 s |136.763 ms (12.8%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.186 s |118.724 ms (11.1%)| |Agent|iast_TELEMETRY_OFF|1.184 s |116.662 ms (10.9%)| |Total|tracing|8.505 s |-| |Total|iast|9.016 s |510.238 ms (6.0%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.972 s |466.852 ms (5.5%)| |Total|iast_TELEMETRY_OFF|8.959 s |454.07 ms (5.3%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.062 s |-| |Agent|iast|1.187 s |124.869 ms (11.8%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.189 s |126.558 ms (11.9%)| |Agent|iast_TELEMETRY_OFF|1.188 s |125.996 ms (11.9%)| |Total|tracing|8.49 s |-| |Total|iast|9.016 s |525.82 ms (6.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.952 s |461.689 ms (5.4%)| |Total|iast_TELEMETRY_OFF|8.986 s |496.148 ms (5.8%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~e74f54b565, baseline=1.40.0-SNAPSHOT~9a35dac495 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (682.338 ms) : 0, 682338 BytebuddyAgent [candidate] (678.729 ms) : 0, 678729 GlobalTracer [baseline] (310.829 ms) : 0, 310829 GlobalTracer [candidate] (310.155 ms) : 0, 310155 AppSec [baseline] (51.977 ms) : 0, 51977 AppSec [candidate] (51.573 ms) : 0, 51573 Remote Config [baseline] (705.092 µs) : 0, 705 Remote Config [candidate] (706.044 µs) : 0, 706 Telemetry [baseline] (7.504 ms) : 0, 7504 Telemetry [candidate] (7.499 ms) : 0, 7499 section iast BytebuddyAgent [baseline] (802.363 ms) : 0, 802363 BytebuddyAgent [candidate] (790.356 ms) : 0, 790356 GlobalTracer [baseline] (302.097 ms) : 0, 302097 GlobalTracer [candidate] (298.618 ms) : 0, 298618 AppSec [baseline] (51.887 ms) : 0, 51887 AppSec [candidate] (52.105 ms) : 0, 52105 Remote Config [baseline] (609.736 µs) : 0, 610 Remote Config [candidate] (1.356 ms) : 0, 1356 Telemetry [baseline] (7.421 ms) : 0, 7421 Telemetry [candidate] (7.36 ms) : 0, 7360 IAST [baseline] (25.622 ms) : 0, 25622 IAST [candidate] (23.698 ms) : 0, 23698 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (788.759 ms) : 0, 788759 BytebuddyAgent [candidate] (791.094 ms) : 0, 791094 GlobalTracer [baseline] (298.604 ms) : 0, 298604 GlobalTracer [candidate] (299.338 ms) : 0, 299338 AppSec [baseline] (52.556 ms) : 0, 52556 AppSec [candidate] (52.421 ms) : 0, 52421 Remote Config [baseline] (603.445 µs) : 0, 603 Remote Config [candidate] (593.857 µs) : 0, 594 Telemetry [baseline] (7.305 ms) : 0, 7305 Telemetry [candidate] (7.29 ms) : 0, 7290 IAST [baseline] (24.321 ms) : 0, 24321 IAST [candidate] (24.407 ms) : 0, 24407 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (787.117 ms) : 0, 787117 BytebuddyAgent [candidate] (789.094 ms) : 0, 789094 GlobalTracer [baseline] (298.589 ms) : 0, 298589 GlobalTracer [candidate] (300.709 ms) : 0, 300709 AppSec [baseline] (53.337 ms) : 0, 53337 AppSec [candidate] (52.734 ms) : 0, 52734 Remote Config [baseline] (600.201 µs) : 0, 600 Remote Config [candidate] (608.4 µs) : 0, 608 Telemetry [baseline] (7.271 ms) : 0, 7271 Telemetry [candidate] (8.085 ms) : 0, 8085 IAST [baseline] (23.18 ms) : 0, 23180 IAST [candidate] (23.334 ms) : 0, 23334 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~e74f54b565, baseline=1.40.0-SNAPSHOT~9a35dac495 dateFormat X axisFormat %s section tracing Agent [baseline] (1.074 s) : 0, 1073850 Total [baseline] (10.441 s) : 0, 10441049 Agent [candidate] (1.064 s) : 0, 1064096 Total [candidate] (10.33 s) : 0, 10329624 section appsec Agent [baseline] (1.196 s) : 0, 1196304 Total [baseline] (10.571 s) : 0, 10571190 Agent [candidate] (1.192 s) : 0, 1192492 Total [candidate] (10.572 s) : 0, 10571693 section iast Agent [baseline] (1.187 s) : 0, 1187302 Total [baseline] (10.835 s) : 0, 10835282 Agent [candidate] (1.187 s) : 0, 1187497 Total [candidate] (10.815 s) : 0, 10814528 section profiling Agent [baseline] (1.258 s) : 0, 1258420 Total [baseline] (10.591 s) : 0, 10591173 Agent [candidate] (1.267 s) : 0, 1266761 Total [candidate] (10.612 s) : 0, 10612073 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.074 s |-| |Agent|appsec|1.196 s |122.454 ms (11.4%)| |Agent|iast|1.187 s |113.452 ms (10.6%)| |Agent|profiling|1.258 s |184.57 ms (17.2%)| |Total|tracing|10.441 s |-| |Total|appsec|10.571 s |130.141 ms (1.2%)| |Total|iast|10.835 s |394.233 ms (3.8%)| |Total|profiling|10.591 s |150.124 ms (1.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.064 s |-| |Agent|appsec|1.192 s |128.396 ms (12.1%)| |Agent|iast|1.187 s |123.401 ms (11.6%)| |Agent|profiling|1.267 s |202.665 ms (19.0%)| |Total|tracing|10.33 s |-| |Total|appsec|10.572 s |242.069 ms (2.3%)| |Total|iast|10.815 s |484.904 ms (4.7%)| |Total|profiling|10.612 s |282.448 ms (2.7%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~e74f54b565, baseline=1.40.0-SNAPSHOT~9a35dac495 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (684.934 ms) : 0, 684934 BytebuddyAgent [candidate] (679.681 ms) : 0, 679681 GlobalTracer [baseline] (314.632 ms) : 0, 314632 GlobalTracer [candidate] (310.691 ms) : 0, 310691 AppSec [baseline] (52.333 ms) : 0, 52333 AppSec [candidate] (51.837 ms) : 0, 51837 Remote Config [baseline] (719.307 µs) : 0, 719 Remote Config [candidate] (718.152 µs) : 0, 718 Telemetry [baseline] (7.585 ms) : 0, 7585 Telemetry [candidate] (7.573 ms) : 0, 7573 section appsec BytebuddyAgent [baseline] (699.049 ms) : 0, 699049 BytebuddyAgent [candidate] (696.66 ms) : 0, 696660 GlobalTracer [baseline] (303.192 ms) : 0, 303192 GlobalTracer [candidate] (302.043 ms) : 0, 302043 AppSec [baseline] (161.549 ms) : 0, 161549 AppSec [candidate] (159.188 ms) : 0, 159188 Remote Config [baseline] (647.506 µs) : 0, 648 Remote Config [candidate] (645.255 µs) : 0, 645 Telemetry [baseline] (7.934 ms) : 0, 7934 Telemetry [candidate] (9.307 ms) : 0, 9307 IAST [baseline] (20.681 ms) : 0, 20681 IAST [candidate] (22.19 ms) : 0, 22190 section iast BytebuddyAgent [baseline] (790.39 ms) : 0, 790390 BytebuddyAgent [candidate] (790.557 ms) : 0, 790557 GlobalTracer [baseline] (298.555 ms) : 0, 298555 GlobalTracer [candidate] (298.844 ms) : 0, 298844 AppSec [baseline] (52.275 ms) : 0, 52275 AppSec [candidate] (52.242 ms) : 0, 52242 Remote Config [baseline] (673.459 µs) : 0, 673 Remote Config [candidate] (628.46 µs) : 0, 628 Telemetry [baseline] (7.331 ms) : 0, 7331 Telemetry [candidate] (7.28 ms) : 0, 7280 IAST [baseline] (24.482 ms) : 0, 24482 IAST [candidate] (24.375 ms) : 0, 24375 section profiling ProfilingAgent [baseline] (95.299 ms) : 0, 95299 ProfilingAgent [candidate] (96.598 ms) : 0, 96598 BytebuddyAgent [baseline] (672.327 ms) : 0, 672327 BytebuddyAgent [candidate] (676.617 ms) : 0, 676617 GlobalTracer [baseline] (392.586 ms) : 0, 392586 GlobalTracer [candidate] (394.586 ms) : 0, 394586 AppSec [baseline] (52.222 ms) : 0, 52222 AppSec [candidate] (52.542 ms) : 0, 52542 Remote Config [baseline] (707.592 µs) : 0, 708 Remote Config [candidate] (713.653 µs) : 0, 714 Telemetry [baseline] (7.398 ms) : 0, 7398 Telemetry [candidate] (7.467 ms) : 0, 7467 Profiling [baseline] (95.323 ms) : 0, 95323 Profiling [candidate] (96.622 ms) : 0, 96622 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-11T09:57:36 2024-09-11T10:05:31
git_branch master smola/iast-no-sampling-bench
git_commit_date 1726045162 1726048048
git_commit_sha 9a35dac495 e74f54b565
release_version 1.40.0-SNAPSHOT~9a35dac495 1.40.0-SNAPSHOT~e74f54b565
start_time 2024-09-11T09:57:23 2024-09-11T10:05:18
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726049540 |1726049540 | |ci_job_id |635139265 |635139265 | |ci_pipeline_id|44056668 |44056668 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 14 metrics, 18 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~e74f54b565, baseline=1.40.0-SNAPSHOT~9a35dac495 dateFormat X axisFormat %s section baseline no_agent (1.356 ms) : 1337, 1375 . : milestone, 1356, appsec (1.724 ms) : 1699, 1748 . : milestone, 1724, appsec_no_iast (1.724 ms) : 1699, 1748 . : milestone, 1724, iast (1.481 ms) : 1458, 1504 . : milestone, 1481, iast_no-sampling (1.477 ms) : 1454, 1500 . : milestone, 1477, profiling (1.489 ms) : 1465, 1513 . : milestone, 1489, tracing (1.505 ms) : 1481, 1529 . : milestone, 1505, section candidate no_agent (1.343 ms) : 1324, 1362 . : milestone, 1343, appsec (1.722 ms) : 1699, 1745 . : milestone, 1722, appsec_no_iast (1.722 ms) : 1699, 1746 . : milestone, 1722, iast (1.493 ms) : 1471, 1515 . : milestone, 1493, iast_no-sampling (1.485 ms) : 1462, 1508 . : milestone, 1485, profiling (1.496 ms) : 1471, 1520 . : milestone, 1496, tracing (1.481 ms) : 1457, 1504 . : milestone, 1481, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.356 ms [1.337 ms, 1.375 ms]|-| |appsec|1.724 ms [1.699 ms, 1.748 ms]|367.64 µs (27.1%)| |appsec_no_iast|1.724 ms [1.699 ms, 1.748 ms]|367.599 µs (27.1%)| |iast|1.481 ms [1.458 ms, 1.504 ms]|124.577 µs (9.2%)| |iast_no-sampling|1.477 ms [1.454 ms, 1.5 ms]|121.233 µs (8.9%)| |profiling|1.489 ms [1.465 ms, 1.513 ms]|132.631 µs (9.8%)| |tracing|1.505 ms [1.481 ms, 1.529 ms]|148.827 µs (11.0%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.343 ms [1.324 ms, 1.362 ms]|-| |appsec|1.722 ms [1.699 ms, 1.745 ms]|378.934 µs (28.2%)| |appsec_no_iast|1.722 ms [1.699 ms, 1.746 ms]|379.488 µs (28.3%)| |iast|1.493 ms [1.471 ms, 1.515 ms]|149.675 µs (11.1%)| |iast_no-sampling|1.485 ms [1.462 ms, 1.508 ms]|141.747 µs (10.6%)| |profiling|1.496 ms [1.471 ms, 1.52 ms]|152.585 µs (11.4%)| |tracing|1.481 ms [1.457 ms, 1.504 ms]|137.685 µs (10.3%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~e74f54b565, baseline=1.40.0-SNAPSHOT~9a35dac495 dateFormat X axisFormat %s section baseline no_agent (372.512 µs) : 353, 392 . : milestone, 373, iast (485.731 µs) : 464, 507 . : milestone, 486, iast_FULL (556.537 µs) : 535, 578 . : milestone, 557, iast_GLOBAL (523.098 µs) : 500, 546 . : milestone, 523, iast_HARDCODED_SECRET_DISABLED (489.459 µs) : 468, 511 . : milestone, 489, iast_INACTIVE (448.736 µs) : 428, 469 . : milestone, 449, iast_NO_SAMPLING (507.755 µs) : 486, 529 . : milestone, 508, iast_TELEMETRY_OFF (480.534 µs) : 458, 503 . : milestone, 481, tracing (449.646 µs) : 429, 470 . : milestone, 450, section candidate no_agent (379.798 µs) : 359, 400 . : milestone, 380, iast (483.979 µs) : 463, 505 . : milestone, 484, iast_FULL (554.378 µs) : 533, 576 . : milestone, 554, iast_GLOBAL (511.296 µs) : 489, 533 . : milestone, 511, iast_HARDCODED_SECRET_DISABLED (485.265 µs) : 464, 507 . : milestone, 485, iast_INACTIVE (450.982 µs) : 430, 472 . : milestone, 451, iast_NO_SAMPLING (512.156 µs) : 491, 534 . : milestone, 512, iast_TELEMETRY_OFF (479.892 µs) : 457, 503 . : milestone, 480, tracing (448.831 µs) : 428, 469 . : milestone, 449, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|372.512 µs [353.237 µs, 391.787 µs]|-| |iast|485.731 µs [464.165 µs, 507.297 µs]|113.218 µs (30.4%)| |iast_FULL|556.537 µs [535.317 µs, 577.758 µs]|184.025 µs (49.4%)| |iast_GLOBAL|523.098 µs [500.161 µs, 546.035 µs]|150.585 µs (40.4%)| |iast_HARDCODED_SECRET_DISABLED|489.459 µs [467.853 µs, 511.065 µs]|116.947 µs (31.4%)| |iast_INACTIVE|448.736 µs [428.258 µs, 469.214 µs]|76.223 µs (20.5%)| |iast_NO_SAMPLING|507.755 µs [486.258 µs, 529.253 µs]|135.243 µs (36.3%)| |iast_TELEMETRY_OFF|480.534 µs [457.694 µs, 503.375 µs]|108.022 µs (29.0%)| |tracing|449.646 µs [429.156 µs, 470.136 µs]|77.134 µs (20.7%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|379.798 µs [359.149 µs, 400.447 µs]|-| |iast|483.979 µs [462.869 µs, 505.089 µs]|104.181 µs (27.4%)| |iast_FULL|554.378 µs [533.126 µs, 575.629 µs]|174.58 µs (46.0%)| |iast_GLOBAL|511.296 µs [489.223 µs, 533.369 µs]|131.498 µs (34.6%)| |iast_HARDCODED_SECRET_DISABLED|485.265 µs [463.558 µs, 506.972 µs]|105.467 µs (27.8%)| |iast_INACTIVE|450.982 µs [429.865 µs, 472.1 µs]|71.184 µs (18.7%)| |iast_NO_SAMPLING|512.156 µs [490.641 µs, 533.672 µs]|132.358 µs (34.8%)| |iast_TELEMETRY_OFF|479.892 µs [456.722 µs, 503.062 µs]|100.094 µs (26.4%)| |tracing|448.831 µs [428.485 µs, 469.177 µs]|69.033 µs (18.2%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/iast-no-sampling-bench
git_commit_date 1726045162 1726048048
git_commit_sha 9a35dac495 e74f54b565
release_version 1.40.0-SNAPSHOT~9a35dac495 1.40.0-SNAPSHOT~e74f54b565
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1726049938 |1726049938 | |ci_job_id |635139266 |635139266 | |ci_pipeline_id|44056668 |44056668 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~e74f54b565, baseline=1.40.0-SNAPSHOT~9a35dac495 dateFormat X axisFormat %s section baseline no_agent (15.309 s) : 15309000, 15309000 . : milestone, 15309000, appsec (15.147 s) : 15147000, 15147000 . : milestone, 15147000, iast (19.158 s) : 19158000, 19158000 . : milestone, 19158000, iast_GLOBAL (18.073 s) : 18073000, 18073000 . : milestone, 18073000, profiling (15.797 s) : 15797000, 15797000 . : milestone, 15797000, tracing (15.126 s) : 15126000, 15126000 . : milestone, 15126000, section candidate no_agent (15.457 s) : 15457000, 15457000 . : milestone, 15457000, appsec (15.015 s) : 15015000, 15015000 . : milestone, 15015000, iast (18.74 s) : 18740000, 18740000 . : milestone, 18740000, iast_GLOBAL (18.132 s) : 18132000, 18132000 . : milestone, 18132000, profiling (15.437 s) : 15437000, 15437000 . : milestone, 15437000, tracing (15.109 s) : 15109000, 15109000 . : milestone, 15109000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.309 s [15.309 s, 15.309 s]|-| |appsec|15.147 s [15.147 s, 15.147 s]|-162.0 ms (-1.1%)| |iast|19.158 s [19.158 s, 19.158 s]|3.849 s (25.1%)| |iast_GLOBAL|18.073 s [18.073 s, 18.073 s]|2.764 s (18.1%)| |profiling|15.797 s [15.797 s, 15.797 s]|488.0 ms (3.2%)| |tracing|15.126 s [15.126 s, 15.126 s]|-183.0 ms (-1.2%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.457 s [15.457 s, 15.457 s]|-| |appsec|15.015 s [15.015 s, 15.015 s]|-442.0 ms (-2.9%)| |iast|18.74 s [18.74 s, 18.74 s]|3.283 s (21.2%)| |iast_GLOBAL|18.132 s [18.132 s, 18.132 s]|2.675 s (17.3%)| |profiling|15.437 s [15.437 s, 15.437 s]|-20.0 ms (-0.1%)| |tracing|15.109 s [15.109 s, 15.109 s]|-348.0 ms (-2.3%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~e74f54b565, baseline=1.40.0-SNAPSHOT~9a35dac495 dateFormat X axisFormat %s section baseline no_agent (1.461 ms) : 1449, 1472 . : milestone, 1461, appsec (2.286 ms) : 2245, 2327 . : milestone, 2286, iast (2.033 ms) : 1984, 2081 . : milestone, 2033, iast_GLOBAL (2.087 ms) : 2037, 2137 . : milestone, 2087, profiling (1.917 ms) : 1876, 1958 . : milestone, 1917, tracing (1.906 ms) : 1867, 1945 . : milestone, 1906, section candidate no_agent (1.471 ms) : 1459, 1483 . : milestone, 1471, appsec (2.297 ms) : 2256, 2339 . : milestone, 2297, iast (2.028 ms) : 1980, 2076 . : milestone, 2028, iast_GLOBAL (2.093 ms) : 2042, 2145 . : milestone, 2093, profiling (1.923 ms) : 1884, 1963 . : milestone, 1923, tracing (1.901 ms) : 1862, 1940 . : milestone, 1901, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.461 ms [1.449 ms, 1.472 ms]|-| |appsec|2.286 ms [2.245 ms, 2.327 ms]|825.624 µs (56.5%)| |iast|2.033 ms [1.984 ms, 2.081 ms]|572.081 µs (39.2%)| |iast_GLOBAL|2.087 ms [2.037 ms, 2.137 ms]|626.549 µs (42.9%)| |profiling|1.917 ms [1.876 ms, 1.958 ms]|456.678 µs (31.3%)| |tracing|1.906 ms [1.867 ms, 1.945 ms]|445.57 µs (30.5%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.471 ms [1.459 ms, 1.483 ms]|-| |appsec|2.297 ms [2.256 ms, 2.339 ms]|826.442 µs (56.2%)| |iast|2.028 ms [1.98 ms, 2.076 ms]|556.906 µs (37.9%)| |iast_GLOBAL|2.093 ms [2.042 ms, 2.145 ms]|622.534 µs (42.3%)| |profiling|1.923 ms [1.884 ms, 1.963 ms]|452.42 µs (30.8%)| |tracing|1.901 ms [1.862 ms, 1.94 ms]|430.296 µs (29.3%)|