DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Throw exception when using repo index to resolve source path for classes with identical names #7805

Closed nikita-tkachenko-datadog closed 1 month ago

nikita-tkachenko-datadog commented 1 month ago

Duplicates #7793, merged by mistake

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7793
git_commit_date 1729245368 1729254380
git_commit_sha 52cdab0c9c e5f5e07d41
release_version 1.42.0-SNAPSHOT~52cdab0c9c 1.42.0-SNAPSHOT~e5f5e07d41
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729256801 |1729256801 | |ci_job_id |676764683 |676764683 | |ci_pipeline_id|46908692 |46908692 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 2 performance regressions! Performance is the same for 52 metrics, 9 unstable metrics.

scenario Δ mean execution_time candidate mean execution_time baseline mean execution_time
scenario:startup:petclinic:profiling:ProfilingAgent worse
[+4.695ms; +8.192ms] or [+5.207%; +9.085%]
96.610ms 90.167ms
scenario:startup:petclinic:profiling:Profiling worse
[+4.696ms; +8.195ms] or [+5.207%; +9.086%]
96.636ms 90.191ms
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section tracing Agent [baseline] (1.076 s) : 0, 1076210 Total [baseline] (8.521 s) : 0, 8521220 Agent [candidate] (1.071 s) : 0, 1070900 Total [candidate] (8.564 s) : 0, 8564323 section iast Agent [baseline] (1.201 s) : 0, 1200670 Total [baseline] (9.086 s) : 0, 9085606 Agent [candidate] (1.199 s) : 0, 1198924 Total [candidate] (9.087 s) : 0, 9087123 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.196 s) : 0, 1196214 Total [baseline] (9.072 s) : 0, 9072033 Agent [candidate] (1.197 s) : 0, 1197104 Total [candidate] (9.068 s) : 0, 9067559 section iast_TELEMETRY_OFF Agent [baseline] (1.196 s) : 0, 1195726 Total [baseline] (9.083 s) : 0, 9083275 Agent [candidate] (1.194 s) : 0, 1193842 Total [candidate] (9.063 s) : 0, 9063492 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.076 s |-| |Agent|iast|1.201 s |124.46 ms (11.6%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.196 s |120.004 ms (11.2%)| |Agent|iast_TELEMETRY_OFF|1.196 s |119.516 ms (11.1%)| |Total|tracing|8.521 s |-| |Total|iast|9.086 s |564.386 ms (6.6%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.072 s |550.814 ms (6.5%)| |Total|iast_TELEMETRY_OFF|9.083 s |562.055 ms (6.6%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.071 s |-| |Agent|iast|1.199 s |128.024 ms (12.0%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.197 s |126.204 ms (11.8%)| |Agent|iast_TELEMETRY_OFF|1.194 s |122.942 ms (11.5%)| |Total|tracing|8.564 s |-| |Total|iast|9.087 s |522.799 ms (6.1%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.068 s |503.236 ms (5.9%)| |Total|iast_TELEMETRY_OFF|9.063 s |499.169 ms (5.8%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (685.543 ms) : 0, 685543 BytebuddyAgent [candidate] (683.221 ms) : 0, 683221 GlobalTracer [baseline] (312.071 ms) : 0, 312071 GlobalTracer [candidate] (312.146 ms) : 0, 312146 AppSec [baseline] (53.945 ms) : 0, 53945 AppSec [candidate] (53.83 ms) : 0, 53830 Remote Config [baseline] (661.229 µs) : 0, 661 Remote Config [candidate] (660.095 µs) : 0, 660 Telemetry [baseline] (10.412 ms) : 0, 10412 Telemetry [candidate] (7.434 ms) : 0, 7434 section iast BytebuddyAgent [baseline] (800.211 ms) : 0, 800211 BytebuddyAgent [candidate] (798.295 ms) : 0, 798295 GlobalTracer [baseline] (300.814 ms) : 0, 300814 GlobalTracer [candidate] (301.289 ms) : 0, 301289 AppSec [baseline] (56.395 ms) : 0, 56395 AppSec [candidate] (56.894 ms) : 0, 56894 IAST [baseline] (21.925 ms) : 0, 21925 IAST [candidate] (21.11 ms) : 0, 21110 Remote Config [baseline] (613.485 µs) : 0, 613 Remote Config [candidate] (592.78 µs) : 0, 593 Telemetry [baseline] (7.091 ms) : 0, 7091 Telemetry [candidate] (7.064 ms) : 0, 7064 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (797.221 ms) : 0, 797221 BytebuddyAgent [candidate] (797.087 ms) : 0, 797087 GlobalTracer [baseline] (300.154 ms) : 0, 300154 GlobalTracer [candidate] (300.762 ms) : 0, 300762 AppSec [baseline] (57.655 ms) : 0, 57655 AppSec [candidate] (56.024 ms) : 0, 56024 IAST [baseline] (20.036 ms) : 0, 20036 IAST [candidate] (22.0 ms) : 0, 22000 Remote Config [baseline] (593.451 µs) : 0, 593 Remote Config [candidate] (602.167 µs) : 0, 602 Telemetry [baseline] (7.006 ms) : 0, 7006 Telemetry [candidate] (7.011 ms) : 0, 7011 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (796.087 ms) : 0, 796087 BytebuddyAgent [candidate] (793.943 ms) : 0, 793943 GlobalTracer [baseline] (301.182 ms) : 0, 301182 GlobalTracer [candidate] (300.968 ms) : 0, 300968 AppSec [baseline] (57.578 ms) : 0, 57578 AppSec [candidate] (56.162 ms) : 0, 56162 IAST [baseline] (19.767 ms) : 0, 19767 IAST [candidate] (21.576 ms) : 0, 21576 Remote Config [baseline] (591.649 µs) : 0, 592 Remote Config [candidate] (595.606 µs) : 0, 596 Telemetry [baseline] (6.902 ms) : 0, 6902 Telemetry [candidate] (6.933 ms) : 0, 6933 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section tracing Agent [baseline] (1.075 s) : 0, 1074728 Total [baseline] (10.337 s) : 0, 10337471 Agent [candidate] (1.07 s) : 0, 1070131 Total [candidate] (10.397 s) : 0, 10396744 section appsec Agent [baseline] (1.217 s) : 0, 1216566 Total [baseline] (10.58 s) : 0, 10579629 Agent [candidate] (1.207 s) : 0, 1207135 Total [candidate] (10.573 s) : 0, 10572687 section iast Agent [baseline] (1.197 s) : 0, 1197456 Total [baseline] (10.799 s) : 0, 10798988 Agent [candidate] (1.2 s) : 0, 1199672 Total [candidate] (10.916 s) : 0, 10915835 section profiling Agent [baseline] (1.271 s) : 0, 1271486 Total [baseline] (10.687 s) : 0, 10687286 Agent [candidate] (1.271 s) : 0, 1270694 Total [candidate] (10.657 s) : 0, 10656995 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.075 s |-| |Agent|appsec|1.217 s |141.838 ms (13.2%)| |Agent|iast|1.197 s |122.728 ms (11.4%)| |Agent|profiling|1.271 s |196.758 ms (18.3%)| |Total|tracing|10.337 s |-| |Total|appsec|10.58 s |242.158 ms (2.3%)| |Total|iast|10.799 s |461.517 ms (4.5%)| |Total|profiling|10.687 s |349.814 ms (3.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.07 s |-| |Agent|appsec|1.207 s |137.004 ms (12.8%)| |Agent|iast|1.2 s |129.541 ms (12.1%)| |Agent|profiling|1.271 s |200.563 ms (18.7%)| |Total|tracing|10.397 s |-| |Total|appsec|10.573 s |175.942 ms (1.7%)| |Total|iast|10.916 s |519.091 ms (5.0%)| |Total|profiling|10.657 s |260.251 ms (2.5%)| ```mermaid gantt title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (684.293 ms) : 0, 684293 BytebuddyAgent [candidate] (682.604 ms) : 0, 682604 GlobalTracer [baseline] (311.98 ms) : 0, 311980 GlobalTracer [candidate] (311.887 ms) : 0, 311887 AppSec [baseline] (53.831 ms) : 0, 53831 AppSec [candidate] (53.946 ms) : 0, 53946 Remote Config [baseline] (671.123 µs) : 0, 671 Remote Config [candidate] (653.293 µs) : 0, 653 Telemetry [baseline] (10.359 ms) : 0, 10359 Telemetry [candidate] (7.427 ms) : 0, 7427 section appsec BytebuddyAgent [baseline] (706.74 ms) : 0, 706740 BytebuddyAgent [candidate] (701.447 ms) : 0, 701447 GlobalTracer [baseline] (311.462 ms) : 0, 311462 GlobalTracer [candidate] (309.55 ms) : 0, 309550 AppSec [baseline] (167.806 ms) : 0, 167806 AppSec [candidate] (163.675 ms) : 0, 163675 Remote Config [baseline] (637.953 µs) : 0, 638 Remote Config [candidate] (630.274 µs) : 0, 630 Telemetry [baseline] (7.029 ms) : 0, 7029 Telemetry [candidate] (8.512 ms) : 0, 8512 IAST [baseline] (18.451 ms) : 0, 18451 IAST [candidate] (19.355 ms) : 0, 19355 section iast BytebuddyAgent [baseline] (798.325 ms) : 0, 798325 BytebuddyAgent [candidate] (799.01 ms) : 0, 799010 GlobalTracer [baseline] (300.369 ms) : 0, 300369 GlobalTracer [candidate] (301.015 ms) : 0, 301015 AppSec [baseline] (57.087 ms) : 0, 57087 AppSec [candidate] (56.284 ms) : 0, 56284 Remote Config [baseline] (600.327 µs) : 0, 600 Remote Config [candidate] (603.06 µs) : 0, 603 Telemetry [baseline] (6.986 ms) : 0, 6986 Telemetry [candidate] (7.076 ms) : 0, 7076 IAST [baseline] (20.517 ms) : 0, 20517 IAST [candidate] (22.01 ms) : 0, 22010 section profiling BytebuddyAgent [baseline] (679.163 ms) : 0, 679163 BytebuddyAgent [candidate] (677.302 ms) : 0, 677302 GlobalTracer [baseline] (395.493 ms) : 0, 395493 GlobalTracer [candidate] (395.573 ms) : 0, 395573 AppSec [baseline] (54.485 ms) : 0, 54485 AppSec [candidate] (54.52 ms) : 0, 54520 Remote Config [baseline] (646.943 µs) : 0, 647 Remote Config [candidate] (647.805 µs) : 0, 648 Telemetry [baseline] (12.961 ms) : 0, 12961 Telemetry [candidate] (7.487 ms) : 0, 7487 ProfilingAgent [baseline] (90.167 ms) : 0, 90167 ProfilingAgent [candidate] (96.61 ms) : 0, 96610 Profiling [baseline] (90.191 ms) : 0, 90191 Profiling [candidate] (96.636 ms) : 0, 96636 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-18T12:37:15 2024-10-18T12:44:07
git_branch master nikita-tkachenko/backport-pr-7793
git_commit_date 1729245368 1729254380
git_commit_sha 52cdab0c9c e5f5e07d41
release_version 1.42.0-SNAPSHOT~52cdab0c9c 1.42.0-SNAPSHOT~e5f5e07d41
start_time 2024-10-18T12:37:01 2024-10-18T12:43:53
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729255795 |1729255795 | |ci_job_id |676764684 |676764684 | |ci_pipeline_id|46908692 |46908692 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 13 metrics, 15 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section baseline no_agent (372.762 µs) : 353, 392 . : milestone, 373, iast (492.979 µs) : 471, 514 . : milestone, 493, iast_FULL (553.304 µs) : 532, 574 . : milestone, 553, iast_GLOBAL (514.407 µs) : 493, 536 . : milestone, 514, iast_HARDCODED_SECRET_DISABLED (491.03 µs) : 470, 512 . : milestone, 491, iast_INACTIVE (455.739 µs) : 435, 477 . : milestone, 456, iast_TELEMETRY_OFF (480.915 µs) : 460, 502 . : milestone, 481, tracing (450.25 µs) : 430, 470 . : milestone, 450, section candidate no_agent (376.029 µs) : 356, 396 . : milestone, 376, iast (492.1 µs) : 471, 513 . : milestone, 492, iast_FULL (566.564 µs) : 545, 588 . : milestone, 567, iast_GLOBAL (506.859 µs) : 486, 528 . : milestone, 507, iast_HARDCODED_SECRET_DISABLED (496.966 µs) : 475, 519 . : milestone, 497, iast_INACTIVE (452.517 µs) : 432, 473 . : milestone, 453, iast_TELEMETRY_OFF (488.454 µs) : 466, 511 . : milestone, 488, tracing (451.238 µs) : 431, 472 . : milestone, 451, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|372.762 µs [353.453 µs, 392.071 µs]|-| |iast|492.979 µs [471.463 µs, 514.494 µs]|120.217 µs (32.3%)| |iast_FULL|553.304 µs [532.131 µs, 574.477 µs]|180.542 µs (48.4%)| |iast_GLOBAL|514.407 µs [493.016 µs, 535.798 µs]|141.645 µs (38.0%)| |iast_HARDCODED_SECRET_DISABLED|491.03 µs [469.582 µs, 512.478 µs]|118.268 µs (31.7%)| |iast_INACTIVE|455.739 µs [434.629 µs, 476.848 µs]|82.977 µs (22.3%)| |iast_TELEMETRY_OFF|480.915 µs [459.878 µs, 501.951 µs]|108.153 µs (29.0%)| |tracing|450.25 µs [430.013 µs, 470.487 µs]|77.489 µs (20.8%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|376.029 µs [356.481 µs, 395.577 µs]|-| |iast|492.1 µs [470.848 µs, 513.353 µs]|116.072 µs (30.9%)| |iast_FULL|566.564 µs [545.256 µs, 587.871 µs]|190.535 µs (50.7%)| |iast_GLOBAL|506.859 µs [485.763 µs, 527.954 µs]|130.83 µs (34.8%)| |iast_HARDCODED_SECRET_DISABLED|496.966 µs [475.359 µs, 518.572 µs]|120.937 µs (32.2%)| |iast_INACTIVE|452.517 µs [431.815 µs, 473.22 µs]|76.488 µs (20.3%)| |iast_TELEMETRY_OFF|488.454 µs [466.354 µs, 510.553 µs]|112.425 µs (29.9%)| |tracing|451.238 µs [430.781 µs, 471.696 µs]|75.209 µs (20.0%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section baseline no_agent (1.347 ms) : 1328, 1366 . : milestone, 1347, appsec (1.728 ms) : 1705, 1751 . : milestone, 1728, appsec_no_iast (1.724 ms) : 1700, 1747 . : milestone, 1724, iast (1.494 ms) : 1472, 1516 . : milestone, 1494, profiling (1.489 ms) : 1465, 1513 . : milestone, 1489, tracing (1.467 ms) : 1442, 1491 . : milestone, 1467, section candidate no_agent (1.323 ms) : 1304, 1342 . : milestone, 1323, appsec (1.721 ms) : 1697, 1746 . : milestone, 1721, appsec_no_iast (1.74 ms) : 1717, 1764 . : milestone, 1740, iast (1.499 ms) : 1476, 1522 . : milestone, 1499, profiling (1.523 ms) : 1500, 1547 . : milestone, 1523, tracing (1.452 ms) : 1428, 1476 . : milestone, 1452, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.347 ms [1.328 ms, 1.366 ms]|-| |appsec|1.728 ms [1.705 ms, 1.751 ms]|381.164 µs (28.3%)| |appsec_no_iast|1.724 ms [1.7 ms, 1.747 ms]|376.493 µs (28.0%)| |iast|1.494 ms [1.472 ms, 1.516 ms]|147.205 µs (10.9%)| |profiling|1.489 ms [1.465 ms, 1.513 ms]|141.851 µs (10.5%)| |tracing|1.467 ms [1.442 ms, 1.491 ms]|119.722 µs (8.9%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.323 ms [1.304 ms, 1.342 ms]|-| |appsec|1.721 ms [1.697 ms, 1.746 ms]|397.929 µs (30.1%)| |appsec_no_iast|1.74 ms [1.717 ms, 1.764 ms]|417.381 µs (31.5%)| |iast|1.499 ms [1.476 ms, 1.522 ms]|175.665 µs (13.3%)| |profiling|1.523 ms [1.5 ms, 1.547 ms]|200.357 µs (15.1%)| |tracing|1.452 ms [1.428 ms, 1.476 ms]|128.738 µs (9.7%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/backport-pr-7793
git_commit_date 1729245368 1729254380
git_commit_sha 52cdab0c9c e5f5e07d41
release_version 1.42.0-SNAPSHOT~52cdab0c9c 1.42.0-SNAPSHOT~e5f5e07d41
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1729256337 |1729256337 | |ci_job_id |676764685 |676764685 | |ci_pipeline_id|46908692 |46908692 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section baseline no_agent (15.778 s) : 15778000, 15778000 . : milestone, 15778000, appsec (15.481 s) : 15481000, 15481000 . : milestone, 15481000, iast (18.782 s) : 18782000, 18782000 . : milestone, 18782000, iast_GLOBAL (17.873 s) : 17873000, 17873000 . : milestone, 17873000, profiling (15.13 s) : 15130000, 15130000 . : milestone, 15130000, tracing (15.209 s) : 15209000, 15209000 . : milestone, 15209000, section candidate no_agent (15.039 s) : 15039000, 15039000 . : milestone, 15039000, appsec (15.264 s) : 15264000, 15264000 . : milestone, 15264000, iast (18.889 s) : 18889000, 18889000 . : milestone, 18889000, iast_GLOBAL (17.912 s) : 17912000, 17912000 . : milestone, 17912000, profiling (15.275 s) : 15275000, 15275000 . : milestone, 15275000, tracing (14.949 s) : 14949000, 14949000 . : milestone, 14949000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.778 s [15.778 s, 15.778 s]|-| |appsec|15.481 s [15.481 s, 15.481 s]|-297.0 ms (-1.9%)| |iast|18.782 s [18.782 s, 18.782 s]|3.004 s (19.0%)| |iast_GLOBAL|17.873 s [17.873 s, 17.873 s]|2.095 s (13.3%)| |profiling|15.13 s [15.13 s, 15.13 s]|-648.0 ms (-4.1%)| |tracing|15.209 s [15.209 s, 15.209 s]|-569.0 ms (-3.6%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.039 s [15.039 s, 15.039 s]|-| |appsec|15.264 s [15.264 s, 15.264 s]|225.0 ms (1.5%)| |iast|18.889 s [18.889 s, 18.889 s]|3.85 s (25.6%)| |iast_GLOBAL|17.912 s [17.912 s, 17.912 s]|2.873 s (19.1%)| |profiling|15.275 s [15.275 s, 15.275 s]|236.0 ms (1.6%)| |tracing|14.949 s [14.949 s, 14.949 s]|-90.0 ms (-0.6%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~e5f5e07d41, baseline=1.42.0-SNAPSHOT~52cdab0c9c dateFormat X axisFormat %s section baseline no_agent (1.468 ms) : 1456, 1480 . : milestone, 1468, appsec (2.323 ms) : 2282, 2364 . : milestone, 2323, iast (2.084 ms) : 2032, 2136 . : milestone, 2084, iast_GLOBAL (2.115 ms) : 2063, 2167 . : milestone, 2115, profiling (1.947 ms) : 1905, 1990 . : milestone, 1947, tracing (1.916 ms) : 1876, 1956 . : milestone, 1916, section candidate no_agent (1.463 ms) : 1452, 1474 . : milestone, 1463, appsec (2.319 ms) : 2278, 2359 . : milestone, 2319, iast (2.074 ms) : 2022, 2125 . : milestone, 2074, iast_GLOBAL (2.117 ms) : 2064, 2169 . : milestone, 2117, profiling (1.942 ms) : 1900, 1984 . : milestone, 1942, tracing (1.91 ms) : 1871, 1949 . : milestone, 1910, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.468 ms [1.456 ms, 1.48 ms]|-| |appsec|2.323 ms [2.282 ms, 2.364 ms]|855.408 µs (58.3%)| |iast|2.084 ms [2.032 ms, 2.136 ms]|615.844 µs (42.0%)| |iast_GLOBAL|2.115 ms [2.063 ms, 2.167 ms]|646.882 µs (44.1%)| |profiling|1.947 ms [1.905 ms, 1.99 ms]|479.473 µs (32.7%)| |tracing|1.916 ms [1.876 ms, 1.956 ms]|448.108 µs (30.5%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.463 ms [1.452 ms, 1.474 ms]|-| |appsec|2.319 ms [2.278 ms, 2.359 ms]|855.645 µs (58.5%)| |iast|2.074 ms [2.022 ms, 2.125 ms]|610.754 µs (41.7%)| |iast_GLOBAL|2.117 ms [2.064 ms, 2.169 ms]|653.656 µs (44.7%)| |profiling|1.942 ms [1.9 ms, 1.984 ms]|479.111 µs (32.7%)| |tracing|1.91 ms [1.871 ms, 1.949 ms]|447.094 µs (30.6%)|