search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
572 stars 284 forks source link

Retry JettyServlet3TestAsyncDispatchOnAsyncTimeout on socket timeout #7627

Closed smola closed 2 weeks ago

smola commented 2 weeks ago

What Does This Do

Same as https://github.com/DataDog/dd-trace-java/pull/7625

Motivation

Additional Notes

Contributor Checklist

pr-commenter[bot] commented 2 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/retry-on-JettyServlet3TestAsyncDispatchOnAsyncTimeout
git_commit_date 1726490819 1726492864
git_commit_sha bb8b0d25a6 cc842f43b5
release_version 1.40.0-SNAPSHOT~bb8b0d25a6 1.40.0-SNAPSHOT~cc842f43b5
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726495206 |1726495206 | |ci_job_id |640476154 |640476154 | |ci_pipeline_id|44410415 |44410415 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~cc842f43b5, baseline=1.40.0-SNAPSHOT~bb8b0d25a6 dateFormat X axisFormat %s section tracing Agent [baseline] (1.065 s) : 0, 1064540 Total [baseline] (10.31 s) : 0, 10309729 Agent [candidate] (1.066 s) : 0, 1065559 Total [candidate] (10.313 s) : 0, 10312542 section appsec Agent [baseline] (1.204 s) : 0, 1203581 Total [baseline] (10.599 s) : 0, 10598557 Agent [candidate] (1.201 s) : 0, 1201088 Total [candidate] (10.561 s) : 0, 10560938 section iast Agent [baseline] (1.191 s) : 0, 1190586 Total [baseline] (10.871 s) : 0, 10870593 Agent [candidate] (1.193 s) : 0, 1192796 Total [candidate] (10.784 s) : 0, 10783619 section profiling Agent [baseline] (1.26 s) : 0, 1260349 Total [baseline] (10.569 s) : 0, 10569247 Agent [candidate] (1.27 s) : 0, 1270458 Total [candidate] (10.631 s) : 0, 10630864 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.065 s |-| |Agent|appsec|1.204 s |139.04 ms (13.1%)| |Agent|iast|1.191 s |126.046 ms (11.8%)| |Agent|profiling|1.26 s |195.809 ms (18.4%)| |Total|tracing|10.31 s |-| |Total|appsec|10.599 s |288.828 ms (2.8%)| |Total|iast|10.871 s |560.864 ms (5.4%)| |Total|profiling|10.569 s |259.518 ms (2.5%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.066 s |-| |Agent|appsec|1.201 s |135.529 ms (12.7%)| |Agent|iast|1.193 s |127.237 ms (11.9%)| |Agent|profiling|1.27 s |204.899 ms (19.2%)| |Total|tracing|10.313 s |-| |Total|appsec|10.561 s |248.396 ms (2.4%)| |Total|iast|10.784 s |471.077 ms (4.6%)| |Total|profiling|10.631 s |318.322 ms (3.1%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~cc842f43b5, baseline=1.40.0-SNAPSHOT~bb8b0d25a6 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (679.275 ms) : 0, 679275 BytebuddyAgent [candidate] (679.574 ms) : 0, 679574 GlobalTracer [baseline] (311.49 ms) : 0, 311490 GlobalTracer [candidate] (312.096 ms) : 0, 312096 AppSec [baseline] (52.038 ms) : 0, 52038 AppSec [candidate] (52.048 ms) : 0, 52048 Remote Config [baseline] (677.258 µs) : 0, 677 Remote Config [candidate] (661.324 µs) : 0, 661 Telemetry [baseline] (7.462 ms) : 0, 7462 Telemetry [candidate] (7.515 ms) : 0, 7515 section appsec BytebuddyAgent [baseline] (704.682 ms) : 0, 704682 BytebuddyAgent [candidate] (703.071 ms) : 0, 703071 GlobalTracer [baseline] (304.981 ms) : 0, 304981 GlobalTracer [candidate] (304.245 ms) : 0, 304245 AppSec [baseline] (160.893 ms) : 0, 160893 AppSec [candidate] (161.633 ms) : 0, 161633 Remote Config [baseline] (647.543 µs) : 0, 648 Remote Config [candidate] (642.045 µs) : 0, 642 Telemetry [baseline] (8.725 ms) : 0, 8725 Telemetry [candidate] (7.975 ms) : 0, 7975 IAST [baseline] (19.988 ms) : 0, 19988 IAST [candidate] (19.767 ms) : 0, 19767 section iast BytebuddyAgent [baseline] (792.935 ms) : 0, 792935 BytebuddyAgent [candidate] (794.443 ms) : 0, 794443 GlobalTracer [baseline] (299.275 ms) : 0, 299275 GlobalTracer [candidate] (300.047 ms) : 0, 300047 AppSec [baseline] (53.296 ms) : 0, 53296 AppSec [candidate] (51.253 ms) : 0, 51253 Remote Config [baseline] (626.35 µs) : 0, 626 Remote Config [candidate] (645.178 µs) : 0, 645 Telemetry [baseline] (7.37 ms) : 0, 7370 Telemetry [candidate] (7.314 ms) : 0, 7314 IAST [baseline] (23.439 ms) : 0, 23439 IAST [candidate] (25.359 ms) : 0, 25359 section profiling ProfilingAgent [baseline] (95.987 ms) : 0, 95987 ProfilingAgent [candidate] (96.663 ms) : 0, 96663 BytebuddyAgent [baseline] (672.418 ms) : 0, 672418 BytebuddyAgent [candidate] (677.857 ms) : 0, 677857 GlobalTracer [baseline] (393.439 ms) : 0, 393439 GlobalTracer [candidate] (396.564 ms) : 0, 396564 AppSec [baseline] (52.553 ms) : 0, 52553 AppSec [candidate] (52.984 ms) : 0, 52984 Remote Config [baseline] (656.339 µs) : 0, 656 Remote Config [candidate] (672.87 µs) : 0, 673 Telemetry [baseline] (7.405 ms) : 0, 7405 Telemetry [candidate] (7.427 ms) : 0, 7427 Profiling [baseline] (96.011 ms) : 0, 96011 Profiling [candidate] (96.687 ms) : 0, 96687 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~cc842f43b5, baseline=1.40.0-SNAPSHOT~bb8b0d25a6 dateFormat X axisFormat %s section tracing Agent [baseline] (1.066 s) : 0, 1066264 Total [baseline] (8.505 s) : 0, 8504653 Agent [candidate] (1.065 s) : 0, 1064607 Total [candidate] (8.503 s) : 0, 8503072 section iast Agent [baseline] (1.185 s) : 0, 1185428 Total [baseline] (9.037 s) : 0, 9037156 Agent [candidate] (1.188 s) : 0, 1188230 Total [candidate] (8.999 s) : 0, 8998558 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.196 s) : 0, 1196347 Total [baseline] (8.938 s) : 0, 8937766 Agent [candidate] (1.19 s) : 0, 1189805 Total [candidate] (8.991 s) : 0, 8991484 section iast_TELEMETRY_OFF Agent [baseline] (1.187 s) : 0, 1186887 Total [baseline] (8.98 s) : 0, 8979736 Agent [candidate] (1.186 s) : 0, 1186100 Total [candidate] (8.971 s) : 0, 8970774 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.066 s |-| |Agent|iast|1.185 s |119.164 ms (11.2%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.196 s |130.083 ms (12.2%)| |Agent|iast_TELEMETRY_OFF|1.187 s |120.623 ms (11.3%)| |Total|tracing|8.505 s |-| |Total|iast|9.037 s |532.504 ms (6.3%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.938 s |433.113 ms (5.1%)| |Total|iast_TELEMETRY_OFF|8.98 s |475.083 ms (5.6%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.065 s |-| |Agent|iast|1.188 s |123.624 ms (11.6%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.19 s |125.199 ms (11.8%)| |Agent|iast_TELEMETRY_OFF|1.186 s |121.494 ms (11.4%)| |Total|tracing|8.503 s |-| |Total|iast|8.999 s |495.486 ms (5.8%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.991 s |488.412 ms (5.7%)| |Total|iast_TELEMETRY_OFF|8.971 s |467.702 ms (5.5%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~cc842f43b5, baseline=1.40.0-SNAPSHOT~bb8b0d25a6 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (680.593 ms) : 0, 680593 BytebuddyAgent [candidate] (679.638 ms) : 0, 679638 GlobalTracer [baseline] (311.905 ms) : 0, 311905 GlobalTracer [candidate] (311.394 ms) : 0, 311394 AppSec [baseline] (51.992 ms) : 0, 51992 AppSec [candidate] (51.849 ms) : 0, 51849 Remote Config [baseline] (662.477 µs) : 0, 662 Remote Config [candidate] (670.744 µs) : 0, 671 Telemetry [baseline] (7.473 ms) : 0, 7473 Telemetry [candidate] (7.469 ms) : 0, 7469 section iast BytebuddyAgent [baseline] (789.44 ms) : 0, 789440 BytebuddyAgent [candidate] (791.555 ms) : 0, 791555 GlobalTracer [baseline] (298.079 ms) : 0, 298079 GlobalTracer [candidate] (298.897 ms) : 0, 298897 AppSec [baseline] (53.63 ms) : 0, 53630 AppSec [candidate] (53.478 ms) : 0, 53478 IAST [baseline] (22.701 ms) : 0, 22701 IAST [candidate] (22.647 ms) : 0, 22647 Remote Config [baseline] (611.216 µs) : 0, 611 Remote Config [candidate] (636.289 µs) : 0, 636 Telemetry [baseline] (7.346 ms) : 0, 7346 Telemetry [candidate] (7.365 ms) : 0, 7365 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (796.934 ms) : 0, 796934 BytebuddyAgent [candidate] (792.048 ms) : 0, 792048 GlobalTracer [baseline] (300.754 ms) : 0, 300754 GlobalTracer [candidate] (299.681 ms) : 0, 299681 AppSec [baseline] (54.107 ms) : 0, 54107 AppSec [candidate] (53.937 ms) : 0, 53937 IAST [baseline] (22.815 ms) : 0, 22815 IAST [candidate] (22.534 ms) : 0, 22534 Remote Config [baseline] (630.338 µs) : 0, 630 Remote Config [candidate] (631.099 µs) : 0, 631 Telemetry [baseline] (7.363 ms) : 0, 7363 Telemetry [candidate] (7.327 ms) : 0, 7327 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (789.463 ms) : 0, 789463 BytebuddyAgent [candidate] (788.509 ms) : 0, 788509 GlobalTracer [baseline] (299.602 ms) : 0, 299602 GlobalTracer [candidate] (299.727 ms) : 0, 299727 AppSec [baseline] (52.166 ms) : 0, 52166 AppSec [candidate] (51.603 ms) : 0, 51603 IAST [baseline] (23.39 ms) : 0, 23390 IAST [candidate] (24.031 ms) : 0, 24031 Remote Config [baseline] (602.321 µs) : 0, 602 Remote Config [candidate] (603.696 µs) : 0, 604 Telemetry [baseline] (8.019 ms) : 0, 8019 Telemetry [candidate] (7.992 ms) : 0, 7992 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-16T13:30:50 2024-09-16T13:37:40
git_branch master smola/retry-on-JettyServlet3TestAsyncDispatchOnAsyncTimeout
git_commit_date 1726490819 1726492864
git_commit_sha bb8b0d25a6 cc842f43b5
release_version 1.40.0-SNAPSHOT~bb8b0d25a6 1.40.0-SNAPSHOT~cc842f43b5
start_time 2024-09-16T13:30:36 2024-09-16T13:37:27
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726494207 |1726494207 | |ci_job_id |640476155 |640476155 | |ci_pipeline_id|44410415 |44410415 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~cc842f43b5, baseline=1.40.0-SNAPSHOT~bb8b0d25a6 dateFormat X axisFormat %s section baseline no_agent (1.342 ms) : 1324, 1361 . : milestone, 1342, appsec (1.707 ms) : 1683, 1730 . : milestone, 1707, appsec_no_iast (1.744 ms) : 1720, 1768 . : milestone, 1744, iast (1.484 ms) : 1463, 1506 . : milestone, 1484, profiling (1.488 ms) : 1465, 1512 . : milestone, 1488, tracing (1.463 ms) : 1439, 1487 . : milestone, 1463, section candidate no_agent (1.351 ms) : 1332, 1371 . : milestone, 1351, appsec (1.713 ms) : 1689, 1738 . : milestone, 1713, appsec_no_iast (1.723 ms) : 1699, 1746 . : milestone, 1723, iast (1.494 ms) : 1471, 1517 . : milestone, 1494, profiling (1.487 ms) : 1464, 1510 . : milestone, 1487, tracing (1.476 ms) : 1451, 1500 . : milestone, 1476, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.342 ms [1.324 ms, 1.361 ms]|-| |appsec|1.707 ms [1.683 ms, 1.73 ms]|364.381 µs (27.1%)| |appsec_no_iast|1.744 ms [1.72 ms, 1.768 ms]|401.766 µs (29.9%)| |iast|1.484 ms [1.463 ms, 1.506 ms]|142.011 µs (10.6%)| |profiling|1.488 ms [1.465 ms, 1.512 ms]|145.867 µs (10.9%)| |tracing|1.463 ms [1.439 ms, 1.487 ms]|120.798 µs (9.0%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.351 ms [1.332 ms, 1.371 ms]|-| |appsec|1.713 ms [1.689 ms, 1.738 ms]|361.91 µs (26.8%)| |appsec_no_iast|1.723 ms [1.699 ms, 1.746 ms]|371.389 µs (27.5%)| |iast|1.494 ms [1.471 ms, 1.517 ms]|142.914 µs (10.6%)| |profiling|1.487 ms [1.464 ms, 1.51 ms]|135.326 µs (10.0%)| |tracing|1.476 ms [1.451 ms, 1.5 ms]|124.164 µs (9.2%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~cc842f43b5, baseline=1.40.0-SNAPSHOT~bb8b0d25a6 dateFormat X axisFormat %s section baseline no_agent (378.446 µs) : 349, 408 . : milestone, 378, iast (485.002 µs) : 464, 506 . : milestone, 485, iast_FULL (559.102 µs) : 538, 580 . : milestone, 559, iast_GLOBAL (503.896 µs) : 483, 525 . : milestone, 504, iast_HARDCODED_SECRET_DISABLED (484.663 µs) : 463, 506 . : milestone, 485, iast_INACTIVE (453.328 µs) : 432, 474 . : milestone, 453, iast_TELEMETRY_OFF (482.408 µs) : 460, 505 . : milestone, 482, tracing (440.703 µs) : 421, 461 . : milestone, 441, section candidate no_agent (379.712 µs) : 360, 399 . : milestone, 380, iast (484.741 µs) : 463, 506 . : milestone, 485, iast_FULL (556.527 µs) : 535, 578 . : milestone, 557, iast_GLOBAL (508.496 µs) : 487, 530 . : milestone, 508, iast_HARDCODED_SECRET_DISABLED (493.937 µs) : 472, 516 . : milestone, 494, iast_INACTIVE (447.258 µs) : 426, 468 . : milestone, 447, iast_TELEMETRY_OFF (484.332 µs) : 462, 507 . : milestone, 484, tracing (443.61 µs) : 424, 464 . : milestone, 444, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|378.446 µs [348.757 µs, 408.135 µs]|-| |iast|485.002 µs [463.861 µs, 506.143 µs]|106.557 µs (28.2%)| |iast_FULL|559.102 µs [537.942 µs, 580.261 µs]|180.656 µs (47.7%)| |iast_GLOBAL|503.896 µs [482.739 µs, 525.053 µs]|125.45 µs (33.1%)| |iast_HARDCODED_SECRET_DISABLED|484.663 µs [463.282 µs, 506.045 µs]|106.217 µs (28.1%)| |iast_INACTIVE|453.328 µs [432.223 µs, 474.432 µs]|74.882 µs (19.8%)| |iast_TELEMETRY_OFF|482.408 µs [459.502 µs, 505.315 µs]|103.963 µs (27.5%)| |tracing|440.703 µs [420.718 µs, 460.688 µs]|62.257 µs (16.5%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|379.712 µs [360.138 µs, 399.287 µs]|-| |iast|484.741 µs [463.312 µs, 506.17 µs]|105.028 µs (27.7%)| |iast_FULL|556.527 µs [534.998 µs, 578.056 µs]|176.815 µs (46.6%)| |iast_GLOBAL|508.496 µs [487.124 µs, 529.868 µs]|128.783 µs (33.9%)| |iast_HARDCODED_SECRET_DISABLED|493.937 µs [472.334 µs, 515.541 µs]|114.225 µs (30.1%)| |iast_INACTIVE|447.258 µs [426.458 µs, 468.057 µs]|67.545 µs (17.8%)| |iast_TELEMETRY_OFF|484.332 µs [461.719 µs, 506.946 µs]|104.62 µs (27.6%)| |tracing|443.61 µs [423.505 µs, 463.715 µs]|63.898 µs (16.8%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master smola/retry-on-JettyServlet3TestAsyncDispatchOnAsyncTimeout
git_commit_date 1726490819 1726492864
git_commit_sha bb8b0d25a6 cc842f43b5
release_version 1.40.0-SNAPSHOT~bb8b0d25a6 1.40.0-SNAPSHOT~cc842f43b5
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1726494757 |1726494757 | |ci_job_id |640476156 |640476156 | |ci_pipeline_id|44410415 |44410415 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~cc842f43b5, baseline=1.40.0-SNAPSHOT~bb8b0d25a6 dateFormat X axisFormat %s section baseline no_agent (1.463 ms) : 1451, 1474 . : milestone, 1463, appsec (2.274 ms) : 2233, 2314 . : milestone, 2274, iast (2.05 ms) : 2000, 2101 . : milestone, 2050, iast_GLOBAL (2.084 ms) : 2034, 2134 . : milestone, 2084, profiling (1.919 ms) : 1878, 1960 . : milestone, 1919, tracing (1.885 ms) : 1847, 1923 . : milestone, 1885, section candidate no_agent (1.457 ms) : 1446, 1469 . : milestone, 1457, appsec (2.286 ms) : 2245, 2327 . : milestone, 2286, iast (2.046 ms) : 1996, 2096 . : milestone, 2046, iast_GLOBAL (2.094 ms) : 2043, 2145 . : milestone, 2094, profiling (1.921 ms) : 1880, 1963 . : milestone, 1921, tracing (1.892 ms) : 1853, 1930 . : milestone, 1892, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.463 ms [1.451 ms, 1.474 ms]|-| |appsec|2.274 ms [2.233 ms, 2.314 ms]|810.851 µs (55.4%)| |iast|2.05 ms [2.0 ms, 2.101 ms]|587.437 µs (40.2%)| |iast_GLOBAL|2.084 ms [2.034 ms, 2.134 ms]|620.83 µs (42.4%)| |profiling|1.919 ms [1.878 ms, 1.96 ms]|456.17 µs (31.2%)| |tracing|1.885 ms [1.847 ms, 1.923 ms]|422.358 µs (28.9%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.457 ms [1.446 ms, 1.469 ms]|-| |appsec|2.286 ms [2.245 ms, 2.327 ms]|828.413 µs (56.8%)| |iast|2.046 ms [1.996 ms, 2.096 ms]|588.743 µs (40.4%)| |iast_GLOBAL|2.094 ms [2.043 ms, 2.145 ms]|636.515 µs (43.7%)| |profiling|1.921 ms [1.88 ms, 1.963 ms]|463.777 µs (31.8%)| |tracing|1.892 ms [1.853 ms, 1.93 ms]|434.076 µs (29.8%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~cc842f43b5, baseline=1.40.0-SNAPSHOT~bb8b0d25a6 dateFormat X axisFormat %s section baseline no_agent (15.155 s) : 15155000, 15155000 . : milestone, 15155000, appsec (15.393 s) : 15393000, 15393000 . : milestone, 15393000, iast (19.05 s) : 19050000, 19050000 . : milestone, 19050000, iast_GLOBAL (18.089 s) : 18089000, 18089000 . : milestone, 18089000, profiling (15.19 s) : 15190000, 15190000 . : milestone, 15190000, tracing (15.171 s) : 15171000, 15171000 . : milestone, 15171000, section candidate no_agent (15.528 s) : 15528000, 15528000 . : milestone, 15528000, appsec (15.17 s) : 15170000, 15170000 . : milestone, 15170000, iast (19.076 s) : 19076000, 19076000 . : milestone, 19076000, iast_GLOBAL (18.078 s) : 18078000, 18078000 . : milestone, 18078000, profiling (15.41 s) : 15410000, 15410000 . : milestone, 15410000, tracing (15.23 s) : 15230000, 15230000 . : milestone, 15230000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.155 s [15.155 s, 15.155 s]|-| |appsec|15.393 s [15.393 s, 15.393 s]|238.0 ms (1.6%)| |iast|19.05 s [19.05 s, 19.05 s]|3.895 s (25.7%)| |iast_GLOBAL|18.089 s [18.089 s, 18.089 s]|2.934 s (19.4%)| |profiling|15.19 s [15.19 s, 15.19 s]|35.0 ms (0.2%)| |tracing|15.171 s [15.171 s, 15.171 s]|16.0 ms (0.1%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.528 s [15.528 s, 15.528 s]|-| |appsec|15.17 s [15.17 s, 15.17 s]|-358.0 ms (-2.3%)| |iast|19.076 s [19.076 s, 19.076 s]|3.548 s (22.8%)| |iast_GLOBAL|18.078 s [18.078 s, 18.078 s]|2.55 s (16.4%)| |profiling|15.41 s [15.41 s, 15.41 s]|-118.0 ms (-0.8%)| |tracing|15.23 s [15.23 s, 15.23 s]|-298.0 ms (-1.9%)|