search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Enable profiling startForceFirst silently for native image builds #7555

Closed MattAlp closed 2 months ago

MattAlp commented 2 months ago

What Does This Do

This turns on the dd.profiling.start_force_first config setting silently when the profiler is baked into a Graal native image.

Motivation

Without this flag specified, the profiling integration will fail silently. The flag itself is relevant to older, non-Graal JVMs (for historical reasons). Docs do not mention this requirement at the moment.

Additional Notes

Contributor Checklist

Jira ticket: [PROF-10457]

jbachorik commented 2 months ago

Without this flag specified, the profiling integration will fail silently

Is this even for long running processes? IIRC, the profiler should be started eventually, if the app has been running for a long time.

MattAlp commented 2 months ago

I don't believe so- the ProfilerInstaller explicitly says that the Profiler is to start first. As far as I know, the run never gets called again, so we never get to the code that sets a delayed startup

jbachorik commented 2 months ago

Oh, ok. Hm, should we have a warning if a user overrides the flag when running the native image as well?

pr-commenter[bot] commented 2 months ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/scp-479-fix
git_commit_date 1725372161 1725383113
git_commit_sha 6e276bef3e a293df12f3
release_version 1.40.0-SNAPSHOT~6e276bef3e 1.40.0-SNAPSHOT~a293df12f3
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725385676 |1725385676 | |ci_job_id |626004338 |626004338 | |ci_pipeline_id|43436402 |43436402 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e dateFormat X axisFormat %s section tracing Agent [baseline] (1.055 s) : 0, 1054811 Total [baseline] (10.402 s) : 0, 10401538 Agent [candidate] (1.053 s) : 0, 1053189 Total [candidate] (10.418 s) : 0, 10417838 section appsec Agent [baseline] (1.185 s) : 0, 1185023 Total [baseline] (10.668 s) : 0, 10668479 Agent [candidate] (1.184 s) : 0, 1183670 Total [candidate] (10.585 s) : 0, 10584837 section iast Agent [baseline] (1.177 s) : 0, 1176538 Total [baseline] (10.79 s) : 0, 10789847 Agent [candidate] (1.175 s) : 0, 1175218 Total [candidate] (10.862 s) : 0, 10862066 section profiling Agent [baseline] (1.26 s) : 0, 1259539 Total [baseline] (10.613 s) : 0, 10613317 Agent [candidate] (1.25 s) : 0, 1250387 Total [candidate] (10.62 s) : 0, 10620215 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.055 s |-| |Agent|appsec|1.185 s |130.212 ms (12.3%)| |Agent|iast|1.177 s |121.726 ms (11.5%)| |Agent|profiling|1.26 s |204.728 ms (19.4%)| |Total|tracing|10.402 s |-| |Total|appsec|10.668 s |266.941 ms (2.6%)| |Total|iast|10.79 s |388.309 ms (3.7%)| |Total|profiling|10.613 s |211.779 ms (2.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.053 s |-| |Agent|appsec|1.184 s |130.482 ms (12.4%)| |Agent|iast|1.175 s |122.029 ms (11.6%)| |Agent|profiling|1.25 s |197.198 ms (18.7%)| |Total|tracing|10.418 s |-| |Total|appsec|10.585 s |166.999 ms (1.6%)| |Total|iast|10.862 s |444.228 ms (4.3%)| |Total|profiling|10.62 s |202.378 ms (1.9%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (672.943 ms) : 0, 672943 BytebuddyAgent [candidate] (671.728 ms) : 0, 671728 GlobalTracer [baseline] (308.331 ms) : 0, 308331 GlobalTracer [candidate] (307.751 ms) : 0, 307751 AppSec [baseline] (51.634 ms) : 0, 51634 AppSec [candidate] (51.731 ms) : 0, 51731 Remote Config [baseline] (677.84 µs) : 0, 678 Remote Config [candidate] (683.001 µs) : 0, 683 Telemetry [baseline] (7.494 ms) : 0, 7494 Telemetry [candidate] (7.595 ms) : 0, 7595 section appsec BytebuddyAgent [baseline] (691.401 ms) : 0, 691401 BytebuddyAgent [candidate] (689.408 ms) : 0, 689408 GlobalTracer [baseline] (301.221 ms) : 0, 301221 GlobalTracer [candidate] (301.107 ms) : 0, 301107 AppSec [baseline] (159.551 ms) : 0, 159551 AppSec [candidate] (159.756 ms) : 0, 159756 IAST [baseline] (19.949 ms) : 0, 19949 IAST [candidate] (19.043 ms) : 0, 19043 Remote Config [baseline] (619.047 µs) : 0, 619 Remote Config [candidate] (618.172 µs) : 0, 618 Telemetry [baseline] (8.627 ms) : 0, 8627 Telemetry [candidate] (9.63 ms) : 0, 9630 section iast BytebuddyAgent [baseline] (782.229 ms) : 0, 782229 BytebuddyAgent [candidate] (781.243 ms) : 0, 781243 GlobalTracer [baseline] (296.54 ms) : 0, 296540 GlobalTracer [candidate] (296.297 ms) : 0, 296297 AppSec [baseline] (51.873 ms) : 0, 51873 AppSec [candidate] (55.216 ms) : 0, 55216 IAST [baseline] (23.534 ms) : 0, 23534 IAST [candidate] (20.971 ms) : 0, 20971 Remote Config [baseline] (589.074 µs) : 0, 589 Remote Config [candidate] (578.199 µs) : 0, 578 Telemetry [baseline] (8.111 ms) : 0, 8111 Telemetry [candidate] (7.276 ms) : 0, 7276 section profiling BytebuddyAgent [baseline] (671.006 ms) : 0, 671006 BytebuddyAgent [candidate] (665.907 ms) : 0, 665907 GlobalTracer [baseline] (393.105 ms) : 0, 393105 GlobalTracer [candidate] (390.665 ms) : 0, 390665 AppSec [baseline] (52.359 ms) : 0, 52359 AppSec [candidate] (52.134 ms) : 0, 52134 Remote Config [baseline] (693.312 µs) : 0, 693 Remote Config [candidate] (682.014 µs) : 0, 682 Telemetry [baseline] (7.422 ms) : 0, 7422 Telemetry [candidate] (7.343 ms) : 0, 7343 ProfilingAgent [baseline] (96.682 ms) : 0, 96682 ProfilingAgent [candidate] (95.572 ms) : 0, 95572 Profiling [baseline] (96.705 ms) : 0, 96705 Profiling [candidate] (95.596 ms) : 0, 95596 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e dateFormat X axisFormat %s section tracing Agent [baseline] (1.054 s) : 0, 1053939 Total [baseline] (8.511 s) : 0, 8510657 Agent [candidate] (1.052 s) : 0, 1051844 Total [candidate] (8.5 s) : 0, 8499914 section iast Agent [baseline] (1.191 s) : 0, 1190807 Total [baseline] (8.997 s) : 0, 8997404 Agent [candidate] (1.193 s) : 0, 1193497 Total [candidate] (9.04 s) : 0, 9040165 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.178 s) : 0, 1178043 Total [baseline] (8.954 s) : 0, 8954083 Agent [candidate] (1.175 s) : 0, 1174988 Total [candidate] (8.963 s) : 0, 8962908 section iast_TELEMETRY_OFF Agent [baseline] (1.191 s) : 0, 1191219 Total [baseline] (9.042 s) : 0, 9042060 Agent [candidate] (1.18 s) : 0, 1179551 Total [candidate] (9.008 s) : 0, 9008488 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.054 s |-| |Agent|iast|1.191 s |136.868 ms (13.0%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.178 s |124.104 ms (11.8%)| |Agent|iast_TELEMETRY_OFF|1.191 s |137.28 ms (13.0%)| |Total|tracing|8.511 s |-| |Total|iast|8.997 s |486.747 ms (5.7%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.954 s |443.425 ms (5.2%)| |Total|iast_TELEMETRY_OFF|9.042 s |531.403 ms (6.2%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.052 s |-| |Agent|iast|1.193 s |141.654 ms (13.5%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.175 s |123.144 ms (11.7%)| |Agent|iast_TELEMETRY_OFF|1.18 s |127.707 ms (12.1%)| |Total|tracing|8.5 s |-| |Total|iast|9.04 s |540.252 ms (6.4%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.963 s |462.994 ms (5.4%)| |Total|iast_TELEMETRY_OFF|9.008 s |508.574 ms (6.0%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (672.601 ms) : 0, 672601 BytebuddyAgent [candidate] (670.814 ms) : 0, 670814 GlobalTracer [baseline] (307.581 ms) : 0, 307581 GlobalTracer [candidate] (307.528 ms) : 0, 307528 AppSec [baseline] (51.782 ms) : 0, 51782 AppSec [candidate] (51.647 ms) : 0, 51647 Remote Config [baseline] (679.487 µs) : 0, 679 Remote Config [candidate] (685.684 µs) : 0, 686 Telemetry [baseline] (7.584 ms) : 0, 7584 Telemetry [candidate] (7.481 ms) : 0, 7481 section iast BytebuddyAgent [baseline] (792.344 ms) : 0, 792344 BytebuddyAgent [candidate] (794.203 ms) : 0, 794203 GlobalTracer [baseline] (300.138 ms) : 0, 300138 GlobalTracer [candidate] (301.201 ms) : 0, 301201 AppSec [baseline] (52.383 ms) : 0, 52383 AppSec [candidate] (55.127 ms) : 0, 55127 IAST [baseline] (23.512 ms) : 0, 23512 IAST [candidate] (21.18 ms) : 0, 21180 Remote Config [baseline] (579.314 µs) : 0, 579 Remote Config [candidate] (586.86 µs) : 0, 587 Telemetry [baseline] (8.026 ms) : 0, 8026 Telemetry [candidate] (7.322 ms) : 0, 7322 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (783.116 ms) : 0, 783116 BytebuddyAgent [candidate] (781.239 ms) : 0, 781239 GlobalTracer [baseline] (297.216 ms) : 0, 297216 GlobalTracer [candidate] (296.883 ms) : 0, 296883 AppSec [baseline] (51.866 ms) : 0, 51866 AppSec [candidate] (51.734 ms) : 0, 51734 IAST [baseline] (24.282 ms) : 0, 24282 IAST [candidate] (23.505 ms) : 0, 23505 Remote Config [baseline] (570.216 µs) : 0, 570 Remote Config [candidate] (591.72 µs) : 0, 592 Telemetry [baseline] (7.291 ms) : 0, 7291 Telemetry [candidate] (7.34 ms) : 0, 7340 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (791.05 ms) : 0, 791050 BytebuddyAgent [candidate] (781.858 ms) : 0, 781858 GlobalTracer [baseline] (301.736 ms) : 0, 301736 GlobalTracer [candidate] (299.658 ms) : 0, 299658 AppSec [baseline] (53.072 ms) : 0, 53072 AppSec [candidate] (49.251 ms) : 0, 49251 IAST [baseline] (21.172 ms) : 0, 21172 IAST [candidate] (26.315 ms) : 0, 26315 Remote Config [baseline] (599.089 µs) : 0, 599 Remote Config [candidate] (598.21 µs) : 0, 598 Telemetry [baseline] (9.715 ms) : 0, 9715 Telemetry [candidate] (8.094 ms) : 0, 8094 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-03T17:18:31 2024-09-03T17:25:20
git_branch master mattalp/scp-479-fix
git_commit_date 1725372161 1725383113
git_commit_sha 6e276bef3e a293df12f3
release_version 1.40.0-SNAPSHOT~6e276bef3e 1.40.0-SNAPSHOT~a293df12f3
start_time 2024-09-03T17:18:18 2024-09-03T17:25:06
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725384664 |1725384664 | |ci_job_id |626004339 |626004339 | |ci_pipeline_id|43436402 |43436402 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e dateFormat X axisFormat %s section baseline no_agent (1.335 ms) : 1315, 1354 . : milestone, 1335, appsec (1.732 ms) : 1709, 1755 . : milestone, 1732, appsec_no_iast (1.727 ms) : 1703, 1751 . : milestone, 1727, iast (1.471 ms) : 1449, 1494 . : milestone, 1471, profiling (1.509 ms) : 1484, 1533 . : milestone, 1509, tracing (1.487 ms) : 1463, 1511 . : milestone, 1487, section candidate no_agent (1.329 ms) : 1310, 1348 . : milestone, 1329, appsec (1.724 ms) : 1700, 1749 . : milestone, 1724, appsec_no_iast (1.725 ms) : 1701, 1749 . : milestone, 1725, iast (1.489 ms) : 1466, 1511 . : milestone, 1489, profiling (1.468 ms) : 1445, 1492 . : milestone, 1468, tracing (1.478 ms) : 1454, 1502 . : milestone, 1478, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.335 ms [1.315 ms, 1.354 ms]|-| |appsec|1.732 ms [1.709 ms, 1.755 ms]|397.376 µs (29.8%)| |appsec_no_iast|1.727 ms [1.703 ms, 1.751 ms]|392.202 µs (29.4%)| |iast|1.471 ms [1.449 ms, 1.494 ms]|136.567 µs (10.2%)| |profiling|1.509 ms [1.484 ms, 1.533 ms]|173.834 µs (13.0%)| |tracing|1.487 ms [1.463 ms, 1.511 ms]|152.0 µs (11.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.329 ms [1.31 ms, 1.348 ms]|-| |appsec|1.724 ms [1.7 ms, 1.749 ms]|395.224 µs (29.7%)| |appsec_no_iast|1.725 ms [1.701 ms, 1.749 ms]|395.695 µs (29.8%)| |iast|1.489 ms [1.466 ms, 1.511 ms]|159.787 µs (12.0%)| |profiling|1.468 ms [1.445 ms, 1.492 ms]|139.498 µs (10.5%)| |tracing|1.478 ms [1.454 ms, 1.502 ms]|149.135 µs (11.2%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e dateFormat X axisFormat %s section baseline no_agent (364.706 µs) : 345, 384 . : milestone, 365, iast (482.078 µs) : 460, 504 . : milestone, 482, iast_FULL (549.272 µs) : 528, 570 . : milestone, 549, iast_GLOBAL (504.322 µs) : 483, 526 . : milestone, 504, iast_HARDCODED_SECRET_DISABLED (481.763 µs) : 460, 503 . : milestone, 482, iast_INACTIVE (444.182 µs) : 423, 465 . : milestone, 444, iast_TELEMETRY_OFF (470.227 µs) : 448, 493 . : milestone, 470, tracing (436.134 µs) : 416, 456 . : milestone, 436, section candidate no_agent (366.487 µs) : 346, 387 . : milestone, 366, iast (487.338 µs) : 465, 509 . : milestone, 487, iast_FULL (549.955 µs) : 529, 571 . : milestone, 550, iast_GLOBAL (510.206 µs) : 487, 533 . : milestone, 510, iast_HARDCODED_SECRET_DISABLED (479.016 µs) : 457, 501 . : milestone, 479, iast_INACTIVE (439.358 µs) : 419, 460 . : milestone, 439, iast_TELEMETRY_OFF (469.715 µs) : 447, 492 . : milestone, 470, tracing (440.819 µs) : 420, 462 . : milestone, 441, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|364.706 µs [345.103 µs, 384.31 µs]|-| |iast|482.078 µs [459.995 µs, 504.16 µs]|117.371 µs (32.2%)| |iast_FULL|549.272 µs [528.101 µs, 570.442 µs]|184.565 µs (50.6%)| |iast_GLOBAL|504.322 µs [482.599 µs, 526.045 µs]|139.616 µs (38.3%)| |iast_HARDCODED_SECRET_DISABLED|481.763 µs [460.201 µs, 503.325 µs]|117.057 µs (32.1%)| |iast_INACTIVE|444.182 µs [423.433 µs, 464.93 µs]|79.476 µs (21.8%)| |iast_TELEMETRY_OFF|470.227 µs [447.736 µs, 492.717 µs]|105.52 µs (28.9%)| |tracing|436.134 µs [415.895 µs, 456.374 µs]|71.428 µs (19.6%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|366.487 µs [346.397 µs, 386.577 µs]|-| |iast|487.338 µs [465.22 µs, 509.456 µs]|120.851 µs (33.0%)| |iast_FULL|549.955 µs [528.868 µs, 571.041 µs]|183.468 µs (50.1%)| |iast_GLOBAL|510.206 µs [487.391 µs, 533.021 µs]|143.719 µs (39.2%)| |iast_HARDCODED_SECRET_DISABLED|479.016 µs [457.436 µs, 500.596 µs]|112.529 µs (30.7%)| |iast_INACTIVE|439.358 µs [419.044 µs, 459.673 µs]|72.871 µs (19.9%)| |iast_TELEMETRY_OFF|469.715 µs [447.389 µs, 492.042 µs]|103.228 µs (28.2%)| |tracing|440.819 µs [419.951 µs, 461.688 µs]|74.332 µs (20.3%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master mattalp/scp-479-fix
git_commit_date 1725372161 1725383113
git_commit_sha 6e276bef3e a293df12f3
release_version 1.40.0-SNAPSHOT~6e276bef3e 1.40.0-SNAPSHOT~a293df12f3
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1725385181 |1725385181 | |ci_job_id |626004340 |626004340 | |ci_pipeline_id|43436402 |43436402 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e dateFormat X axisFormat %s section baseline no_agent (1.457 ms) : 1445, 1469 . : milestone, 1457, appsec (2.227 ms) : 2191, 2262 . : milestone, 2227, iast (1.996 ms) : 1952, 2040 . : milestone, 1996, iast_GLOBAL (2.024 ms) : 1980, 2068 . : milestone, 2024, profiling (1.866 ms) : 1831, 1900 . : milestone, 1866, tracing (1.83 ms) : 1798, 1863 . : milestone, 1830, section candidate no_agent (1.459 ms) : 1447, 1470 . : milestone, 1459, appsec (2.217 ms) : 2182, 2253 . : milestone, 2217, iast (1.986 ms) : 1942, 2031 . : milestone, 1986, iast_GLOBAL (2.03 ms) : 1986, 2074 . : milestone, 2030, profiling (1.847 ms) : 1812, 1882 . : milestone, 1847, tracing (1.834 ms) : 1801, 1867 . : milestone, 1834, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.457 ms [1.445 ms, 1.469 ms]|-| |appsec|2.227 ms [2.191 ms, 2.262 ms]|769.659 µs (52.8%)| |iast|1.996 ms [1.952 ms, 2.04 ms]|539.066 µs (37.0%)| |iast_GLOBAL|2.024 ms [1.98 ms, 2.068 ms]|566.735 µs (38.9%)| |profiling|1.866 ms [1.831 ms, 1.9 ms]|408.806 µs (28.1%)| |tracing|1.83 ms [1.798 ms, 1.863 ms]|373.255 µs (25.6%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.459 ms [1.447 ms, 1.47 ms]|-| |appsec|2.217 ms [2.182 ms, 2.253 ms]|758.619 µs (52.0%)| |iast|1.986 ms [1.942 ms, 2.031 ms]|527.37 µs (36.2%)| |iast_GLOBAL|2.03 ms [1.986 ms, 2.074 ms]|570.997 µs (39.1%)| |profiling|1.847 ms [1.812 ms, 1.882 ms]|388.342 µs (26.6%)| |tracing|1.834 ms [1.801 ms, 1.867 ms]|374.965 µs (25.7%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~a293df12f3, baseline=1.40.0-SNAPSHOT~6e276bef3e dateFormat X axisFormat %s section baseline no_agent (14.903 s) : 14903000, 14903000 . : milestone, 14903000, appsec (14.854 s) : 14854000, 14854000 . : milestone, 14854000, iast (18.797 s) : 18797000, 18797000 . : milestone, 18797000, iast_GLOBAL (18.003 s) : 18003000, 18003000 . : milestone, 18003000, profiling (15.827 s) : 15827000, 15827000 . : milestone, 15827000, tracing (14.804 s) : 14804000, 14804000 . : milestone, 14804000, section candidate no_agent (15.475 s) : 15475000, 15475000 . : milestone, 15475000, appsec (15.281 s) : 15281000, 15281000 . : milestone, 15281000, iast (18.628 s) : 18628000, 18628000 . : milestone, 18628000, iast_GLOBAL (17.955 s) : 17955000, 17955000 . : milestone, 17955000, profiling (15.378 s) : 15378000, 15378000 . : milestone, 15378000, tracing (14.861 s) : 14861000, 14861000 . : milestone, 14861000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.903 s [14.903 s, 14.903 s]|-| |appsec|14.854 s [14.854 s, 14.854 s]|-49.0 ms (-0.3%)| |iast|18.797 s [18.797 s, 18.797 s]|3.894 s (26.1%)| |iast_GLOBAL|18.003 s [18.003 s, 18.003 s]|3.1 s (20.8%)| |profiling|15.827 s [15.827 s, 15.827 s]|924.0 ms (6.2%)| |tracing|14.804 s [14.804 s, 14.804 s]|-99.0 ms (-0.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.475 s [15.475 s, 15.475 s]|-| |appsec|15.281 s [15.281 s, 15.281 s]|-194.0 ms (-1.3%)| |iast|18.628 s [18.628 s, 18.628 s]|3.153 s (20.4%)| |iast_GLOBAL|17.955 s [17.955 s, 17.955 s]|2.48 s (16.0%)| |profiling|15.378 s [15.378 s, 15.378 s]|-97.0 ms (-0.6%)| |tracing|14.861 s [14.861 s, 14.861 s]|-614.0 ms (-4.0%)|