search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Add proper context propagation for reactive streams #7644

Closed amarziali closed 1 month ago

amarziali commented 1 month ago

What Does This Do

This PR aims definitely addressing context propagation for reactivestreams Publisher and Subscriber. It addresses also patterns (Mono, Flux, Processor) provided by project reactor.

The old advices we had were either not always applied (TerminalSubscriberInstrumentation) either not applied by default (ReactorHooks). In particular TerminalSubscriberInstrumentation was only applied when the Mono or Flux was peeking elements (i.e. methods doOnXXXX or log). Also it had no effects on propagation. The propagation was only handled by our java_concurrent advices that was missing use cases like subscription on unhandled thread pools or work queues.

This PR also unify the way traced methods finish spans when the return type is a Producer. We had two different extensions:

Considering this use case

@WithSpan
public Mono doSomething() {
   ....
}

In that case there it may happen that ReactiveStreamsAsyncResultSupportExtension is used (since Mono implements Publisher). This one was wrapping the publisher in an internal types causing class casts when bytebuddy replaces the return type since our wrapped type cannot be casted back to Mono

Generally speaking this PR avoid rewrapping Publisher and Subscriber in order to save a lot of object allocations (but transforms more types).

Motivation

Additional Notes

Contributor Checklist

Jira ticket: AIDM-331

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/reactor-rebirth
git_commit_date 1728548937 1728570335
git_commit_sha 70c9598d61 c367127391
release_version 1.41.0-SNAPSHOT~70c9598d61 1.41.0-SNAPSHOT~c367127391
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1728573404 |1728573404 | |ci_job_id |668489027 |668489027 | |ci_pipeline_id|46291596 |46291596 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 54 metrics, 9 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~c367127391, baseline=1.41.0-SNAPSHOT~70c9598d61 dateFormat X axisFormat %s section tracing Agent [baseline] (1.067 s) : 0, 1066718 Total [baseline] (10.398 s) : 0, 10398429 Agent [candidate] (1.07 s) : 0, 1069547 Total [candidate] (10.375 s) : 0, 10375452 section appsec Agent [baseline] (1.208 s) : 0, 1207953 Total [baseline] (10.559 s) : 0, 10559158 Agent [candidate] (1.202 s) : 0, 1202416 Total [candidate] (10.646 s) : 0, 10645657 section iast Agent [baseline] (1.193 s) : 0, 1193439 Total [baseline] (10.86 s) : 0, 10860255 Agent [candidate] (1.198 s) : 0, 1197828 Total [candidate] (10.888 s) : 0, 10887890 section profiling Agent [baseline] (1.276 s) : 0, 1275884 Total [baseline] (10.679 s) : 0, 10679104 Agent [candidate] (1.282 s) : 0, 1281796 Total [candidate] (10.637 s) : 0, 10636895 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.067 s |-| |Agent|appsec|1.208 s |141.235 ms (13.2%)| |Agent|iast|1.193 s |126.721 ms (11.9%)| |Agent|profiling|1.276 s |209.166 ms (19.6%)| |Total|tracing|10.398 s |-| |Total|appsec|10.559 s |160.729 ms (1.5%)| |Total|iast|10.86 s |461.825 ms (4.4%)| |Total|profiling|10.679 s |280.675 ms (2.7%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.07 s |-| |Agent|appsec|1.202 s |132.868 ms (12.4%)| |Agent|iast|1.198 s |128.28 ms (12.0%)| |Agent|profiling|1.282 s |212.249 ms (19.8%)| |Total|tracing|10.375 s |-| |Total|appsec|10.646 s |270.205 ms (2.6%)| |Total|iast|10.888 s |512.437 ms (4.9%)| |Total|profiling|10.637 s |261.443 ms (2.5%)| ```mermaid gantt title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~c367127391, baseline=1.41.0-SNAPSHOT~70c9598d61 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (680.928 ms) : 0, 680928 BytebuddyAgent [candidate] (682.761 ms) : 0, 682761 GlobalTracer [baseline] (310.332 ms) : 0, 310332 GlobalTracer [candidate] (311.365 ms) : 0, 311365 AppSec [baseline] (53.525 ms) : 0, 53525 AppSec [candidate] (53.535 ms) : 0, 53535 Remote Config [baseline] (663.534 µs) : 0, 664 Remote Config [candidate] (670.705 µs) : 0, 671 Telemetry [baseline] (7.61 ms) : 0, 7610 Telemetry [candidate] (7.53 ms) : 0, 7530 section appsec BytebuddyAgent [baseline] (702.158 ms) : 0, 702158 BytebuddyAgent [candidate] (698.818 ms) : 0, 698818 GlobalTracer [baseline] (309.268 ms) : 0, 309268 GlobalTracer [candidate] (307.88 ms) : 0, 307880 AppSec [baseline] (162.814 ms) : 0, 162814 AppSec [candidate] (162.653 ms) : 0, 162653 IAST [baseline] (21.5 ms) : 0, 21500 IAST [candidate] (20.768 ms) : 0, 20768 Remote Config [baseline] (649.255 µs) : 0, 649 Remote Config [candidate] (632.529 µs) : 0, 633 Telemetry [baseline] (8.575 ms) : 0, 8575 Telemetry [candidate] (8.38 ms) : 0, 8380 section iast BytebuddyAgent [baseline] (794.96 ms) : 0, 794960 BytebuddyAgent [candidate] (798.638 ms) : 0, 798638 GlobalTracer [baseline] (299.309 ms) : 0, 299309 GlobalTracer [candidate] (299.798 ms) : 0, 299798 AppSec [baseline] (54.488 ms) : 0, 54488 AppSec [candidate] (56.042 ms) : 0, 56042 IAST [baseline] (23.383 ms) : 0, 23383 IAST [candidate] (21.985 ms) : 0, 21985 Remote Config [baseline] (596.164 µs) : 0, 596 Remote Config [candidate] (603.407 µs) : 0, 603 Telemetry [baseline] (7.03 ms) : 0, 7030 Telemetry [candidate] (7.058 ms) : 0, 7058 section profiling BytebuddyAgent [baseline] (680.233 ms) : 0, 680233 BytebuddyAgent [candidate] (683.346 ms) : 0, 683346 GlobalTracer [baseline] (395.945 ms) : 0, 395945 GlobalTracer [candidate] (398.543 ms) : 0, 398543 AppSec [baseline] (54.953 ms) : 0, 54953 AppSec [candidate] (55.316 ms) : 0, 55316 Remote Config [baseline] (660.296 µs) : 0, 660 Remote Config [candidate] (670.153 µs) : 0, 670 Telemetry [baseline] (7.48 ms) : 0, 7480 Telemetry [candidate] (7.534 ms) : 0, 7534 ProfilingAgent [baseline] (97.718 ms) : 0, 97718 ProfilingAgent [candidate] (97.303 ms) : 0, 97303 Profiling [baseline] (97.744 ms) : 0, 97744 Profiling [candidate] (97.328 ms) : 0, 97328 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~c367127391, baseline=1.41.0-SNAPSHOT~70c9598d61 dateFormat X axisFormat %s section tracing Agent [baseline] (1.076 s) : 0, 1075639 Total [baseline] (8.597 s) : 0, 8597143 Agent [candidate] (1.068 s) : 0, 1068009 Total [candidate] (8.549 s) : 0, 8549375 section iast Agent [baseline] (1.195 s) : 0, 1194959 Total [baseline] (9.07 s) : 0, 9070414 Agent [candidate] (1.218 s) : 0, 1217778 Total [candidate] (9.168 s) : 0, 9167720 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.211 s) : 0, 1211095 Total [baseline] (9.142 s) : 0, 9142052 Agent [candidate] (1.198 s) : 0, 1198464 Total [candidate] (9.107 s) : 0, 9107305 section iast_TELEMETRY_OFF Agent [baseline] (1.206 s) : 0, 1205807 Total [baseline] (9.149 s) : 0, 9149118 Agent [candidate] (1.201 s) : 0, 1201421 Total [candidate] (9.107 s) : 0, 9106727 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.076 s |-| |Agent|iast|1.195 s |119.32 ms (11.1%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.211 s |135.456 ms (12.6%)| |Agent|iast_TELEMETRY_OFF|1.206 s |130.169 ms (12.1%)| |Total|tracing|8.597 s |-| |Total|iast|9.07 s |473.271 ms (5.5%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.142 s |544.909 ms (6.3%)| |Total|iast_TELEMETRY_OFF|9.149 s |551.975 ms (6.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.068 s |-| |Agent|iast|1.218 s |149.769 ms (14.0%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.198 s |130.454 ms (12.2%)| |Agent|iast_TELEMETRY_OFF|1.201 s |133.412 ms (12.5%)| |Total|tracing|8.549 s |-| |Total|iast|9.168 s |618.345 ms (7.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.107 s |557.93 ms (6.5%)| |Total|iast_TELEMETRY_OFF|9.107 s |557.353 ms (6.5%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~c367127391, baseline=1.41.0-SNAPSHOT~70c9598d61 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (686.12 ms) : 0, 686120 BytebuddyAgent [candidate] (681.867 ms) : 0, 681867 GlobalTracer [baseline] (313.289 ms) : 0, 313289 GlobalTracer [candidate] (310.688 ms) : 0, 310688 AppSec [baseline] (54.258 ms) : 0, 54258 AppSec [candidate] (53.617 ms) : 0, 53617 Remote Config [baseline] (672.117 µs) : 0, 672 Remote Config [candidate] (663.064 µs) : 0, 663 Telemetry [baseline] (7.57 ms) : 0, 7570 Telemetry [candidate] (7.521 ms) : 0, 7521 section iast BytebuddyAgent [baseline] (796.372 ms) : 0, 796372 BytebuddyAgent [candidate] (813.592 ms) : 0, 813592 GlobalTracer [baseline] (299.356 ms) : 0, 299356 GlobalTracer [candidate] (303.262 ms) : 0, 303262 AppSec [baseline] (55.22 ms) : 0, 55220 AppSec [candidate] (57.574 ms) : 0, 57574 IAST [baseline] (22.702 ms) : 0, 22702 IAST [candidate] (21.591 ms) : 0, 21591 Remote Config [baseline] (599.43 µs) : 0, 599 Remote Config [candidate] (620.579 µs) : 0, 621 Telemetry [baseline] (7.024 ms) : 0, 7024 Telemetry [candidate] (7.194 ms) : 0, 7194 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (807.934 ms) : 0, 807934 BytebuddyAgent [candidate] (798.005 ms) : 0, 798005 GlobalTracer [baseline] (303.845 ms) : 0, 303845 GlobalTracer [candidate] (300.697 ms) : 0, 300697 AppSec [baseline] (56.379 ms) : 0, 56379 AppSec [candidate] (55.533 ms) : 0, 55533 IAST [baseline] (21.297 ms) : 0, 21297 IAST [candidate] (22.7 ms) : 0, 22700 Remote Config [baseline] (604.753 µs) : 0, 605 Remote Config [candidate] (615.168 µs) : 0, 615 Telemetry [baseline] (7.14 ms) : 0, 7140 Telemetry [candidate] (7.126 ms) : 0, 7126 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (801.899 ms) : 0, 801899 BytebuddyAgent [candidate] (799.975 ms) : 0, 799975 GlobalTracer [baseline] (303.423 ms) : 0, 303423 GlobalTracer [candidate] (301.599 ms) : 0, 301599 AppSec [baseline] (54.633 ms) : 0, 54633 AppSec [candidate] (54.934 ms) : 0, 54934 IAST [baseline] (24.369 ms) : 0, 24369 IAST [candidate] (23.443 ms) : 0, 23443 Remote Config [baseline] (618.417 µs) : 0, 618 Remote Config [candidate] (630.654 µs) : 0, 631 Telemetry [baseline] (7.033 ms) : 0, 7033 Telemetry [candidate] (7.018 ms) : 0, 7018 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-10T14:45:14 2024-10-10T14:52:09
git_branch master andrea.marziali/reactor-rebirth
git_commit_date 1728548937 1728570335
git_commit_sha 70c9598d61 c367127391
release_version 1.41.0-SNAPSHOT~70c9598d61 1.41.0-SNAPSHOT~c367127391
start_time 2024-10-10T14:45:01 2024-10-10T14:51:56
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1728572276 |1728572276 | |ci_job_id |668489029 |668489029 | |ci_pipeline_id|46291596 |46291596 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~c367127391, baseline=1.41.0-SNAPSHOT~70c9598d61 dateFormat X axisFormat %s section baseline no_agent (1.348 ms) : 1328, 1367 . : milestone, 1348, appsec (1.742 ms) : 1718, 1766 . : milestone, 1742, appsec_no_iast (1.715 ms) : 1691, 1739 . : milestone, 1715, iast (1.493 ms) : 1470, 1516 . : milestone, 1493, profiling (1.524 ms) : 1499, 1549 . : milestone, 1524, tracing (1.475 ms) : 1451, 1499 . : milestone, 1475, section candidate no_agent (1.338 ms) : 1318, 1357 . : milestone, 1338, appsec (1.717 ms) : 1693, 1741 . : milestone, 1717, appsec_no_iast (1.732 ms) : 1708, 1756 . : milestone, 1732, iast (1.488 ms) : 1465, 1510 . : milestone, 1488, profiling (1.482 ms) : 1457, 1507 . : milestone, 1482, tracing (1.459 ms) : 1434, 1484 . : milestone, 1459, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.348 ms [1.328 ms, 1.367 ms]|-| |appsec|1.742 ms [1.718 ms, 1.766 ms]|394.766 µs (29.3%)| |appsec_no_iast|1.715 ms [1.691 ms, 1.739 ms]|367.508 µs (27.3%)| |iast|1.493 ms [1.47 ms, 1.516 ms]|145.768 µs (10.8%)| |profiling|1.524 ms [1.499 ms, 1.549 ms]|176.121 µs (13.1%)| |tracing|1.475 ms [1.451 ms, 1.499 ms]|127.408 µs (9.5%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.338 ms [1.318 ms, 1.357 ms]|-| |appsec|1.717 ms [1.693 ms, 1.741 ms]|379.076 µs (28.3%)| |appsec_no_iast|1.732 ms [1.708 ms, 1.756 ms]|394.109 µs (29.5%)| |iast|1.488 ms [1.465 ms, 1.51 ms]|149.804 µs (11.2%)| |profiling|1.482 ms [1.457 ms, 1.507 ms]|144.093 µs (10.8%)| |tracing|1.459 ms [1.434 ms, 1.484 ms]|121.301 µs (9.1%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~c367127391, baseline=1.41.0-SNAPSHOT~70c9598d61 dateFormat X axisFormat %s section baseline no_agent (371.734 µs) : 351, 392 . : milestone, 372, iast (480.042 µs) : 459, 501 . : milestone, 480, iast_FULL (549.976 µs) : 529, 571 . : milestone, 550, iast_GLOBAL (505.858 µs) : 484, 528 . : milestone, 506, iast_HARDCODED_SECRET_DISABLED (486.94 µs) : 466, 508 . : milestone, 487, iast_INACTIVE (443.831 µs) : 423, 464 . : milestone, 444, iast_TELEMETRY_OFF (467.967 µs) : 447, 489 . : milestone, 468, tracing (448.486 µs) : 427, 470 . : milestone, 448, section candidate no_agent (368.125 µs) : 349, 387 . : milestone, 368, iast (480.283 µs) : 459, 501 . : milestone, 480, iast_FULL (555.022 µs) : 534, 576 . : milestone, 555, iast_GLOBAL (505.003 µs) : 483, 527 . : milestone, 505, iast_HARDCODED_SECRET_DISABLED (486.305 µs) : 465, 507 . : milestone, 486, iast_INACTIVE (447.226 µs) : 426, 469 . : milestone, 447, iast_TELEMETRY_OFF (469.329 µs) : 448, 490 . : milestone, 469, tracing (441.077 µs) : 421, 461 . : milestone, 441, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|371.734 µs [350.973 µs, 392.496 µs]|-| |iast|480.042 µs [458.884 µs, 501.2 µs]|108.308 µs (29.1%)| |iast_FULL|549.976 µs [528.996 µs, 570.957 µs]|178.242 µs (47.9%)| |iast_GLOBAL|505.858 µs [483.852 µs, 527.864 µs]|134.124 µs (36.1%)| |iast_HARDCODED_SECRET_DISABLED|486.94 µs [465.684 µs, 508.197 µs]|115.206 µs (31.0%)| |iast_INACTIVE|443.831 µs [423.453 µs, 464.209 µs]|72.097 µs (19.4%)| |iast_TELEMETRY_OFF|467.967 µs [446.892 µs, 489.042 µs]|96.233 µs (25.9%)| |tracing|448.486 µs [427.184 µs, 469.788 µs]|76.752 µs (20.6%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|368.125 µs [348.897 µs, 387.353 µs]|-| |iast|480.283 µs [459.168 µs, 501.398 µs]|112.158 µs (30.5%)| |iast_FULL|555.022 µs [533.656 µs, 576.388 µs]|186.897 µs (50.8%)| |iast_GLOBAL|505.003 µs [482.746 µs, 527.26 µs]|136.878 µs (37.2%)| |iast_HARDCODED_SECRET_DISABLED|486.305 µs [465.292 µs, 507.317 µs]|118.18 µs (32.1%)| |iast_INACTIVE|447.226 µs [425.838 µs, 468.614 µs]|79.101 µs (21.5%)| |iast_TELEMETRY_OFF|469.329 µs [448.436 µs, 490.223 µs]|101.205 µs (27.5%)| |tracing|441.077 µs [420.753 µs, 461.401 µs]|72.952 µs (19.8%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master andrea.marziali/reactor-rebirth
git_commit_date 1728548937 1728570335
git_commit_sha 70c9598d61 c367127391
release_version 1.41.0-SNAPSHOT~70c9598d61 1.41.0-SNAPSHOT~c367127391
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1728572921 |1728572921 | |ci_job_id |668489031 |668489031 | |ci_pipeline_id|46291596 |46291596 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~c367127391, baseline=1.41.0-SNAPSHOT~70c9598d61 dateFormat X axisFormat %s section baseline no_agent (14.963 s) : 14963000, 14963000 . : milestone, 14963000, appsec (14.922 s) : 14922000, 14922000 . : milestone, 14922000, iast (18.597 s) : 18597000, 18597000 . : milestone, 18597000, iast_GLOBAL (18.002 s) : 18002000, 18002000 . : milestone, 18002000, profiling (15.076 s) : 15076000, 15076000 . : milestone, 15076000, tracing (15.295 s) : 15295000, 15295000 . : milestone, 15295000, section candidate no_agent (15.681 s) : 15681000, 15681000 . : milestone, 15681000, appsec (15.138 s) : 15138000, 15138000 . : milestone, 15138000, iast (18.711 s) : 18711000, 18711000 . : milestone, 18711000, iast_GLOBAL (17.786 s) : 17786000, 17786000 . : milestone, 17786000, profiling (15.06 s) : 15060000, 15060000 . : milestone, 15060000, tracing (15.475 s) : 15475000, 15475000 . : milestone, 15475000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.963 s [14.963 s, 14.963 s]|-| |appsec|14.922 s [14.922 s, 14.922 s]|-41.0 ms (-0.3%)| |iast|18.597 s [18.597 s, 18.597 s]|3.634 s (24.3%)| |iast_GLOBAL|18.002 s [18.002 s, 18.002 s]|3.039 s (20.3%)| |profiling|15.076 s [15.076 s, 15.076 s]|113.0 ms (0.8%)| |tracing|15.295 s [15.295 s, 15.295 s]|332.0 ms (2.2%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.681 s [15.681 s, 15.681 s]|-| |appsec|15.138 s [15.138 s, 15.138 s]|-543.0 ms (-3.5%)| |iast|18.711 s [18.711 s, 18.711 s]|3.03 s (19.3%)| |iast_GLOBAL|17.786 s [17.786 s, 17.786 s]|2.105 s (13.4%)| |profiling|15.06 s [15.06 s, 15.06 s]|-621.0 ms (-4.0%)| |tracing|15.475 s [15.475 s, 15.475 s]|-206.0 ms (-1.3%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~c367127391, baseline=1.41.0-SNAPSHOT~70c9598d61 dateFormat X axisFormat %s section baseline no_agent (1.47 ms) : 1458, 1481 . : milestone, 1470, appsec (2.336 ms) : 2295, 2376 . : milestone, 2336, iast (2.065 ms) : 2013, 2116 . : milestone, 2065, iast_GLOBAL (2.107 ms) : 2055, 2159 . : milestone, 2107, profiling (1.943 ms) : 1901, 1984 . : milestone, 1943, tracing (1.916 ms) : 1876, 1955 . : milestone, 1916, section candidate no_agent (1.461 ms) : 1450, 1472 . : milestone, 1461, appsec (2.338 ms) : 2298, 2379 . : milestone, 2338, iast (2.063 ms) : 2012, 2114 . : milestone, 2063, iast_GLOBAL (2.113 ms) : 2060, 2165 . : milestone, 2113, profiling (2.414 ms) : 2226, 2602 . : milestone, 2414, tracing (1.915 ms) : 1876, 1954 . : milestone, 1915, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.47 ms [1.458 ms, 1.481 ms]|-| |appsec|2.336 ms [2.295 ms, 2.376 ms]|866.034 µs (58.9%)| |iast|2.065 ms [2.013 ms, 2.116 ms]|595.008 µs (40.5%)| |iast_GLOBAL|2.107 ms [2.055 ms, 2.159 ms]|637.731 µs (43.4%)| |profiling|1.943 ms [1.901 ms, 1.984 ms]|473.39 µs (32.2%)| |tracing|1.916 ms [1.876 ms, 1.955 ms]|446.137 µs (30.4%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.461 ms [1.45 ms, 1.472 ms]|-| |appsec|2.338 ms [2.298 ms, 2.379 ms]|877.483 µs (60.1%)| |iast|2.063 ms [2.012 ms, 2.114 ms]|601.96 µs (41.2%)| |iast_GLOBAL|2.113 ms [2.06 ms, 2.165 ms]|651.851 µs (44.6%)| |profiling|2.414 ms [2.226 ms, 2.602 ms]|952.767 µs (65.2%)| |tracing|1.915 ms [1.876 ms, 1.954 ms]|454.192 µs (31.1%)|