search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Extract AWS payload tags #7811

Closed ygree closed 2 weeks ago

ygree commented 1 month ago

What Does This Do

AWS Payload Tag Extraction

Adds functionality to capture AWS JSON response/request payload and convert it to span tags while applying default and user defined redaction rules. It also tries to expand any possibly embedded JSON-like string and binary data.

Aside from the original PR, which was just capturing a raw response/request body and trying to parse it as JSON, it takes a different approach to tackling this by using SdkPojo for top-level field traversal, which allows us to:

Motivation

Having the ability to see data that was passed into an HTTPS payload from one service to the other. Help customers (especially those who are using serverless architecture) reproduce and resolve bugs in their serverless compute code or configuration.

Additional Notes

Supersedes #7312

Jira ticket: AIDM-174

NodeJS: https://github.com/DataDog/dd-trace-js/pull/4309 Python: https://github.com/DataDog/dd-trace-py/pull/10642

Example 1: S3

 TODO

Example 2: Sso

 (manually enabled with custom redaction rules) TODO

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/aws-payload-tagging-2
git_commit_date 1730486404 1730491923
git_commit_sha d46416d5b6 b49f9a4d18
release_version 1.42.0-SNAPSHOT~d46416d5b6 1.42.0-SNAPSHOT~b49f9a4d18
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1730494874 |1730494874 | |ci_job_id |693114335 |693114335 | |ci_pipeline_id|48076720 |48076720 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 55 metrics, 8 unstable metrics.

Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6 dateFormat X axisFormat %s section tracing Agent [baseline] (1.08 s) : 0, 1080407 Total [baseline] (8.58 s) : 0, 8579705 Agent [candidate] (1.081 s) : 0, 1081483 Total [candidate] (8.548 s) : 0, 8547934 section iast Agent [baseline] (1.214 s) : 0, 1214271 Total [baseline] (9.14 s) : 0, 9139816 Agent [candidate] (1.211 s) : 0, 1211405 Total [candidate] (9.16 s) : 0, 9159944 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.221 s) : 0, 1221225 Total [baseline] (9.135 s) : 0, 9135082 Agent [candidate] (1.206 s) : 0, 1205718 Total [candidate] (9.093 s) : 0, 9092956 section iast_TELEMETRY_OFF Agent [baseline] (1.213 s) : 0, 1212757 Total [baseline] (9.14 s) : 0, 9139562 Agent [candidate] (1.201 s) : 0, 1201292 Total [candidate] (9.134 s) : 0, 9134322 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.08 s |-| |Agent|iast|1.214 s |133.864 ms (12.4%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.221 s |140.818 ms (13.0%)| |Agent|iast_TELEMETRY_OFF|1.213 s |132.35 ms (12.3%)| |Total|tracing|8.58 s |-| |Total|iast|9.14 s |560.111 ms (6.5%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.135 s |555.378 ms (6.5%)| |Total|iast_TELEMETRY_OFF|9.14 s |559.857 ms (6.5%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.081 s |-| |Agent|iast|1.211 s |129.922 ms (12.0%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.206 s |124.235 ms (11.5%)| |Agent|iast_TELEMETRY_OFF|1.201 s |119.809 ms (11.1%)| |Total|tracing|8.548 s |-| |Total|iast|9.16 s |612.01 ms (7.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.093 s |545.022 ms (6.4%)| |Total|iast_TELEMETRY_OFF|9.134 s |586.388 ms (6.9%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (687.164 ms) : 0, 687164 BytebuddyAgent [candidate] (686.754 ms) : 0, 686754 GlobalTracer [baseline] (316.562 ms) : 0, 316562 GlobalTracer [candidate] (316.176 ms) : 0, 316176 AppSec [baseline] (53.927 ms) : 0, 53927 AppSec [candidate] (53.866 ms) : 0, 53866 Remote Config [baseline] (657.668 µs) : 0, 658 Remote Config [candidate] (658.413 µs) : 0, 658 Telemetry [baseline] (8.421 ms) : 0, 8421 Telemetry [candidate] (10.379 ms) : 0, 10379 section iast BytebuddyAgent [baseline] (807.861 ms) : 0, 807861 BytebuddyAgent [candidate] (805.683 ms) : 0, 805683 GlobalTracer [baseline] (306.279 ms) : 0, 306279 GlobalTracer [candidate] (305.045 ms) : 0, 305045 AppSec [baseline] (56.859 ms) : 0, 56859 AppSec [candidate] (57.782 ms) : 0, 57782 IAST [baseline] (21.387 ms) : 0, 21387 IAST [candidate] (20.907 ms) : 0, 20907 Remote Config [baseline] (625.956 µs) : 0, 626 Remote Config [candidate] (627.07 µs) : 0, 627 Telemetry [baseline] (7.477 ms) : 0, 7477 Telemetry [candidate] (7.619 ms) : 0, 7619 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (813.504 ms) : 0, 813504 BytebuddyAgent [candidate] (801.683 ms) : 0, 801683 GlobalTracer [baseline] (306.885 ms) : 0, 306885 GlobalTracer [candidate] (304.806 ms) : 0, 304806 AppSec [baseline] (57.236 ms) : 0, 57236 AppSec [candidate] (56.465 ms) : 0, 56465 IAST [baseline] (21.605 ms) : 0, 21605 IAST [candidate] (21.011 ms) : 0, 21011 Remote Config [baseline] (617.591 µs) : 0, 618 Remote Config [candidate] (598.526 µs) : 0, 599 Telemetry [baseline] (7.545 ms) : 0, 7545 Telemetry [candidate] (7.479 ms) : 0, 7479 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (806.324 ms) : 0, 806324 BytebuddyAgent [candidate] (798.116 ms) : 0, 798116 GlobalTracer [baseline] (306.974 ms) : 0, 306974 GlobalTracer [candidate] (304.683 ms) : 0, 304683 AppSec [baseline] (57.331 ms) : 0, 57331 AppSec [candidate] (57.186 ms) : 0, 57186 IAST [baseline] (20.339 ms) : 0, 20339 IAST [candidate] (19.828 ms) : 0, 19828 Remote Config [baseline] (615.884 µs) : 0, 616 Remote Config [candidate] (595.253 µs) : 0, 595 Telemetry [baseline] (7.414 ms) : 0, 7414 Telemetry [candidate] (7.258 ms) : 0, 7258 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6 dateFormat X axisFormat %s section tracing Agent [baseline] (1.082 s) : 0, 1081879 Total [baseline] (10.361 s) : 0, 10361061 Agent [candidate] (1.086 s) : 0, 1086051 Total [candidate] (10.391 s) : 0, 10390934 section appsec Agent [baseline] (1.218 s) : 0, 1217638 Total [baseline] (10.65 s) : 0, 10650348 Agent [candidate] (1.22 s) : 0, 1220292 Total [candidate] (10.684 s) : 0, 10683738 section iast Agent [baseline] (1.206 s) : 0, 1205619 Total [baseline] (10.939 s) : 0, 10938973 Agent [candidate] (1.207 s) : 0, 1206655 Total [candidate] (10.891 s) : 0, 10891090 section profiling Agent [baseline] (1.285 s) : 0, 1284949 Total [baseline] (10.775 s) : 0, 10774873 Agent [candidate] (1.283 s) : 0, 1282799 Total [candidate] (10.721 s) : 0, 10721146 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.082 s |-| |Agent|appsec|1.218 s |135.758 ms (12.5%)| |Agent|iast|1.206 s |123.74 ms (11.4%)| |Agent|profiling|1.285 s |203.07 ms (18.8%)| |Total|tracing|10.361 s |-| |Total|appsec|10.65 s |289.287 ms (2.8%)| |Total|iast|10.939 s |577.912 ms (5.6%)| |Total|profiling|10.775 s |413.812 ms (4.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.086 s |-| |Agent|appsec|1.22 s |134.241 ms (12.4%)| |Agent|iast|1.207 s |120.604 ms (11.1%)| |Agent|profiling|1.283 s |196.747 ms (18.1%)| |Total|tracing|10.391 s |-| |Total|appsec|10.684 s |292.804 ms (2.8%)| |Total|iast|10.891 s |500.156 ms (4.8%)| |Total|profiling|10.721 s |330.212 ms (3.2%)| ```mermaid gantt title petclinic - break down per module: candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (687.163 ms) : 0, 687163 BytebuddyAgent [candidate] (690.509 ms) : 0, 690509 GlobalTracer [baseline] (316.458 ms) : 0, 316458 GlobalTracer [candidate] (316.235 ms) : 0, 316235 AppSec [baseline] (54.08 ms) : 0, 54080 AppSec [candidate] (54.301 ms) : 0, 54301 Remote Config [baseline] (656.756 µs) : 0, 657 Remote Config [candidate] (661.377 µs) : 0, 661 Telemetry [baseline] (9.849 ms) : 0, 9849 Telemetry [candidate] (10.622 ms) : 0, 10622 section appsec BytebuddyAgent [baseline] (705.238 ms) : 0, 705238 BytebuddyAgent [candidate] (708.355 ms) : 0, 708355 GlobalTracer [baseline] (313.854 ms) : 0, 313854 GlobalTracer [candidate] (313.941 ms) : 0, 313941 AppSec [baseline] (166.424 ms) : 0, 166424 AppSec [candidate] (165.739 ms) : 0, 165739 IAST [baseline] (19.34 ms) : 0, 19340 IAST [candidate] (20.28 ms) : 0, 20280 Remote Config [baseline] (643.059 µs) : 0, 643 Remote Config [candidate] (636.138 µs) : 0, 636 Telemetry [baseline] (8.135 ms) : 0, 8135 Telemetry [candidate] (7.797 ms) : 0, 7797 section iast BytebuddyAgent [baseline] (801.674 ms) : 0, 801674 BytebuddyAgent [candidate] (802.495 ms) : 0, 802495 GlobalTracer [baseline] (304.511 ms) : 0, 304511 GlobalTracer [candidate] (305.495 ms) : 0, 305495 AppSec [baseline] (57.352 ms) : 0, 57352 AppSec [candidate] (56.668 ms) : 0, 56668 IAST [baseline] (20.446 ms) : 0, 20446 IAST [candidate] (20.386 ms) : 0, 20386 Remote Config [baseline] (607.614 µs) : 0, 608 Remote Config [candidate] (607.385 µs) : 0, 607 Telemetry [baseline] (7.375 ms) : 0, 7375 Telemetry [candidate] (7.343 ms) : 0, 7343 section profiling BytebuddyAgent [baseline] (683.841 ms) : 0, 683841 BytebuddyAgent [candidate] (683.692 ms) : 0, 683692 GlobalTracer [baseline] (401.048 ms) : 0, 401048 GlobalTracer [candidate] (400.115 ms) : 0, 400115 AppSec [baseline] (54.622 ms) : 0, 54622 AppSec [candidate] (54.61 ms) : 0, 54610 Remote Config [baseline] (673.673 µs) : 0, 674 Remote Config [candidate] (678.124 µs) : 0, 678 Telemetry [baseline] (13.516 ms) : 0, 13516 Telemetry [candidate] (13.475 ms) : 0, 13475 ProfilingAgent [baseline] (92.253 ms) : 0, 92253 ProfilingAgent [candidate] (91.153 ms) : 0, 91153 Profiling [baseline] (92.277 ms) : 0, 92277 Profiling [candidate] (91.177 ms) : 0, 91177 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-11-01T20:29:31 2024-11-01T20:36:25
git_branch master ygree/aws-payload-tagging-2
git_commit_date 1730486404 1730491923
git_commit_sha d46416d5b6 b49f9a4d18
release_version 1.42.0-SNAPSHOT~d46416d5b6 1.42.0-SNAPSHOT~b49f9a4d18
start_time 2024-11-01T20:29:18 2024-11-01T20:36:11
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1730493733 |1730493733 | |ci_job_id |693114336 |693114336 | |ci_pipeline_id|48076720 |48076720 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6 dateFormat X axisFormat %s section baseline no_agent (372.746 µs) : 353, 393 . : milestone, 373, iast (488.742 µs) : 467, 510 . : milestone, 489, iast_FULL (646.249 µs) : 625, 668 . : milestone, 646, iast_GLOBAL (508.545 µs) : 488, 530 . : milestone, 509, iast_HARDCODED_SECRET_DISABLED (490.557 µs) : 469, 512 . : milestone, 491, iast_INACTIVE (447.529 µs) : 426, 469 . : milestone, 448, iast_TELEMETRY_OFF (479.736 µs) : 459, 501 . : milestone, 480, tracing (439.083 µs) : 418, 460 . : milestone, 439, section candidate no_agent (362.256 µs) : 342, 382 . : milestone, 362, iast (490.158 µs) : 469, 512 . : milestone, 490, iast_FULL (647.71 µs) : 626, 669 . : milestone, 648, iast_GLOBAL (507.123 µs) : 486, 528 . : milestone, 507, iast_HARDCODED_SECRET_DISABLED (481.679 µs) : 461, 503 . : milestone, 482, iast_INACTIVE (449.325 µs) : 428, 470 . : milestone, 449, iast_TELEMETRY_OFF (486.318 µs) : 464, 509 . : milestone, 486, tracing (439.642 µs) : 419, 460 . : milestone, 440, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|372.746 µs [352.92 µs, 392.573 µs]|-| |iast|488.742 µs [467.35 µs, 510.134 µs]|115.996 µs (31.1%)| |iast_FULL|646.249 µs [624.974 µs, 667.524 µs]|273.503 µs (73.4%)| |iast_GLOBAL|508.545 µs [487.5 µs, 529.589 µs]|135.798 µs (36.4%)| |iast_HARDCODED_SECRET_DISABLED|490.557 µs [469.093 µs, 512.02 µs]|117.81 µs (31.6%)| |iast_INACTIVE|447.529 µs [426.485 µs, 468.573 µs]|74.783 µs (20.1%)| |iast_TELEMETRY_OFF|479.736 µs [458.532 µs, 500.94 µs]|106.989 µs (28.7%)| |tracing|439.083 µs [418.175 µs, 459.99 µs]|66.336 µs (17.8%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|362.256 µs [342.466 µs, 382.045 µs]|-| |iast|490.158 µs [468.653 µs, 511.664 µs]|127.903 µs (35.3%)| |iast_FULL|647.71 µs [626.184 µs, 669.236 µs]|285.454 µs (78.8%)| |iast_GLOBAL|507.123 µs [485.875 µs, 528.37 µs]|144.867 µs (40.0%)| |iast_HARDCODED_SECRET_DISABLED|481.679 µs [460.566 µs, 502.793 µs]|119.424 µs (33.0%)| |iast_INACTIVE|449.325 µs [428.431 µs, 470.218 µs]|87.069 µs (24.0%)| |iast_TELEMETRY_OFF|486.318 µs [463.866 µs, 508.771 µs]|124.063 µs (34.2%)| |tracing|439.642 µs [419.114 µs, 460.17 µs]|77.386 µs (21.4%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6 dateFormat X axisFormat %s section baseline no_agent (1.334 ms) : 1314, 1354 . : milestone, 1334, appsec (1.717 ms) : 1692, 1742 . : milestone, 1717, appsec_no_iast (1.71 ms) : 1686, 1735 . : milestone, 1710, iast (1.482 ms) : 1458, 1505 . : milestone, 1482, profiling (1.474 ms) : 1450, 1497 . : milestone, 1474, tracing (1.486 ms) : 1461, 1510 . : milestone, 1486, section candidate no_agent (1.332 ms) : 1312, 1352 . : milestone, 1332, appsec (1.742 ms) : 1718, 1766 . : milestone, 1742, appsec_no_iast (1.71 ms) : 1685, 1734 . : milestone, 1710, iast (1.477 ms) : 1454, 1500 . : milestone, 1477, profiling (1.494 ms) : 1470, 1517 . : milestone, 1494, tracing (1.472 ms) : 1447, 1497 . : milestone, 1472, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.334 ms [1.314 ms, 1.354 ms]|-| |appsec|1.717 ms [1.692 ms, 1.742 ms]|382.739 µs (28.7%)| |appsec_no_iast|1.71 ms [1.686 ms, 1.735 ms]|376.017 µs (28.2%)| |iast|1.482 ms [1.458 ms, 1.505 ms]|147.687 µs (11.1%)| |profiling|1.474 ms [1.45 ms, 1.497 ms]|139.418 µs (10.5%)| |tracing|1.486 ms [1.461 ms, 1.51 ms]|151.424 µs (11.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.332 ms [1.312 ms, 1.352 ms]|-| |appsec|1.742 ms [1.718 ms, 1.766 ms]|410.156 µs (30.8%)| |appsec_no_iast|1.71 ms [1.685 ms, 1.734 ms]|377.691 µs (28.4%)| |iast|1.477 ms [1.454 ms, 1.5 ms]|145.22 µs (10.9%)| |profiling|1.494 ms [1.47 ms, 1.517 ms]|161.787 µs (12.1%)| |tracing|1.472 ms [1.447 ms, 1.497 ms]|139.892 µs (10.5%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master ygree/aws-payload-tagging-2
git_commit_date 1730486404 1730491923
git_commit_sha d46416d5b6 b49f9a4d18
release_version 1.42.0-SNAPSHOT~d46416d5b6 1.42.0-SNAPSHOT~b49f9a4d18
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1730494278 |1730494278 | |ci_job_id |693114337 |693114337 | |ci_pipeline_id|48076720 |48076720 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6 dateFormat X axisFormat %s section baseline no_agent (15.079 s) : 15079000, 15079000 . : milestone, 15079000, appsec (15.384 s) : 15384000, 15384000 . : milestone, 15384000, iast (18.749 s) : 18749000, 18749000 . : milestone, 18749000, iast_GLOBAL (17.962 s) : 17962000, 17962000 . : milestone, 17962000, profiling (15.685 s) : 15685000, 15685000 . : milestone, 15685000, tracing (14.979 s) : 14979000, 14979000 . : milestone, 14979000, section candidate no_agent (15.067 s) : 15067000, 15067000 . : milestone, 15067000, appsec (15.094 s) : 15094000, 15094000 . : milestone, 15094000, iast (18.966 s) : 18966000, 18966000 . : milestone, 18966000, iast_GLOBAL (18.418 s) : 18418000, 18418000 . : milestone, 18418000, profiling (15.653 s) : 15653000, 15653000 . : milestone, 15653000, tracing (15.452 s) : 15452000, 15452000 . : milestone, 15452000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.079 s [15.079 s, 15.079 s]|-| |appsec|15.384 s [15.384 s, 15.384 s]|305.0 ms (2.0%)| |iast|18.749 s [18.749 s, 18.749 s]|3.67 s (24.3%)| |iast_GLOBAL|17.962 s [17.962 s, 17.962 s]|2.883 s (19.1%)| |profiling|15.685 s [15.685 s, 15.685 s]|606.0 ms (4.0%)| |tracing|14.979 s [14.979 s, 14.979 s]|-100.0 ms (-0.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.067 s [15.067 s, 15.067 s]|-| |appsec|15.094 s [15.094 s, 15.094 s]|27.0 ms (0.2%)| |iast|18.966 s [18.966 s, 18.966 s]|3.899 s (25.9%)| |iast_GLOBAL|18.418 s [18.418 s, 18.418 s]|3.351 s (22.2%)| |profiling|15.653 s [15.653 s, 15.653 s]|586.0 ms (3.9%)| |tracing|15.452 s [15.452 s, 15.452 s]|385.0 ms (2.6%)|
Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.42.0-SNAPSHOT~b49f9a4d18, baseline=1.42.0-SNAPSHOT~d46416d5b6 dateFormat X axisFormat %s section baseline no_agent (1.467 ms) : 1456, 1479 . : milestone, 1467, appsec (2.334 ms) : 2293, 2375 . : milestone, 2334, iast (2.075 ms) : 2023, 2127 . : milestone, 2075, iast_GLOBAL (2.121 ms) : 2069, 2173 . : milestone, 2121, profiling (2.386 ms) : 2213, 2558 . : milestone, 2386, tracing (1.909 ms) : 1870, 1948 . : milestone, 1909, section candidate no_agent (1.472 ms) : 1460, 1483 . : milestone, 1472, appsec (2.342 ms) : 2300, 2383 . : milestone, 2342, iast (2.077 ms) : 2025, 2129 . : milestone, 2077, iast_GLOBAL (2.129 ms) : 2076, 2181 . : milestone, 2129, profiling (1.952 ms) : 1910, 1995 . : milestone, 1952, tracing (1.923 ms) : 1883, 1963 . : milestone, 1923, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.467 ms [1.456 ms, 1.479 ms]|-| |appsec|2.334 ms [2.293 ms, 2.375 ms]|866.441 µs (59.0%)| |iast|2.075 ms [2.023 ms, 2.127 ms]|607.407 µs (41.4%)| |iast_GLOBAL|2.121 ms [2.069 ms, 2.173 ms]|653.573 µs (44.5%)| |profiling|2.386 ms [2.213 ms, 2.558 ms]|918.253 µs (62.6%)| |tracing|1.909 ms [1.87 ms, 1.948 ms]|441.533 µs (30.1%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.472 ms [1.46 ms, 1.483 ms]|-| |appsec|2.342 ms [2.3 ms, 2.383 ms]|869.641 µs (59.1%)| |iast|2.077 ms [2.025 ms, 2.129 ms]|604.902 µs (41.1%)| |iast_GLOBAL|2.129 ms [2.076 ms, 2.181 ms]|656.782 µs (44.6%)| |profiling|1.952 ms [1.91 ms, 1.995 ms]|480.441 µs (32.6%)| |tracing|1.923 ms [1.883 ms, 1.963 ms]|451.213 µs (30.7%)|