DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Improve BUILDING.md #7781

Closed sarahchen6 closed 1 month ago

sarahchen6 commented 1 month ago

What Does This Do

Improve BUILDING.md clarity and organization.

Motivation

This document is very helpful for java onboarding and general referencing. While going through it myself, I thought the document could be edited and improved for clarity and organization.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/update-building-doc
git_commit_date 1729113612 1729115035
git_commit_sha b53b6dc565 dfc0bb3a71
release_version 1.41.0-SNAPSHOT~b53b6dc565 1.41.0-SNAPSHOT~dfc0bb3a71
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729117468 |1729117468 | |ci_job_id |674825169 |674825169 | |ci_pipeline_id|46775393 |46775393 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 56 metrics, 7 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.41.0-SNAPSHOT~dfc0bb3a71, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section tracing Agent [baseline] (1.08 s) : 0, 1080399 Total [baseline] (10.441 s) : 0, 10441125 Agent [candidate] (1.075 s) : 0, 1075048 Total [candidate] (10.387 s) : 0, 10386512 section appsec Agent [baseline] (1.21 s) : 0, 1210261 Total [baseline] (10.581 s) : 0, 10581201 Agent [candidate] (1.207 s) : 0, 1207386 Total [candidate] (10.676 s) : 0, 10676221 section iast Agent [baseline] (1.201 s) : 0, 1200502 Total [baseline] (10.838 s) : 0, 10838479 Agent [candidate] (1.2 s) : 0, 1199949 Total [candidate] (10.866 s) : 0, 10866168 section profiling Agent [baseline] (1.272 s) : 0, 1272209 Total [baseline] (10.655 s) : 0, 10654519 Agent [candidate] (1.279 s) : 0, 1279232 Total [candidate] (10.842 s) : 0, 10842384 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.08 s |-| |Agent|appsec|1.21 s |129.862 ms (12.0%)| |Agent|iast|1.201 s |120.103 ms (11.1%)| |Agent|profiling|1.272 s |191.811 ms (17.8%)| |Total|tracing|10.441 s |-| |Total|appsec|10.581 s |140.077 ms (1.3%)| |Total|iast|10.838 s |397.355 ms (3.8%)| |Total|profiling|10.655 s |213.394 ms (2.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.075 s |-| |Agent|appsec|1.207 s |132.339 ms (12.3%)| |Agent|iast|1.2 s |124.902 ms (11.6%)| |Agent|profiling|1.279 s |204.185 ms (19.0%)| |Total|tracing|10.387 s |-| |Total|appsec|10.676 s |289.709 ms (2.8%)| |Total|iast|10.866 s |479.656 ms (4.6%)| |Total|profiling|10.842 s |455.873 ms (4.4%)| ```mermaid gantt title petclinic - break down per module: candidate=1.41.0-SNAPSHOT~dfc0bb3a71, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (688.903 ms) : 0, 688903 BytebuddyAgent [candidate] (684.396 ms) : 0, 684396 GlobalTracer [baseline] (315.349 ms) : 0, 315349 GlobalTracer [candidate] (314.492 ms) : 0, 314492 AppSec [baseline] (54.013 ms) : 0, 54013 AppSec [candidate] (54.215 ms) : 0, 54215 Remote Config [baseline] (675.023 µs) : 0, 675 Remote Config [candidate] (653.909 µs) : 0, 654 Telemetry [baseline] (7.635 ms) : 0, 7635 Telemetry [candidate] (7.54 ms) : 0, 7540 section appsec BytebuddyAgent [baseline] (703.143 ms) : 0, 703143 BytebuddyAgent [candidate] (700.574 ms) : 0, 700574 GlobalTracer [baseline] (310.873 ms) : 0, 310873 GlobalTracer [candidate] (310.493 ms) : 0, 310493 AppSec [baseline] (163.465 ms) : 0, 163465 AppSec [candidate] (162.305 ms) : 0, 162305 IAST [baseline] (19.185 ms) : 0, 19185 IAST [candidate] (23.04 ms) : 0, 23040 Remote Config [baseline] (635.375 µs) : 0, 635 Remote Config [candidate] (629.601 µs) : 0, 630 Telemetry [baseline] (8.813 ms) : 0, 8813 Telemetry [candidate] (8.1 ms) : 0, 8100 section iast BytebuddyAgent [baseline] (799.047 ms) : 0, 799047 BytebuddyAgent [candidate] (798.055 ms) : 0, 798055 GlobalTracer [baseline] (301.819 ms) : 0, 301819 GlobalTracer [candidate] (302.094 ms) : 0, 302094 AppSec [baseline] (57.724 ms) : 0, 57724 AppSec [candidate] (57.024 ms) : 0, 57024 IAST [baseline] (20.476 ms) : 0, 20476 IAST [candidate] (21.3 ms) : 0, 21300 Remote Config [baseline] (609.053 µs) : 0, 609 Remote Config [candidate] (605.794 µs) : 0, 606 Telemetry [baseline] (7.115 ms) : 0, 7115 Telemetry [candidate] (7.124 ms) : 0, 7124 section profiling BytebuddyAgent [baseline] (677.82 ms) : 0, 677820 BytebuddyAgent [candidate] (679.848 ms) : 0, 679848 GlobalTracer [baseline] (396.345 ms) : 0, 396345 GlobalTracer [candidate] (398.861 ms) : 0, 398861 AppSec [baseline] (54.474 ms) : 0, 54474 AppSec [candidate] (55.094 ms) : 0, 55094 Remote Config [baseline] (646.718 µs) : 0, 647 Remote Config [candidate] (654.597 µs) : 0, 655 Telemetry [baseline] (7.467 ms) : 0, 7467 Telemetry [candidate] (7.509 ms) : 0, 7509 ProfilingAgent [baseline] (96.639 ms) : 0, 96639 ProfilingAgent [candidate] (98.322 ms) : 0, 98322 Profiling [baseline] (96.663 ms) : 0, 96663 Profiling [candidate] (98.346 ms) : 0, 98346 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.41.0-SNAPSHOT~dfc0bb3a71, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section tracing Agent [baseline] (1.076 s) : 0, 1075729 Total [baseline] (8.62 s) : 0, 8619750 Agent [candidate] (1.087 s) : 0, 1087156 Total [candidate] (8.623 s) : 0, 8622631 section iast Agent [baseline] (1.198 s) : 0, 1198495 Total [baseline] (9.073 s) : 0, 9073117 Agent [candidate] (1.204 s) : 0, 1204095 Total [candidate] (9.155 s) : 0, 9154620 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.204 s) : 0, 1203638 Total [baseline] (9.061 s) : 0, 9061235 Agent [candidate] (1.204 s) : 0, 1203591 Total [candidate] (9.107 s) : 0, 9107067 section iast_TELEMETRY_OFF Agent [baseline] (1.198 s) : 0, 1197771 Total [baseline] (9.083 s) : 0, 9083107 Agent [candidate] (1.196 s) : 0, 1196389 Total [candidate] (9.102 s) : 0, 9102085 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.076 s |-| |Agent|iast|1.198 s |122.765 ms (11.4%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.204 s |127.908 ms (11.9%)| |Agent|iast_TELEMETRY_OFF|1.198 s |122.041 ms (11.3%)| |Total|tracing|8.62 s |-| |Total|iast|9.073 s |453.367 ms (5.3%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.061 s |441.485 ms (5.1%)| |Total|iast_TELEMETRY_OFF|9.083 s |463.357 ms (5.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.087 s |-| |Agent|iast|1.204 s |116.938 ms (10.8%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.204 s |116.435 ms (10.7%)| |Agent|iast_TELEMETRY_OFF|1.196 s |109.233 ms (10.0%)| |Total|tracing|8.623 s |-| |Total|iast|9.155 s |531.989 ms (6.2%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.107 s |484.436 ms (5.6%)| |Total|iast_TELEMETRY_OFF|9.102 s |479.454 ms (5.6%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.41.0-SNAPSHOT~dfc0bb3a71, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (685.852 ms) : 0, 685852 BytebuddyAgent [candidate] (692.89 ms) : 0, 692890 GlobalTracer [baseline] (313.751 ms) : 0, 313751 GlobalTracer [candidate] (317.249 ms) : 0, 317249 AppSec [baseline] (54.105 ms) : 0, 54105 AppSec [candidate] (54.816 ms) : 0, 54816 Remote Config [baseline] (666.37 µs) : 0, 666 Remote Config [candidate] (665.732 µs) : 0, 666 Telemetry [baseline] (7.524 ms) : 0, 7524 Telemetry [candidate] (7.595 ms) : 0, 7595 section iast BytebuddyAgent [baseline] (797.575 ms) : 0, 797575 BytebuddyAgent [candidate] (802.145 ms) : 0, 802145 GlobalTracer [baseline] (301.79 ms) : 0, 301790 GlobalTracer [candidate] (301.999 ms) : 0, 301999 AppSec [baseline] (55.792 ms) : 0, 55792 AppSec [candidate] (56.415 ms) : 0, 56415 IAST [baseline] (21.962 ms) : 0, 21962 IAST [candidate] (22.047 ms) : 0, 22047 Remote Config [baseline] (602.311 µs) : 0, 602 Remote Config [candidate] (605.438 µs) : 0, 605 Telemetry [baseline] (7.041 ms) : 0, 7041 Telemetry [candidate] (7.023 ms) : 0, 7023 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (800.29 ms) : 0, 800290 BytebuddyAgent [candidate] (801.399 ms) : 0, 801399 GlobalTracer [baseline] (302.854 ms) : 0, 302854 GlobalTracer [candidate] (301.767 ms) : 0, 301767 AppSec [baseline] (56.684 ms) : 0, 56684 AppSec [candidate] (56.652 ms) : 0, 56652 IAST [baseline] (22.269 ms) : 0, 22269 IAST [candidate] (22.222 ms) : 0, 22222 Remote Config [baseline] (622.385 µs) : 0, 622 Remote Config [candidate] (608.966 µs) : 0, 609 Telemetry [baseline] (7.129 ms) : 0, 7129 Telemetry [candidate] (7.073 ms) : 0, 7073 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (795.508 ms) : 0, 795508 BytebuddyAgent [candidate] (794.232 ms) : 0, 794232 GlobalTracer [baseline] (302.956 ms) : 0, 302956 GlobalTracer [candidate] (302.318 ms) : 0, 302318 AppSec [baseline] (56.26 ms) : 0, 56260 AppSec [candidate] (54.962 ms) : 0, 54962 IAST [baseline] (21.747 ms) : 0, 21747 IAST [candidate] (23.399 ms) : 0, 23399 Remote Config [baseline] (603.118 µs) : 0, 603 Remote Config [candidate] (608.478 µs) : 0, 608 Telemetry [baseline] (6.995 ms) : 0, 6995 Telemetry [candidate] (7.062 ms) : 0, 7062 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-10-16T21:54:48 2024-10-16T22:01:37
git_branch master sarahchen6/update-building-doc
git_commit_date 1729113612 1729115035
git_commit_sha b53b6dc565 dfc0bb3a71
release_version 1.41.0-SNAPSHOT~b53b6dc565 1.41.0-SNAPSHOT~dfc0bb3a71
start_time 2024-10-16T21:54:34 2024-10-16T22:01:24
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1729116442 |1729116442 | |ci_job_id |674825171 |674825171 | |ci_pipeline_id|46775393 |46775393 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 17 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~dfc0bb3a71, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section baseline no_agent (1.341 ms) : 1321, 1360 . : milestone, 1341, appsec (1.702 ms) : 1678, 1726 . : milestone, 1702, appsec_no_iast (1.727 ms) : 1702, 1751 . : milestone, 1727, iast (1.473 ms) : 1450, 1496 . : milestone, 1473, profiling (1.483 ms) : 1458, 1507 . : milestone, 1483, tracing (1.454 ms) : 1429, 1478 . : milestone, 1454, section candidate no_agent (1.34 ms) : 1321, 1359 . : milestone, 1340, appsec (1.709 ms) : 1686, 1732 . : milestone, 1709, appsec_no_iast (1.742 ms) : 1718, 1766 . : milestone, 1742, iast (1.485 ms) : 1462, 1508 . : milestone, 1485, profiling (1.464 ms) : 1441, 1487 . : milestone, 1464, tracing (1.46 ms) : 1435, 1485 . : milestone, 1460, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.341 ms [1.321 ms, 1.36 ms]|-| |appsec|1.702 ms [1.678 ms, 1.726 ms]|361.104 µs (26.9%)| |appsec_no_iast|1.727 ms [1.702 ms, 1.751 ms]|385.981 µs (28.8%)| |iast|1.473 ms [1.45 ms, 1.496 ms]|132.249 µs (9.9%)| |profiling|1.483 ms [1.458 ms, 1.507 ms]|142.001 µs (10.6%)| |tracing|1.454 ms [1.429 ms, 1.478 ms]|112.992 µs (8.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.34 ms [1.321 ms, 1.359 ms]|-| |appsec|1.709 ms [1.686 ms, 1.732 ms]|368.706 µs (27.5%)| |appsec_no_iast|1.742 ms [1.718 ms, 1.766 ms]|401.653 µs (30.0%)| |iast|1.485 ms [1.462 ms, 1.508 ms]|144.381 µs (10.8%)| |profiling|1.464 ms [1.441 ms, 1.487 ms]|123.885 µs (9.2%)| |tracing|1.46 ms [1.435 ms, 1.485 ms]|119.835 µs (8.9%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.41.0-SNAPSHOT~dfc0bb3a71, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section baseline no_agent (371.824 µs) : 350, 393 . : milestone, 372, iast (480.943 µs) : 460, 502 . : milestone, 481, iast_FULL (547.152 µs) : 526, 568 . : milestone, 547, iast_GLOBAL (504.414 µs) : 483, 526 . : milestone, 504, iast_HARDCODED_SECRET_DISABLED (484.897 µs) : 464, 506 . : milestone, 485, iast_INACTIVE (442.842 µs) : 422, 463 . : milestone, 443, iast_TELEMETRY_OFF (473.231 µs) : 452, 494 . : milestone, 473, tracing (440.388 µs) : 420, 461 . : milestone, 440, section candidate no_agent (371.269 µs) : 352, 391 . : milestone, 371, iast (481.757 µs) : 460, 503 . : milestone, 482, iast_FULL (551.09 µs) : 530, 573 . : milestone, 551, iast_GLOBAL (502.244 µs) : 481, 523 . : milestone, 502, iast_HARDCODED_SECRET_DISABLED (484.775 µs) : 463, 506 . : milestone, 485, iast_INACTIVE (441.088 µs) : 420, 462 . : milestone, 441, iast_TELEMETRY_OFF (471.519 µs) : 450, 493 . : milestone, 472, tracing (442.93 µs) : 422, 463 . : milestone, 443, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|371.824 µs [350.493 µs, 393.154 µs]|-| |iast|480.943 µs [459.881 µs, 502.004 µs]|109.119 µs (29.3%)| |iast_FULL|547.152 µs [525.897 µs, 568.407 µs]|175.328 µs (47.2%)| |iast_GLOBAL|504.414 µs [482.967 µs, 525.86 µs]|132.59 µs (35.7%)| |iast_HARDCODED_SECRET_DISABLED|484.897 µs [463.808 µs, 505.986 µs]|113.074 µs (30.4%)| |iast_INACTIVE|442.842 µs [422.275 µs, 463.409 µs]|71.019 µs (19.1%)| |iast_TELEMETRY_OFF|473.231 µs [452.039 µs, 494.423 µs]|101.408 µs (27.3%)| |tracing|440.388 µs [419.572 µs, 461.205 µs]|68.565 µs (18.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|371.269 µs [351.703 µs, 390.836 µs]|-| |iast|481.757 µs [460.307 µs, 503.208 µs]|110.488 µs (29.8%)| |iast_FULL|551.09 µs [529.673 µs, 572.507 µs]|179.821 µs (48.4%)| |iast_GLOBAL|502.244 µs [481.069 µs, 523.418 µs]|130.974 µs (35.3%)| |iast_HARDCODED_SECRET_DISABLED|484.775 µs [463.246 µs, 506.304 µs]|113.505 µs (30.6%)| |iast_INACTIVE|441.088 µs [420.326 µs, 461.849 µs]|69.818 µs (18.8%)| |iast_TELEMETRY_OFF|471.519 µs [449.899 µs, 493.139 µs]|100.249 µs (27.0%)| |tracing|442.93 µs [422.486 µs, 463.374 µs]|71.661 µs (19.3%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master sarahchen6/update-building-doc
git_commit_date 1729113612 1729115035
git_commit_sha b53b6dc565 dfc0bb3a71
release_version 1.41.0-SNAPSHOT~b53b6dc565 1.41.0-SNAPSHOT~dfc0bb3a71
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1729116981 |1729116981 | |ci_job_id |674825173 |674825173 | |ci_pipeline_id|46775393 |46775393 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~dfc0bb3a71, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section baseline no_agent (1.476 ms) : 1464, 1487 . : milestone, 1476, appsec (2.336 ms) : 2295, 2377 . : milestone, 2336, iast (2.077 ms) : 2025, 2129 . : milestone, 2077, iast_GLOBAL (2.126 ms) : 2074, 2179 . : milestone, 2126, profiling (1.955 ms) : 1912, 1997 . : milestone, 1955, tracing (1.926 ms) : 1886, 1965 . : milestone, 1926, section candidate no_agent (1.469 ms) : 1457, 1480 . : milestone, 1469, appsec (2.326 ms) : 2285, 2367 . : milestone, 2326, iast (2.07 ms) : 2019, 2122 . : milestone, 2070, iast_GLOBAL (2.118 ms) : 2066, 2171 . : milestone, 2118, profiling (1.935 ms) : 1893, 1976 . : milestone, 1935, tracing (1.924 ms) : 1884, 1964 . : milestone, 1924, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.476 ms [1.464 ms, 1.487 ms]|-| |appsec|2.336 ms [2.295 ms, 2.377 ms]|860.279 µs (58.3%)| |iast|2.077 ms [2.025 ms, 2.129 ms]|601.072 µs (40.7%)| |iast_GLOBAL|2.126 ms [2.074 ms, 2.179 ms]|650.541 µs (44.1%)| |profiling|1.955 ms [1.912 ms, 1.997 ms]|478.959 µs (32.5%)| |tracing|1.926 ms [1.886 ms, 1.965 ms]|450.093 µs (30.5%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.469 ms [1.457 ms, 1.48 ms]|-| |appsec|2.326 ms [2.285 ms, 2.367 ms]|857.315 µs (58.4%)| |iast|2.07 ms [2.019 ms, 2.122 ms]|601.689 µs (41.0%)| |iast_GLOBAL|2.118 ms [2.066 ms, 2.171 ms]|649.885 µs (44.3%)| |profiling|1.935 ms [1.893 ms, 1.976 ms]|466.076 µs (31.7%)| |tracing|1.924 ms [1.884 ms, 1.964 ms]|455.56 µs (31.0%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.41.0-SNAPSHOT~dfc0bb3a71, baseline=1.41.0-SNAPSHOT~b53b6dc565 dateFormat X axisFormat %s section baseline no_agent (15.381 s) : 15381000, 15381000 . : milestone, 15381000, appsec (15.371 s) : 15371000, 15371000 . : milestone, 15371000, iast (18.61 s) : 18610000, 18610000 . : milestone, 18610000, iast_GLOBAL (18.135 s) : 18135000, 18135000 . : milestone, 18135000, profiling (14.991 s) : 14991000, 14991000 . : milestone, 14991000, tracing (14.905 s) : 14905000, 14905000 . : milestone, 14905000, section candidate no_agent (15.552 s) : 15552000, 15552000 . : milestone, 15552000, appsec (15.249 s) : 15249000, 15249000 . : milestone, 15249000, iast (18.666 s) : 18666000, 18666000 . : milestone, 18666000, iast_GLOBAL (17.893 s) : 17893000, 17893000 . : milestone, 17893000, profiling (15.674 s) : 15674000, 15674000 . : milestone, 15674000, tracing (15.268 s) : 15268000, 15268000 . : milestone, 15268000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.381 s [15.381 s, 15.381 s]|-| |appsec|15.371 s [15.371 s, 15.371 s]|-10.0 ms (-0.1%)| |iast|18.61 s [18.61 s, 18.61 s]|3.229 s (21.0%)| |iast_GLOBAL|18.135 s [18.135 s, 18.135 s]|2.754 s (17.9%)| |profiling|14.991 s [14.991 s, 14.991 s]|-390.0 ms (-2.5%)| |tracing|14.905 s [14.905 s, 14.905 s]|-476.0 ms (-3.1%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.552 s [15.552 s, 15.552 s]|-| |appsec|15.249 s [15.249 s, 15.249 s]|-303.0 ms (-1.9%)| |iast|18.666 s [18.666 s, 18.666 s]|3.114 s (20.0%)| |iast_GLOBAL|17.893 s [17.893 s, 17.893 s]|2.341 s (15.1%)| |profiling|15.674 s [15.674 s, 15.674 s]|122.0 ms (0.8%)| |tracing|15.268 s [15.268 s, 15.268 s]|-284.0 ms (-1.8%)|