search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
572 stars 284 forks source link

Add pull_request extra tags for GitHub Actions #7604

Closed nikita-tkachenko-datadog closed 2 weeks ago

nikita-tkachenko-datadog commented 2 weeks ago

What Does This Do

Adds extra tags with Git metadata for Github Actions workflows that are triggered with pull_request event.

Motivation

These tags are needed by the backend. In GHA pull_request workflows HEAD does not point to the last commit in the PR, but to a commit that is the result of merging PR branch with the target branch.

Additional Notes

The extra tags are:

Contributor Checklist

Jira ticket: SDTEST-527

pr-commenter[bot] commented 2 weeks ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gha-pr-extra-tags
git_commit_date 1726062980 1726070433
git_commit_sha 4abf841368 66be571623
release_version 1.40.0-SNAPSHOT~4abf841368 1.40.0-SNAPSHOT~66be571623
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726072786 |1726072786 | |ci_job_id |635837226 |635837226 | |ci_pipeline_id|44098077 |44098077 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 50 metrics, 13 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~66be571623, baseline=1.40.0-SNAPSHOT~4abf841368 dateFormat X axisFormat %s section tracing Agent [baseline] (1.069 s) : 0, 1068588 Total [baseline] (10.503 s) : 0, 10503236 Agent [candidate] (1.072 s) : 0, 1071615 Total [candidate] (10.484 s) : 0, 10483846 section appsec Agent [baseline] (1.197 s) : 0, 1197006 Total [baseline] (10.628 s) : 0, 10628249 Agent [candidate] (1.205 s) : 0, 1204871 Total [candidate] (10.681 s) : 0, 10681423 section iast Agent [baseline] (1.196 s) : 0, 1196275 Total [baseline] (10.894 s) : 0, 10894117 Agent [candidate] (1.197 s) : 0, 1197261 Total [candidate] (10.923 s) : 0, 10923318 section profiling Agent [baseline] (1.282 s) : 0, 1282109 Total [baseline] (10.717 s) : 0, 10717471 Agent [candidate] (1.274 s) : 0, 1274282 Total [candidate] (10.718 s) : 0, 10717701 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.069 s |-| |Agent|appsec|1.197 s |128.418 ms (12.0%)| |Agent|iast|1.196 s |127.687 ms (11.9%)| |Agent|profiling|1.282 s |213.521 ms (20.0%)| |Total|tracing|10.503 s |-| |Total|appsec|10.628 s |125.013 ms (1.2%)| |Total|iast|10.894 s |390.881 ms (3.7%)| |Total|profiling|10.717 s |214.235 ms (2.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.072 s |-| |Agent|appsec|1.205 s |133.256 ms (12.4%)| |Agent|iast|1.197 s |125.646 ms (11.7%)| |Agent|profiling|1.274 s |202.667 ms (18.9%)| |Total|tracing|10.484 s |-| |Total|appsec|10.681 s |197.577 ms (1.9%)| |Total|iast|10.923 s |439.472 ms (4.2%)| |Total|profiling|10.718 s |233.856 ms (2.2%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~66be571623, baseline=1.40.0-SNAPSHOT~4abf841368 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (681.897 ms) : 0, 681897 BytebuddyAgent [candidate] (682.579 ms) : 0, 682579 GlobalTracer [baseline] (312.199 ms) : 0, 312199 GlobalTracer [candidate] (314.276 ms) : 0, 314276 AppSec [baseline] (52.332 ms) : 0, 52332 AppSec [candidate] (52.582 ms) : 0, 52582 Remote Config [baseline] (738.313 µs) : 0, 738 Remote Config [candidate] (733.544 µs) : 0, 734 Telemetry [baseline] (7.686 ms) : 0, 7686 Telemetry [candidate] (7.701 ms) : 0, 7701 section appsec BytebuddyAgent [baseline] (699.328 ms) : 0, 699328 BytebuddyAgent [candidate] (702.689 ms) : 0, 702689 GlobalTracer [baseline] (303.74 ms) : 0, 303740 GlobalTracer [candidate] (305.199 ms) : 0, 305199 AppSec [baseline] (162.002 ms) : 0, 162002 AppSec [candidate] (161.996 ms) : 0, 161996 IAST [baseline] (18.496 ms) : 0, 18496 IAST [candidate] (23.149 ms) : 0, 23149 Remote Config [baseline] (645.09 µs) : 0, 645 Remote Config [candidate] (650.1 µs) : 0, 650 Telemetry [baseline] (8.36 ms) : 0, 8360 Telemetry [candidate] (9.035 ms) : 0, 9035 section iast BytebuddyAgent [baseline] (794.528 ms) : 0, 794528 BytebuddyAgent [candidate] (794.667 ms) : 0, 794667 GlobalTracer [baseline] (301.867 ms) : 0, 301867 GlobalTracer [candidate] (302.811 ms) : 0, 302811 AppSec [baseline] (54.148 ms) : 0, 54148 AppSec [candidate] (53.898 ms) : 0, 53898 IAST [baseline] (23.102 ms) : 0, 23102 IAST [candidate] (21.543 ms) : 0, 21543 Remote Config [baseline] (1.389 ms) : 0, 1389 Remote Config [candidate] (2.981 ms) : 0, 2981 Telemetry [baseline] (7.492 ms) : 0, 7492 Telemetry [candidate] (7.604 ms) : 0, 7604 section profiling BytebuddyAgent [baseline] (684.5 ms) : 0, 684500 BytebuddyAgent [candidate] (680.365 ms) : 0, 680365 GlobalTracer [baseline] (399.867 ms) : 0, 399867 GlobalTracer [candidate] (397.258 ms) : 0, 397258 AppSec [baseline] (53.145 ms) : 0, 53145 AppSec [candidate] (52.858 ms) : 0, 52858 Remote Config [baseline] (714.216 µs) : 0, 714 Remote Config [candidate] (717.55 µs) : 0, 718 Telemetry [baseline] (7.571 ms) : 0, 7571 Telemetry [candidate] (7.505 ms) : 0, 7505 ProfilingAgent [baseline] (97.56 ms) : 0, 97560 ProfilingAgent [candidate] (97.083 ms) : 0, 97083 Profiling [baseline] (97.584 ms) : 0, 97584 Profiling [candidate] (97.107 ms) : 0, 97107 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~66be571623, baseline=1.40.0-SNAPSHOT~4abf841368 dateFormat X axisFormat %s section tracing Agent [baseline] (1.068 s) : 0, 1068385 Total [baseline] (8.555 s) : 0, 8554863 Agent [candidate] (1.068 s) : 0, 1067705 Total [candidate] (8.544 s) : 0, 8544435 section iast Agent [baseline] (1.216 s) : 0, 1216423 Total [baseline] (9.029 s) : 0, 9028569 Agent [candidate] (1.198 s) : 0, 1198165 Total [candidate] (9.032 s) : 0, 9031792 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.193 s) : 0, 1193274 Total [baseline] (9.008 s) : 0, 9008389 Agent [candidate] (1.197 s) : 0, 1196559 Total [candidate] (9.004 s) : 0, 9004071 section iast_TELEMETRY_OFF Agent [baseline] (1.196 s) : 0, 1196058 Total [baseline] (9.011 s) : 0, 9011367 Agent [candidate] (1.2 s) : 0, 1200168 Total [candidate] (9.025 s) : 0, 9025035 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.068 s |-| |Agent|iast|1.216 s |148.038 ms (13.9%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.193 s |124.888 ms (11.7%)| |Agent|iast_TELEMETRY_OFF|1.196 s |127.672 ms (12.0%)| |Total|tracing|8.555 s |-| |Total|iast|9.029 s |473.706 ms (5.5%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.008 s |453.526 ms (5.3%)| |Total|iast_TELEMETRY_OFF|9.011 s |456.504 ms (5.3%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.068 s |-| |Agent|iast|1.198 s |130.46 ms (12.2%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.197 s |128.854 ms (12.1%)| |Agent|iast_TELEMETRY_OFF|1.2 s |132.463 ms (12.4%)| |Total|tracing|8.544 s |-| |Total|iast|9.032 s |487.357 ms (5.7%)| |Total|iast_HARDCODED_SECRET_DISABLED|9.004 s |459.636 ms (5.4%)| |Total|iast_TELEMETRY_OFF|9.025 s |480.6 ms (5.6%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~66be571623, baseline=1.40.0-SNAPSHOT~4abf841368 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (681.605 ms) : 0, 681605 BytebuddyAgent [candidate] (681.703 ms) : 0, 681703 GlobalTracer [baseline] (312.736 ms) : 0, 312736 GlobalTracer [candidate] (311.934 ms) : 0, 311934 AppSec [baseline] (51.967 ms) : 0, 51967 AppSec [candidate] (51.943 ms) : 0, 51943 Remote Config [baseline] (719.441 µs) : 0, 719 Remote Config [candidate] (720.605 µs) : 0, 721 Telemetry [baseline] (7.64 ms) : 0, 7640 Telemetry [candidate] (7.685 ms) : 0, 7685 section iast BytebuddyAgent [baseline] (810.974 ms) : 0, 810974 BytebuddyAgent [candidate] (797.278 ms) : 0, 797278 GlobalTracer [baseline] (306.193 ms) : 0, 306193 GlobalTracer [candidate] (302.086 ms) : 0, 302086 AppSec [baseline] (55.334 ms) : 0, 55334 AppSec [candidate] (53.17 ms) : 0, 53170 IAST [baseline] (21.69 ms) : 0, 21690 IAST [candidate] (23.768 ms) : 0, 23768 Remote Config [baseline] (624.361 µs) : 0, 624 Remote Config [candidate] (632.968 µs) : 0, 633 Telemetry [baseline] (7.566 ms) : 0, 7566 Telemetry [candidate] (7.418 ms) : 0, 7418 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (793.44 ms) : 0, 793440 BytebuddyAgent [candidate] (792.274 ms) : 0, 792274 GlobalTracer [baseline] (300.486 ms) : 0, 300486 GlobalTracer [candidate] (306.089 ms) : 0, 306089 AppSec [baseline] (56.061 ms) : 0, 56061 AppSec [candidate] (55.138 ms) : 0, 55138 IAST [baseline] (21.385 ms) : 0, 21385 IAST [candidate] (20.483 ms) : 0, 20483 Remote Config [baseline] (616.239 µs) : 0, 616 Remote Config [candidate] (622.517 µs) : 0, 623 Telemetry [baseline] (7.514 ms) : 0, 7514 Telemetry [candidate] (8.199 ms) : 0, 8199 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (794.812 ms) : 0, 794812 BytebuddyAgent [candidate] (797.928 ms) : 0, 797928 GlobalTracer [baseline] (301.994 ms) : 0, 301994 GlobalTracer [candidate] (303.259 ms) : 0, 303259 AppSec [baseline] (53.248 ms) : 0, 53248 AppSec [candidate] (56.086 ms) : 0, 56086 IAST [baseline] (24.23 ms) : 0, 24230 IAST [candidate] (21.069 ms) : 0, 21069 Remote Config [baseline] (607.313 µs) : 0, 607 Remote Config [candidate] (609.146 µs) : 0, 609 Telemetry [baseline] (7.303 ms) : 0, 7303 Telemetry [candidate] (7.357 ms) : 0, 7357 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-11T16:12:22 2024-09-11T16:19:12
git_branch master nikita-tkachenko/gha-pr-extra-tags
git_commit_date 1726062980 1726070433
git_commit_sha 4abf841368 66be571623
release_version 1.40.0-SNAPSHOT~4abf841368 1.40.0-SNAPSHOT~66be571623
start_time 2024-09-11T16:12:08 2024-09-11T16:18:58
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1726071898 |1726071898 | |ci_job_id |635837227 |635837227 | |ci_pipeline_id|44098077 |44098077 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~66be571623, baseline=1.40.0-SNAPSHOT~4abf841368 dateFormat X axisFormat %s section baseline no_agent (1.346 ms) : 1326, 1365 . : milestone, 1346, appsec (1.72 ms) : 1695, 1746 . : milestone, 1720, appsec_no_iast (1.734 ms) : 1710, 1758 . : milestone, 1734, iast (1.484 ms) : 1461, 1506 . : milestone, 1484, profiling (1.483 ms) : 1460, 1505 . : milestone, 1483, tracing (1.465 ms) : 1441, 1489 . : milestone, 1465, section candidate no_agent (1.35 ms) : 1331, 1369 . : milestone, 1350, appsec (1.712 ms) : 1687, 1737 . : milestone, 1712, appsec_no_iast (1.711 ms) : 1687, 1736 . : milestone, 1711, iast (1.484 ms) : 1461, 1507 . : milestone, 1484, profiling (1.501 ms) : 1478, 1524 . : milestone, 1501, tracing (1.458 ms) : 1433, 1483 . : milestone, 1458, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.346 ms [1.326 ms, 1.365 ms]|-| |appsec|1.72 ms [1.695 ms, 1.746 ms]|374.852 µs (27.9%)| |appsec_no_iast|1.734 ms [1.71 ms, 1.758 ms]|388.739 µs (28.9%)| |iast|1.484 ms [1.461 ms, 1.506 ms]|138.018 µs (10.3%)| |profiling|1.483 ms [1.46 ms, 1.505 ms]|137.252 µs (10.2%)| |tracing|1.465 ms [1.441 ms, 1.489 ms]|119.4 µs (8.9%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.35 ms [1.331 ms, 1.369 ms]|-| |appsec|1.712 ms [1.687 ms, 1.737 ms]|362.13 µs (26.8%)| |appsec_no_iast|1.711 ms [1.687 ms, 1.736 ms]|361.289 µs (26.8%)| |iast|1.484 ms [1.461 ms, 1.507 ms]|133.766 µs (9.9%)| |profiling|1.501 ms [1.478 ms, 1.524 ms]|151.084 µs (11.2%)| |tracing|1.458 ms [1.433 ms, 1.483 ms]|107.547 µs (8.0%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~66be571623, baseline=1.40.0-SNAPSHOT~4abf841368 dateFormat X axisFormat %s section baseline no_agent (373.028 µs) : 353, 393 . : milestone, 373, iast (498.994 µs) : 477, 521 . : milestone, 499, iast_FULL (554.48 µs) : 533, 576 . : milestone, 554, iast_GLOBAL (508.961 µs) : 488, 530 . : milestone, 509, iast_HARDCODED_SECRET_DISABLED (487.401 µs) : 466, 509 . : milestone, 487, iast_INACTIVE (445.676 µs) : 425, 466 . : milestone, 446, iast_TELEMETRY_OFF (478.865 µs) : 457, 501 . : milestone, 479, tracing (444.78 µs) : 425, 465 . : milestone, 445, section candidate no_agent (378.543 µs) : 359, 398 . : milestone, 379, iast (487.294 µs) : 466, 509 . : milestone, 487, iast_FULL (558.569 µs) : 537, 580 . : milestone, 559, iast_GLOBAL (517.217 µs) : 495, 540 . : milestone, 517, iast_HARDCODED_SECRET_DISABLED (498.482 µs) : 476, 521 . : milestone, 498, iast_INACTIVE (450.231 µs) : 430, 471 . : milestone, 450, iast_TELEMETRY_OFF (481.699 µs) : 459, 504 . : milestone, 482, tracing (445.867 µs) : 425, 466 . : milestone, 446, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|373.028 µs [353.091 µs, 392.964 µs]|-| |iast|498.994 µs [477.066 µs, 520.922 µs]|125.966 µs (33.8%)| |iast_FULL|554.48 µs [533.352 µs, 575.608 µs]|181.452 µs (48.6%)| |iast_GLOBAL|508.961 µs [487.545 µs, 530.378 µs]|135.934 µs (36.4%)| |iast_HARDCODED_SECRET_DISABLED|487.401 µs [465.575 µs, 509.226 µs]|114.373 µs (30.7%)| |iast_INACTIVE|445.676 µs [425.324 µs, 466.028 µs]|72.648 µs (19.5%)| |iast_TELEMETRY_OFF|478.865 µs [456.544 µs, 501.185 µs]|105.837 µs (28.4%)| |tracing|444.78 µs [424.618 µs, 464.943 µs]|71.753 µs (19.2%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|378.543 µs [358.928 µs, 398.158 µs]|-| |iast|487.294 µs [465.754 µs, 508.834 µs]|108.751 µs (28.7%)| |iast_FULL|558.569 µs [537.277 µs, 579.862 µs]|180.026 µs (47.6%)| |iast_GLOBAL|517.217 µs [494.855 µs, 539.579 µs]|138.674 µs (36.6%)| |iast_HARDCODED_SECRET_DISABLED|498.482 µs [476.189 µs, 520.775 µs]|119.939 µs (31.7%)| |iast_INACTIVE|450.231 µs [429.525 µs, 470.937 µs]|71.688 µs (18.9%)| |iast_TELEMETRY_OFF|481.699 µs [459.154 µs, 504.243 µs]|103.156 µs (27.3%)| |tracing|445.867 µs [425.348 µs, 466.385 µs]|67.323 µs (17.8%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master nikita-tkachenko/gha-pr-extra-tags
git_commit_date 1726062980 1726070433
git_commit_sha 4abf841368 66be571623
release_version 1.40.0-SNAPSHOT~4abf841368 1.40.0-SNAPSHOT~66be571623
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1726072433 |1726072433 | |ci_job_id |635837228 |635837228 | |ci_pipeline_id|44098077 |44098077 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~66be571623, baseline=1.40.0-SNAPSHOT~4abf841368 dateFormat X axisFormat %s section baseline no_agent (1.468 ms) : 1456, 1479 . : milestone, 1468, appsec (2.301 ms) : 2261, 2342 . : milestone, 2301, iast (2.05 ms) : 2002, 2098 . : milestone, 2050, iast_GLOBAL (2.103 ms) : 2052, 2154 . : milestone, 2103, profiling (1.925 ms) : 1885, 1965 . : milestone, 1925, tracing (1.911 ms) : 1872, 1950 . : milestone, 1911, section candidate no_agent (1.467 ms) : 1455, 1478 . : milestone, 1467, appsec (2.312 ms) : 2271, 2352 . : milestone, 2312, iast (2.058 ms) : 2007, 2108 . : milestone, 2058, iast_GLOBAL (2.094 ms) : 2044, 2144 . : milestone, 2094, profiling (1.92 ms) : 1879, 1961 . : milestone, 1920, tracing (1.91 ms) : 1872, 1949 . : milestone, 1910, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.468 ms [1.456 ms, 1.479 ms]|-| |appsec|2.301 ms [2.261 ms, 2.342 ms]|833.639 µs (56.8%)| |iast|2.05 ms [2.002 ms, 2.098 ms]|581.934 µs (39.6%)| |iast_GLOBAL|2.103 ms [2.052 ms, 2.154 ms]|634.836 µs (43.3%)| |profiling|1.925 ms [1.885 ms, 1.965 ms]|457.259 µs (31.2%)| |tracing|1.911 ms [1.872 ms, 1.95 ms]|443.161 µs (30.2%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.467 ms [1.455 ms, 1.478 ms]|-| |appsec|2.312 ms [2.271 ms, 2.352 ms]|844.676 µs (57.6%)| |iast|2.058 ms [2.007 ms, 2.108 ms]|590.787 µs (40.3%)| |iast_GLOBAL|2.094 ms [2.044 ms, 2.144 ms]|627.398 µs (42.8%)| |profiling|1.92 ms [1.879 ms, 1.961 ms]|453.186 µs (30.9%)| |tracing|1.91 ms [1.872 ms, 1.949 ms]|443.311 µs (30.2%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~66be571623, baseline=1.40.0-SNAPSHOT~4abf841368 dateFormat X axisFormat %s section baseline no_agent (15.566 s) : 15566000, 15566000 . : milestone, 15566000, appsec (15.083 s) : 15083000, 15083000 . : milestone, 15083000, iast (18.863 s) : 18863000, 18863000 . : milestone, 18863000, iast_GLOBAL (18.265 s) : 18265000, 18265000 . : milestone, 18265000, profiling (15.282 s) : 15282000, 15282000 . : milestone, 15282000, tracing (15.027 s) : 15027000, 15027000 . : milestone, 15027000, section candidate no_agent (15.313 s) : 15313000, 15313000 . : milestone, 15313000, appsec (15.215 s) : 15215000, 15215000 . : milestone, 15215000, iast (18.897 s) : 18897000, 18897000 . : milestone, 18897000, iast_GLOBAL (18.212 s) : 18212000, 18212000 . : milestone, 18212000, profiling (15.2 s) : 15200000, 15200000 . : milestone, 15200000, tracing (15.083 s) : 15083000, 15083000 . : milestone, 15083000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.566 s [15.566 s, 15.566 s]|-| |appsec|15.083 s [15.083 s, 15.083 s]|-483.0 ms (-3.1%)| |iast|18.863 s [18.863 s, 18.863 s]|3.297 s (21.2%)| |iast_GLOBAL|18.265 s [18.265 s, 18.265 s]|2.699 s (17.3%)| |profiling|15.282 s [15.282 s, 15.282 s]|-284.0 ms (-1.8%)| |tracing|15.027 s [15.027 s, 15.027 s]|-539.0 ms (-3.5%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.313 s [15.313 s, 15.313 s]|-| |appsec|15.215 s [15.215 s, 15.215 s]|-98.0 ms (-0.6%)| |iast|18.897 s [18.897 s, 18.897 s]|3.584 s (23.4%)| |iast_GLOBAL|18.212 s [18.212 s, 18.212 s]|2.899 s (18.9%)| |profiling|15.2 s [15.2 s, 15.2 s]|-113.0 ms (-0.7%)| |tracing|15.083 s [15.083 s, 15.083 s]|-230.0 ms (-1.5%)|