DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Change Gradle task ordering to fix build issues with dd-smoke-tests #7570

Closed jordan-wong closed 2 months ago

jordan-wong commented 2 months ago

What Does This Do

Adds task ordering for certain sections of dd-smoke-tests

Motivation

Consistently getting errors with dd-smoke-tests:springboot-tomcat:forbiddenApisMain when trying to build a clean version of dd-trace-java from master branch (./gradlew clean build), following the https://github.com/DataDog/dd-trace-java/blob/master/BUILDING.md instructions.

FAILURE: Build failed with an exception.

* What went wrong:
Some problems were found with the configuration of task ':dd-smoke-tests:springboot-tomcat:forbiddenApisMain' (type 'CheckForbiddenApis').
  - Gradle detected a problem with the following location: '/Users/jordan.wong/dd-trace-java/dd-smoke-tests/springboot-tomcat/build/classes/java/main'

    Reason: Task ':dd-smoke-tests:springboot-tomcat:forbiddenApisMain' uses this output of task ':dd-smoke-tests:springboot-tomcat:unzip' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed.

    Possible solutions:
      1. Declare task ':dd-smoke-tests:springboot-tomcat:unzip' as an input of ':dd-smoke-tests:springboot-tomcat:forbiddenApisMain'.
      2. Declare an explicit dependency on ':dd-smoke-tests:springboot-tomcat:unzip' from ':dd-smoke-tests:springboot-tomcat:forbiddenApisMain' using Task#dependsOn.
      3. Declare an explicit dependency on ':dd-smoke-tests:springboot-tomcat:unzip' from ':dd-smoke-tests:springboot-tomcat:forbiddenApisMain' using Task#mustRunAfter.

    For more information, please refer to https://docs.gradle.org/8.4/userguide/validation_problems.html#implicit_dependency in the Gradle documentation.
  - Gradle detected a problem with the following location: '/Users/jordan.wong/dd-trace-java/dd-smoke-tests/springboot-tomcat/build/classes/groovy/main'.

    Reason: Task ':dd-smoke-tests:springboot-tomcat:forbiddenApisMain' uses this output of task ':dd-smoke-tests:springboot-tomcat:unzip' without declaring an explicit or implicit dependency. This can lead to incorrect results being produced, depending on what order the tasks are executed.

    Possible solutions:
      1. Declare task ':dd-smoke-tests:springboot-tomcat:unzip' as an input of ':dd-smoke-tests:springboot-tomcat:forbiddenApisMain'.
      2. Declare an explicit dependency on ':dd-smoke-tests:springboot-tomcat:unzip' from ':dd-smoke-tests:springboot-tomcat:forbiddenApisMain' using Task#dependsOn.
      3. Declare an explicit dependency on ':dd-smoke-tests:springboot-tomcat:unzip' from ':dd-smoke-tests:springboot-tomcat:forbiddenApisMain' using Task#mustRunAfter.

    For more information, please refer to https://docs.gradle.org/8.4/userguide/validation_problems.html#implicit_dependency in the Gradle documentation.

Additional Notes

Contributor Checklist

Jira ticket: [PROJ-IDENT]

pr-commenter[bot] commented 2 months ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master change-task-ordering-smoketests
git_commit_date 1725545464 1725550119
git_commit_sha 123a2c8614 bbe77e2c3a
release_version 1.40.0-SNAPSHOT~123a2c8614 1.40.0-SNAPSHOT~bbe77e2c3a
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725552482 |1725552482 | |ci_job_id |628983638 |628983638 | |ci_pipeline_id|43632322 |43632322 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~bbe77e2c3a, baseline=1.40.0-SNAPSHOT~123a2c8614 dateFormat X axisFormat %s section tracing Agent [baseline] (1.057 s) : 0, 1056664 Total [baseline] (10.409 s) : 0, 10409221 Agent [candidate] (1.051 s) : 0, 1050757 Total [candidate] (10.408 s) : 0, 10408183 section appsec Agent [baseline] (1.188 s) : 0, 1188114 Total [baseline] (10.607 s) : 0, 10607464 Agent [candidate] (1.184 s) : 0, 1183543 Total [candidate] (10.576 s) : 0, 10575774 section iast Agent [baseline] (1.175 s) : 0, 1174895 Total [baseline] (10.856 s) : 0, 10855798 Agent [candidate] (1.182 s) : 0, 1182184 Total [candidate] (10.804 s) : 0, 10804038 section profiling Agent [baseline] (1.271 s) : 0, 1271249 Total [baseline] (10.609 s) : 0, 10608932 Agent [candidate] (1.255 s) : 0, 1254623 Total [candidate] (10.614 s) : 0, 10614226 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.057 s |-| |Agent|appsec|1.188 s |131.45 ms (12.4%)| |Agent|iast|1.175 s |118.231 ms (11.2%)| |Agent|profiling|1.271 s |214.586 ms (20.3%)| |Total|tracing|10.409 s |-| |Total|appsec|10.607 s |198.243 ms (1.9%)| |Total|iast|10.856 s |446.577 ms (4.3%)| |Total|profiling|10.609 s |199.711 ms (1.9%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.051 s |-| |Agent|appsec|1.184 s |132.785 ms (12.6%)| |Agent|iast|1.182 s |131.427 ms (12.5%)| |Agent|profiling|1.255 s |203.865 ms (19.4%)| |Total|tracing|10.408 s |-| |Total|appsec|10.576 s |167.591 ms (1.6%)| |Total|iast|10.804 s |395.855 ms (3.8%)| |Total|profiling|10.614 s |206.043 ms (2.0%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~bbe77e2c3a, baseline=1.40.0-SNAPSHOT~123a2c8614 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (674.13 ms) : 0, 674130 BytebuddyAgent [candidate] (670.15 ms) : 0, 670150 GlobalTracer [baseline] (308.911 ms) : 0, 308911 GlobalTracer [candidate] (307.385 ms) : 0, 307385 AppSec [baseline] (51.767 ms) : 0, 51767 AppSec [candidate] (51.416 ms) : 0, 51416 Remote Config [baseline] (677.181 µs) : 0, 677 Remote Config [candidate] (693.68 µs) : 0, 694 Telemetry [baseline] (7.499 ms) : 0, 7499 Telemetry [candidate] (7.525 ms) : 0, 7525 section appsec BytebuddyAgent [baseline] (693.664 ms) : 0, 693664 BytebuddyAgent [candidate] (690.362 ms) : 0, 690362 GlobalTracer [baseline] (301.866 ms) : 0, 301866 GlobalTracer [candidate] (300.92 ms) : 0, 300920 AppSec [baseline] (159.666 ms) : 0, 159666 AppSec [candidate] (159.215 ms) : 0, 159215 Remote Config [baseline] (623.068 µs) : 0, 623 Remote Config [candidate] (621.608 µs) : 0, 622 Telemetry [baseline] (8.25 ms) : 0, 8250 Telemetry [candidate] (8.569 ms) : 0, 8569 IAST [baseline] (20.801 ms) : 0, 20801 IAST [candidate] (20.531 ms) : 0, 20531 section iast BytebuddyAgent [baseline] (781.771 ms) : 0, 781771 BytebuddyAgent [candidate] (786.202 ms) : 0, 786202 GlobalTracer [baseline] (296.054 ms) : 0, 296054 GlobalTracer [candidate] (298.004 ms) : 0, 298004 AppSec [baseline] (52.14 ms) : 0, 52140 AppSec [candidate] (53.131 ms) : 0, 53131 Remote Config [baseline] (573.039 µs) : 0, 573 Remote Config [candidate] (602.364 µs) : 0, 602 Telemetry [baseline] (8.106 ms) : 0, 8106 Telemetry [candidate] (9.009 ms) : 0, 9009 IAST [baseline] (22.652 ms) : 0, 22652 IAST [candidate] (21.543 ms) : 0, 21543 section profiling BytebuddyAgent [baseline] (677.963 ms) : 0, 677963 BytebuddyAgent [candidate] (669.08 ms) : 0, 669080 GlobalTracer [baseline] (395.6 ms) : 0, 395600 GlobalTracer [candidate] (390.998 ms) : 0, 390998 AppSec [baseline] (52.868 ms) : 0, 52868 AppSec [candidate] (52.206 ms) : 0, 52206 Remote Config [baseline] (708.203 µs) : 0, 708 Remote Config [candidate] (690.003 µs) : 0, 690 Telemetry [baseline] (7.507 ms) : 0, 7507 Telemetry [candidate] (7.415 ms) : 0, 7415 ProfilingAgent [baseline] (97.936 ms) : 0, 97936 ProfilingAgent [candidate] (96.1 ms) : 0, 96100 Profiling [baseline] (97.96 ms) : 0, 97960 Profiling [candidate] (96.124 ms) : 0, 96124 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~bbe77e2c3a, baseline=1.40.0-SNAPSHOT~123a2c8614 dateFormat X axisFormat %s section tracing Agent [baseline] (1.05 s) : 0, 1049920 Total [baseline] (8.492 s) : 0, 8491978 Agent [candidate] (1.049 s) : 0, 1048843 Total [candidate] (8.479 s) : 0, 8479455 section iast Agent [baseline] (1.175 s) : 0, 1175133 Total [baseline] (8.979 s) : 0, 8978737 Agent [candidate] (1.176 s) : 0, 1175998 Total [candidate] (8.968 s) : 0, 8968136 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.173 s) : 0, 1173076 Total [baseline] (8.956 s) : 0, 8955731 Agent [candidate] (1.183 s) : 0, 1183006 Total [candidate] (8.951 s) : 0, 8951384 section iast_TELEMETRY_OFF Agent [baseline] (1.18 s) : 0, 1180335 Total [baseline] (9.027 s) : 0, 9027286 Agent [candidate] (1.169 s) : 0, 1169020 Total [candidate] (8.97 s) : 0, 8970213 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.05 s |-| |Agent|iast|1.175 s |125.213 ms (11.9%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.173 s |123.155 ms (11.7%)| |Agent|iast_TELEMETRY_OFF|1.18 s |130.415 ms (12.4%)| |Total|tracing|8.492 s |-| |Total|iast|8.979 s |486.758 ms (5.7%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.956 s |463.752 ms (5.5%)| |Total|iast_TELEMETRY_OFF|9.027 s |535.308 ms (6.3%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.049 s |-| |Agent|iast|1.176 s |127.156 ms (12.1%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.183 s |134.163 ms (12.8%)| |Agent|iast_TELEMETRY_OFF|1.169 s |120.177 ms (11.5%)| |Total|tracing|8.479 s |-| |Total|iast|8.968 s |488.68 ms (5.8%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.951 s |471.929 ms (5.6%)| |Total|iast_TELEMETRY_OFF|8.97 s |490.758 ms (5.8%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~bbe77e2c3a, baseline=1.40.0-SNAPSHOT~123a2c8614 dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (669.783 ms) : 0, 669783 BytebuddyAgent [candidate] (668.722 ms) : 0, 668722 GlobalTracer [baseline] (307.158 ms) : 0, 307158 GlobalTracer [candidate] (307.185 ms) : 0, 307185 AppSec [baseline] (51.272 ms) : 0, 51272 AppSec [candidate] (51.289 ms) : 0, 51289 Remote Config [baseline] (665.092 µs) : 0, 665 Remote Config [candidate] (665.579 µs) : 0, 666 Telemetry [baseline] (7.461 ms) : 0, 7461 Telemetry [candidate] (7.414 ms) : 0, 7414 section iast BytebuddyAgent [baseline] (782.498 ms) : 0, 782498 BytebuddyAgent [candidate] (782.075 ms) : 0, 782075 GlobalTracer [baseline] (296.345 ms) : 0, 296345 GlobalTracer [candidate] (296.741 ms) : 0, 296741 AppSec [baseline] (52.934 ms) : 0, 52934 AppSec [candidate] (53.033 ms) : 0, 53033 IAST [baseline] (21.87 ms) : 0, 21870 IAST [candidate] (21.915 ms) : 0, 21915 Remote Config [baseline] (581.271 µs) : 0, 581 Remote Config [candidate] (594.991 µs) : 0, 595 Telemetry [baseline] (7.319 ms) : 0, 7319 Telemetry [candidate] (8.026 ms) : 0, 8026 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (779.679 ms) : 0, 779679 BytebuddyAgent [candidate] (786.687 ms) : 0, 786687 GlobalTracer [baseline] (295.749 ms) : 0, 295749 GlobalTracer [candidate] (298.496 ms) : 0, 298496 AppSec [baseline] (52.48 ms) : 0, 52480 AppSec [candidate] (53.977 ms) : 0, 53977 IAST [baseline] (22.821 ms) : 0, 22821 IAST [candidate] (22.144 ms) : 0, 22144 Remote Config [baseline] (596.457 µs) : 0, 596 Remote Config [candidate] (602.46 µs) : 0, 602 Telemetry [baseline] (8.164 ms) : 0, 8164 Telemetry [candidate] (7.375 ms) : 0, 7375 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (785.125 ms) : 0, 785125 BytebuddyAgent [candidate] (776.329 ms) : 0, 776329 GlobalTracer [baseline] (298.263 ms) : 0, 298263 GlobalTracer [candidate] (296.122 ms) : 0, 296122 AppSec [baseline] (52.851 ms) : 0, 52851 AppSec [candidate] (53.005 ms) : 0, 53005 IAST [baseline] (21.683 ms) : 0, 21683 IAST [candidate] (22.212 ms) : 0, 22212 Remote Config [baseline] (588.727 µs) : 0, 589 Remote Config [candidate] (562.116 µs) : 0, 562 Telemetry [baseline] (8.093 ms) : 0, 8093 Telemetry [candidate] (7.17 ms) : 0, 7170 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-05T15:38:41 2024-09-05T15:45:33
git_branch master change-task-ordering-smoketests
git_commit_date 1725545464 1725550119
git_commit_sha 123a2c8614 bbe77e2c3a
release_version 1.40.0-SNAPSHOT~123a2c8614 1.40.0-SNAPSHOT~bbe77e2c3a
start_time 2024-09-05T15:38:28 2024-09-05T15:45:20
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1725551479 |1725551479 | |ci_job_id |628983639 |628983639 | |ci_pipeline_id|43632322 |43632322 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~bbe77e2c3a, baseline=1.40.0-SNAPSHOT~123a2c8614 dateFormat X axisFormat %s section baseline no_agent (1.356 ms) : 1335, 1376 . : milestone, 1356, appsec (1.729 ms) : 1706, 1753 . : milestone, 1729, appsec_no_iast (1.727 ms) : 1703, 1751 . : milestone, 1727, iast (1.485 ms) : 1462, 1507 . : milestone, 1485, profiling (1.53 ms) : 1506, 1554 . : milestone, 1530, tracing (1.463 ms) : 1438, 1487 . : milestone, 1463, section candidate no_agent (1.351 ms) : 1331, 1371 . : milestone, 1351, appsec (1.717 ms) : 1692, 1742 . : milestone, 1717, appsec_no_iast (1.718 ms) : 1694, 1743 . : milestone, 1718, iast (1.505 ms) : 1483, 1528 . : milestone, 1505, profiling (1.495 ms) : 1471, 1519 . : milestone, 1495, tracing (1.475 ms) : 1451, 1499 . : milestone, 1475, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.356 ms [1.335 ms, 1.376 ms]|-| |appsec|1.729 ms [1.706 ms, 1.753 ms]|373.567 µs (27.6%)| |appsec_no_iast|1.727 ms [1.703 ms, 1.751 ms]|371.522 µs (27.4%)| |iast|1.485 ms [1.462 ms, 1.507 ms]|129.099 µs (9.5%)| |profiling|1.53 ms [1.506 ms, 1.554 ms]|174.516 µs (12.9%)| |tracing|1.463 ms [1.438 ms, 1.487 ms]|107.102 µs (7.9%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.351 ms [1.331 ms, 1.371 ms]|-| |appsec|1.717 ms [1.692 ms, 1.742 ms]|365.944 µs (27.1%)| |appsec_no_iast|1.718 ms [1.694 ms, 1.743 ms]|367.506 µs (27.2%)| |iast|1.505 ms [1.483 ms, 1.528 ms]|154.548 µs (11.4%)| |profiling|1.495 ms [1.471 ms, 1.519 ms]|144.437 µs (10.7%)| |tracing|1.475 ms [1.451 ms, 1.499 ms]|124.077 µs (9.2%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~bbe77e2c3a, baseline=1.40.0-SNAPSHOT~123a2c8614 dateFormat X axisFormat %s section baseline no_agent (368.377 µs) : 349, 388 . : milestone, 368, iast (486.653 µs) : 465, 508 . : milestone, 487, iast_FULL (556.917 µs) : 536, 578 . : milestone, 557, iast_GLOBAL (516.418 µs) : 494, 538 . : milestone, 516, iast_HARDCODED_SECRET_DISABLED (490.904 µs) : 469, 513 . : milestone, 491, iast_INACTIVE (448.448 µs) : 427, 470 . : milestone, 448, iast_TELEMETRY_OFF (483.679 µs) : 461, 506 . : milestone, 484, tracing (448.404 µs) : 428, 469 . : milestone, 448, section candidate no_agent (376.246 µs) : 357, 396 . : milestone, 376, iast (489.205 µs) : 467, 512 . : milestone, 489, iast_FULL (554.934 µs) : 534, 576 . : milestone, 555, iast_GLOBAL (515.731 µs) : 494, 538 . : milestone, 516, iast_HARDCODED_SECRET_DISABLED (485.256 µs) : 464, 507 . : milestone, 485, iast_INACTIVE (460.864 µs) : 440, 482 . : milestone, 461, iast_TELEMETRY_OFF (474.358 µs) : 452, 496 . : milestone, 474, tracing (443.978 µs) : 424, 464 . : milestone, 444, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|368.377 µs [348.614 µs, 388.14 µs]|-| |iast|486.653 µs [465.141 µs, 508.165 µs]|118.276 µs (32.1%)| |iast_FULL|556.917 µs [535.868 µs, 577.966 µs]|188.54 µs (51.2%)| |iast_GLOBAL|516.418 µs [494.474 µs, 538.363 µs]|148.041 µs (40.2%)| |iast_HARDCODED_SECRET_DISABLED|490.904 µs [468.735 µs, 513.073 µs]|122.527 µs (33.3%)| |iast_INACTIVE|448.448 µs [427.237 µs, 469.66 µs]|80.071 µs (21.7%)| |iast_TELEMETRY_OFF|483.679 µs [461.477 µs, 505.881 µs]|115.301 µs (31.3%)| |tracing|448.404 µs [427.995 µs, 468.813 µs]|80.027 µs (21.7%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|376.246 µs [356.695 µs, 395.797 µs]|-| |iast|489.205 µs [466.774 µs, 511.636 µs]|112.959 µs (30.0%)| |iast_FULL|554.934 µs [533.865 µs, 576.003 µs]|178.688 µs (47.5%)| |iast_GLOBAL|515.731 µs [493.834 µs, 537.627 µs]|139.485 µs (37.1%)| |iast_HARDCODED_SECRET_DISABLED|485.256 µs [463.943 µs, 506.569 µs]|109.01 µs (29.0%)| |iast_INACTIVE|460.864 µs [440.173 µs, 481.554 µs]|84.618 µs (22.5%)| |iast_TELEMETRY_OFF|474.358 µs [452.337 µs, 496.379 µs]|98.112 µs (26.1%)| |tracing|443.978 µs [423.527 µs, 464.43 µs]|67.733 µs (18.0%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master change-task-ordering-smoketests
git_commit_date 1725545464 1725550119
git_commit_sha 123a2c8614 bbe77e2c3a
release_version 1.40.0-SNAPSHOT~123a2c8614 1.40.0-SNAPSHOT~bbe77e2c3a
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1725552012 |1725552012 | |ci_job_id |628983640 |628983640 | |ci_pipeline_id|43632322 |43632322 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~bbe77e2c3a, baseline=1.40.0-SNAPSHOT~123a2c8614 dateFormat X axisFormat %s section baseline no_agent (1.462 ms) : 1450, 1473 . : milestone, 1462, appsec (2.233 ms) : 2198, 2269 . : milestone, 2233, iast (1.999 ms) : 1955, 2043 . : milestone, 1999, iast_GLOBAL (2.04 ms) : 1996, 2084 . : milestone, 2040, profiling (1.877 ms) : 1842, 1913 . : milestone, 1877, tracing (1.853 ms) : 1820, 1887 . : milestone, 1853, section candidate no_agent (1.466 ms) : 1455, 1478 . : milestone, 1466, appsec (2.24 ms) : 2204, 2275 . : milestone, 2240, iast (1.99 ms) : 1947, 2034 . : milestone, 1990, iast_GLOBAL (2.025 ms) : 1981, 2068 . : milestone, 2025, profiling (1.866 ms) : 1831, 1901 . : milestone, 1866, tracing (1.843 ms) : 1810, 1876 . : milestone, 1843, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.462 ms [1.45 ms, 1.473 ms]|-| |appsec|2.233 ms [2.198 ms, 2.269 ms]|771.548 µs (52.8%)| |iast|1.999 ms [1.955 ms, 2.043 ms]|536.947 µs (36.7%)| |iast_GLOBAL|2.04 ms [1.996 ms, 2.084 ms]|577.75 µs (39.5%)| |profiling|1.877 ms [1.842 ms, 1.913 ms]|415.561 µs (28.4%)| |tracing|1.853 ms [1.82 ms, 1.887 ms]|391.188 µs (26.8%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.466 ms [1.455 ms, 1.478 ms]|-| |appsec|2.24 ms [2.204 ms, 2.275 ms]|773.389 µs (52.7%)| |iast|1.99 ms [1.947 ms, 2.034 ms]|523.961 µs (35.7%)| |iast_GLOBAL|2.025 ms [1.981 ms, 2.068 ms]|558.424 µs (38.1%)| |profiling|1.866 ms [1.831 ms, 1.901 ms]|399.626 µs (27.3%)| |tracing|1.843 ms [1.81 ms, 1.876 ms]|376.7 µs (25.7%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~bbe77e2c3a, baseline=1.40.0-SNAPSHOT~123a2c8614 dateFormat X axisFormat %s section baseline no_agent (15.331 s) : 15331000, 15331000 . : milestone, 15331000, appsec (15.233 s) : 15233000, 15233000 . : milestone, 15233000, iast (18.725 s) : 18725000, 18725000 . : milestone, 18725000, iast_GLOBAL (18.081 s) : 18081000, 18081000 . : milestone, 18081000, profiling (15.379 s) : 15379000, 15379000 . : milestone, 15379000, tracing (15.194 s) : 15194000, 15194000 . : milestone, 15194000, section candidate no_agent (15.533 s) : 15533000, 15533000 . : milestone, 15533000, appsec (15.172 s) : 15172000, 15172000 . : milestone, 15172000, iast (18.733 s) : 18733000, 18733000 . : milestone, 18733000, iast_GLOBAL (17.802 s) : 17802000, 17802000 . : milestone, 17802000, profiling (15.981 s) : 15981000, 15981000 . : milestone, 15981000, tracing (14.877 s) : 14877000, 14877000 . : milestone, 14877000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.331 s [15.331 s, 15.331 s]|-| |appsec|15.233 s [15.233 s, 15.233 s]|-98.0 ms (-0.6%)| |iast|18.725 s [18.725 s, 18.725 s]|3.394 s (22.1%)| |iast_GLOBAL|18.081 s [18.081 s, 18.081 s]|2.75 s (17.9%)| |profiling|15.379 s [15.379 s, 15.379 s]|48.0 ms (0.3%)| |tracing|15.194 s [15.194 s, 15.194 s]|-137.0 ms (-0.9%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.533 s [15.533 s, 15.533 s]|-| |appsec|15.172 s [15.172 s, 15.172 s]|-361.0 ms (-2.3%)| |iast|18.733 s [18.733 s, 18.733 s]|3.2 s (20.6%)| |iast_GLOBAL|17.802 s [17.802 s, 17.802 s]|2.269 s (14.6%)| |profiling|15.981 s [15.981 s, 15.981 s]|448.0 ms (2.9%)| |tracing|14.877 s [14.877 s, 14.877 s]|-656.0 ms (-4.2%)|