search

DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
588 stars 290 forks source link

Fix stack overflow in spock making junit ignore test failures #7674

Closed manuel-alvarez-alvarez closed 1 month ago

manuel-alvarez-alvarez commented 1 month ago

What Does This Do

Fixes tests failures when a org.spockframework.mock.TooManyInvocationsError triggers a java.lang.StackOverflowError while composing the failure message.

Motivation

When a mocked class captures the assertion error (e.g. TooManyInvocationsError), spock will throw an StackOverflowError while building the accepted invocations failure message, it causes the test to be ignored and won't be reported as a failure. As an example:

Before (warning message and test ignored):

Sep 24, 2024 11:35:27 AM org.junit.platform.launcher.core.CompositeTestExecutionListener lambda$notifyEach$19
WARNING: TestExecutionListener [org.junit.platform.runner.JUnitPlatformRunnerListener] threw exception for method: executionFinished(TestIdentifier [uniqueId = [engine:spock]/[spec:datadog.trace.instrumentation.java.lang.StringCallSiteTest]/[feature:$spock_feature_2_0], parentId = [engine:spock]/[spec:datadog.trace.instrumentation.java.lang.StringCallSiteTest], displayName = 'test string concat call site', legacyReportingName = 'test string concat call site', source = MethodSource [className = 'datadog.trace.instrumentation.java.lang.StringCallSiteTest', methodName = 'test string concat call site', methodParameterTypes = ''], tags = [], type = TEST], TestExecutionResult [status = FAILED, throwable = org.spockframework.mock.TooManyInvocationsError@35dc849b])
java.lang.StackOverflowError
    at java.util.AbstractList.listIterator(AbstractList.java:299)

After (test reported as a failure):

datadog.trace.instrumentation.java.lang.StringCallSiteTest > StringCallSiteTest.test string concat call site FAILED
    org.spockframework.mock.TooManyInvocationsError at MockInteraction.java:70
2 tests completed, 1 failed

Too many invocations for:

0 * _   (2 invocations)

Matching invocations (ordered by last occurrence):

1 * stringModule.onUnexpectedException('afetConcat threw', java.lang.AssertionError: 'org.spockframework.mock.TooManyInvocationsError' hidden due to 'java.lang.StackOverflowError')   <-- this triggered the error
1 * stringModule.onStringConcat('ERROR ', 'World!', 'ERROR World!')

Additional Notes

Contributor Checklist

Jira ticket: APPSEC-54984

pr-commenter[bot] commented 1 month ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/fix-too-many-invocations-stack-overflow
git_commit_date 1727466491 1727620127
git_commit_sha 201bcbe8ed 376d6618b0
release_version 1.40.0-SNAPSHOT~201bcbe8ed 1.40.0-SNAPSHOT~376d6618b0
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727622536 |1727622536 | |ci_job_id |654941258 |654941258 | |ci_pipeline_id|45375753 |45375753 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 49 metrics, 14 unstable metrics.

Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~376d6618b0, baseline=1.40.0-SNAPSHOT~201bcbe8ed dateFormat X axisFormat %s section tracing Agent [baseline] (1.062 s) : 0, 1061900 Total [baseline] (10.411 s) : 0, 10410967 Agent [candidate] (1.062 s) : 0, 1061891 Total [candidate] (10.343 s) : 0, 10343492 section appsec Agent [baseline] (1.201 s) : 0, 1200602 Total [baseline] (10.666 s) : 0, 10666298 Agent [candidate] (1.2 s) : 0, 1199982 Total [candidate] (10.564 s) : 0, 10564050 section iast Agent [baseline] (1.185 s) : 0, 1185079 Total [baseline] (10.798 s) : 0, 10798044 Agent [candidate] (1.186 s) : 0, 1185549 Total [candidate] (10.798 s) : 0, 10797873 section profiling Agent [baseline] (1.259 s) : 0, 1259411 Total [baseline] (10.597 s) : 0, 10597138 Agent [candidate] (1.261 s) : 0, 1261400 Total [candidate] (10.607 s) : 0, 10606922 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.062 s |-| |Agent|appsec|1.201 s |138.702 ms (13.1%)| |Agent|iast|1.185 s |123.178 ms (11.6%)| |Agent|profiling|1.259 s |197.511 ms (18.6%)| |Total|tracing|10.411 s |-| |Total|appsec|10.666 s |255.331 ms (2.5%)| |Total|iast|10.798 s |387.077 ms (3.7%)| |Total|profiling|10.597 s |186.171 ms (1.8%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.062 s |-| |Agent|appsec|1.2 s |138.091 ms (13.0%)| |Agent|iast|1.186 s |123.658 ms (11.6%)| |Agent|profiling|1.261 s |199.509 ms (18.8%)| |Total|tracing|10.343 s |-| |Total|appsec|10.564 s |220.558 ms (2.1%)| |Total|iast|10.798 s |454.381 ms (4.4%)| |Total|profiling|10.607 s |263.43 ms (2.5%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~376d6618b0, baseline=1.40.0-SNAPSHOT~201bcbe8ed dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (677.945 ms) : 0, 677945 BytebuddyAgent [candidate] (678.103 ms) : 0, 678103 GlobalTracer [baseline] (308.242 ms) : 0, 308242 GlobalTracer [candidate] (308.383 ms) : 0, 308383 AppSec [baseline] (53.872 ms) : 0, 53872 AppSec [candidate] (53.558 ms) : 0, 53558 Remote Config [baseline] (663.441 µs) : 0, 663 Remote Config [candidate] (663.129 µs) : 0, 663 Telemetry [baseline] (7.626 ms) : 0, 7626 Telemetry [candidate] (7.605 ms) : 0, 7605 section appsec BytebuddyAgent [baseline] (702.664 ms) : 0, 702664 BytebuddyAgent [candidate] (698.223 ms) : 0, 698223 GlobalTracer [baseline] (303.318 ms) : 0, 303318 GlobalTracer [candidate] (307.189 ms) : 0, 307189 AppSec [baseline] (162.627 ms) : 0, 162627 AppSec [candidate] (161.61 ms) : 0, 161610 Remote Config [baseline] (636.143 µs) : 0, 636 Remote Config [candidate] (640.833 µs) : 0, 641 Telemetry [baseline] (8.122 ms) : 0, 8122 Telemetry [candidate] (8.262 ms) : 0, 8262 IAST [baseline] (19.213 ms) : 0, 19213 IAST [candidate] (20.853 ms) : 0, 20853 section iast BytebuddyAgent [baseline] (788.845 ms) : 0, 788845 BytebuddyAgent [candidate] (789.968 ms) : 0, 789968 GlobalTracer [baseline] (297.332 ms) : 0, 297332 GlobalTracer [candidate] (296.792 ms) : 0, 296792 AppSec [baseline] (53.334 ms) : 0, 53334 AppSec [candidate] (55.789 ms) : 0, 55789 Remote Config [baseline] (700.213 µs) : 0, 700 Remote Config [candidate] (598.329 µs) : 0, 598 Telemetry [baseline] (6.979 ms) : 0, 6979 Telemetry [candidate] (6.96 ms) : 0, 6960 IAST [baseline] (24.275 ms) : 0, 24275 IAST [candidate] (21.841 ms) : 0, 21841 section profiling BytebuddyAgent [baseline] (671.286 ms) : 0, 671286 BytebuddyAgent [candidate] (671.778 ms) : 0, 671778 GlobalTracer [baseline] (390.935 ms) : 0, 390935 GlobalTracer [candidate] (391.378 ms) : 0, 391378 AppSec [baseline] (54.309 ms) : 0, 54309 AppSec [candidate] (54.383 ms) : 0, 54383 Remote Config [baseline] (650.236 µs) : 0, 650 Remote Config [candidate] (648.04 µs) : 0, 648 Telemetry [baseline] (7.436 ms) : 0, 7436 Telemetry [candidate] (7.468 ms) : 0, 7468 ProfilingAgent [baseline] (96.324 ms) : 0, 96324 ProfilingAgent [candidate] (97.257 ms) : 0, 97257 Profiling [baseline] (96.348 ms) : 0, 96348 Profiling [candidate] (97.28 ms) : 0, 97280 ```
Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~376d6618b0, baseline=1.40.0-SNAPSHOT~201bcbe8ed dateFormat X axisFormat %s section tracing Agent [baseline] (1.065 s) : 0, 1064546 Total [baseline] (8.524 s) : 0, 8523836 Agent [candidate] (1.061 s) : 0, 1060668 Total [candidate] (8.502 s) : 0, 8501661 section iast Agent [baseline] (1.193 s) : 0, 1193337 Total [baseline] (8.999 s) : 0, 8999359 Agent [candidate] (1.186 s) : 0, 1185705 Total [candidate] (8.973 s) : 0, 8973301 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.188 s) : 0, 1187674 Total [baseline] (8.957 s) : 0, 8956679 Agent [candidate] (1.189 s) : 0, 1188773 Total [candidate] (8.969 s) : 0, 8968866 section iast_TELEMETRY_OFF Agent [baseline] (1.194 s) : 0, 1194462 Total [baseline] (8.985 s) : 0, 8985050 Agent [candidate] (1.185 s) : 0, 1184679 Total [candidate] (8.989 s) : 0, 8989009 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.065 s |-| |Agent|iast|1.193 s |128.792 ms (12.1%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.188 s |123.128 ms (11.6%)| |Agent|iast_TELEMETRY_OFF|1.194 s |129.916 ms (12.2%)| |Total|tracing|8.524 s |-| |Total|iast|8.999 s |475.523 ms (5.6%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.957 s |432.843 ms (5.1%)| |Total|iast_TELEMETRY_OFF|8.985 s |461.214 ms (5.4%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.061 s |-| |Agent|iast|1.186 s |125.037 ms (11.8%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.189 s |128.105 ms (12.1%)| |Agent|iast_TELEMETRY_OFF|1.185 s |124.011 ms (11.7%)| |Total|tracing|8.502 s |-| |Total|iast|8.973 s |471.64 ms (5.5%)| |Total|iast_HARDCODED_SECRET_DISABLED|8.969 s |467.205 ms (5.5%)| |Total|iast_TELEMETRY_OFF|8.989 s |487.348 ms (5.7%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~376d6618b0, baseline=1.40.0-SNAPSHOT~201bcbe8ed dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (679.673 ms) : 0, 679673 BytebuddyAgent [candidate] (677.134 ms) : 0, 677134 GlobalTracer [baseline] (309.434 ms) : 0, 309434 GlobalTracer [candidate] (308.269 ms) : 0, 308269 AppSec [baseline] (53.64 ms) : 0, 53640 AppSec [candidate] (53.403 ms) : 0, 53403 Remote Config [baseline] (655.947 µs) : 0, 656 Remote Config [candidate] (657.059 µs) : 0, 657 Telemetry [baseline] (7.546 ms) : 0, 7546 Telemetry [candidate] (7.608 ms) : 0, 7608 section iast BytebuddyAgent [baseline] (794.963 ms) : 0, 794963 BytebuddyAgent [candidate] (789.305 ms) : 0, 789305 GlobalTracer [baseline] (298.841 ms) : 0, 298841 GlobalTracer [candidate] (297.15 ms) : 0, 297150 AppSec [baseline] (54.714 ms) : 0, 54714 AppSec [candidate] (53.825 ms) : 0, 53825 Remote Config [baseline] (612.152 µs) : 0, 612 Remote Config [candidate] (616.794 µs) : 0, 617 Telemetry [baseline] (6.947 ms) : 0, 6947 Telemetry [candidate] (6.939 ms) : 0, 6939 IAST [baseline] (23.524 ms) : 0, 23524 IAST [candidate] (24.289 ms) : 0, 24289 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (790.752 ms) : 0, 790752 BytebuddyAgent [candidate] (791.392 ms) : 0, 791392 GlobalTracer [baseline] (298.148 ms) : 0, 298148 GlobalTracer [candidate] (298.235 ms) : 0, 298235 AppSec [baseline] (52.368 ms) : 0, 52368 AppSec [candidate] (54.475 ms) : 0, 54475 Remote Config [baseline] (611.053 µs) : 0, 611 Remote Config [candidate] (610.308 µs) : 0, 610 Telemetry [baseline] (6.992 ms) : 0, 6992 Telemetry [candidate] (7.002 ms) : 0, 7002 IAST [baseline] (25.158 ms) : 0, 25158 IAST [candidate] (23.399 ms) : 0, 23399 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (794.391 ms) : 0, 794391 BytebuddyAgent [candidate] (787.932 ms) : 0, 787932 GlobalTracer [baseline] (300.61 ms) : 0, 300610 GlobalTracer [candidate] (298.329 ms) : 0, 298329 AppSec [baseline] (55.691 ms) : 0, 55691 AppSec [candidate] (54.941 ms) : 0, 54941 Remote Config [baseline] (677.422 µs) : 0, 677 Remote Config [candidate] (603.45 µs) : 0, 603 Telemetry [baseline] (6.994 ms) : 0, 6994 Telemetry [candidate] (6.93 ms) : 0, 6930 IAST [baseline] (22.384 ms) : 0, 22384 IAST [candidate] (22.321 ms) : 0, 22321 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-29T14:39:42 2024-09-29T14:46:32
git_branch master malvarez/fix-too-many-invocations-stack-overflow
git_commit_date 1727466491 1727620127
git_commit_sha 201bcbe8ed 376d6618b0
release_version 1.40.0-SNAPSHOT~201bcbe8ed 1.40.0-SNAPSHOT~376d6618b0
start_time 2024-09-29T14:39:29 2024-09-29T14:46:19
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727621538 |1727621538 | |ci_job_id |654941259 |654941259 | |ci_pipeline_id|45375753 |45375753 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 10 metrics, 18 unstable metrics.

Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~376d6618b0, baseline=1.40.0-SNAPSHOT~201bcbe8ed dateFormat X axisFormat %s section baseline no_agent (1.34 ms) : 1321, 1359 . : milestone, 1340, appsec (1.714 ms) : 1690, 1739 . : milestone, 1714, appsec_no_iast (1.737 ms) : 1713, 1760 . : milestone, 1737, iast (1.486 ms) : 1463, 1508 . : milestone, 1486, profiling (1.484 ms) : 1462, 1507 . : milestone, 1484, tracing (1.467 ms) : 1442, 1492 . : milestone, 1467, section candidate no_agent (1.34 ms) : 1320, 1359 . : milestone, 1340, appsec (1.718 ms) : 1695, 1742 . : milestone, 1718, appsec_no_iast (1.701 ms) : 1677, 1726 . : milestone, 1701, iast (1.471 ms) : 1448, 1494 . : milestone, 1471, profiling (1.502 ms) : 1477, 1527 . : milestone, 1502, tracing (1.473 ms) : 1449, 1497 . : milestone, 1473, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.34 ms [1.321 ms, 1.359 ms]|-| |appsec|1.714 ms [1.69 ms, 1.739 ms]|374.733 µs (28.0%)| |appsec_no_iast|1.737 ms [1.713 ms, 1.76 ms]|396.924 µs (29.6%)| |iast|1.486 ms [1.463 ms, 1.508 ms]|145.99 µs (10.9%)| |profiling|1.484 ms [1.462 ms, 1.507 ms]|144.537 µs (10.8%)| |tracing|1.467 ms [1.442 ms, 1.492 ms]|127.509 µs (9.5%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.34 ms [1.32 ms, 1.359 ms]|-| |appsec|1.718 ms [1.695 ms, 1.742 ms]|378.768 µs (28.3%)| |appsec_no_iast|1.701 ms [1.677 ms, 1.726 ms]|361.693 µs (27.0%)| |iast|1.471 ms [1.448 ms, 1.494 ms]|131.026 µs (9.8%)| |profiling|1.502 ms [1.477 ms, 1.527 ms]|162.751 µs (12.1%)| |tracing|1.473 ms [1.449 ms, 1.497 ms]|133.805 µs (10.0%)|
Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~376d6618b0, baseline=1.40.0-SNAPSHOT~201bcbe8ed dateFormat X axisFormat %s section baseline no_agent (370.936 µs) : 351, 391 . : milestone, 371, iast (482.469 µs) : 461, 504 . : milestone, 482, iast_FULL (557.041 µs) : 536, 578 . : milestone, 557, iast_GLOBAL (508.212 µs) : 487, 530 . : milestone, 508, iast_HARDCODED_SECRET_DISABLED (489.404 µs) : 468, 511 . : milestone, 489, iast_INACTIVE (449.091 µs) : 428, 470 . : milestone, 449, iast_TELEMETRY_OFF (478.798 µs) : 456, 502 . : milestone, 479, tracing (446.626 µs) : 426, 467 . : milestone, 447, section candidate no_agent (372.68 µs) : 353, 392 . : milestone, 373, iast (485.546 µs) : 464, 507 . : milestone, 486, iast_FULL (555.695 µs) : 534, 577 . : milestone, 556, iast_GLOBAL (510.492 µs) : 489, 532 . : milestone, 510, iast_HARDCODED_SECRET_DISABLED (488.874 µs) : 467, 510 . : milestone, 489, iast_INACTIVE (434.686 µs) : 413, 457 . : milestone, 435, iast_TELEMETRY_OFF (475.306 µs) : 453, 497 . : milestone, 475, tracing (448.884 µs) : 427, 471 . : milestone, 449, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|370.936 µs [350.794 µs, 391.078 µs]|-| |iast|482.469 µs [461.251 µs, 503.688 µs]|111.534 µs (30.1%)| |iast_FULL|557.041 µs [535.678 µs, 578.405 µs]|186.105 µs (50.2%)| |iast_GLOBAL|508.212 µs [486.567 µs, 529.856 µs]|137.276 µs (37.0%)| |iast_HARDCODED_SECRET_DISABLED|489.404 µs [467.89 µs, 510.917 µs]|118.468 µs (31.9%)| |iast_INACTIVE|449.091 µs [428.308 µs, 469.873 µs]|78.155 µs (21.1%)| |iast_TELEMETRY_OFF|478.798 µs [455.844 µs, 501.753 µs]|107.862 µs (29.1%)| |tracing|446.626 µs [425.912 µs, 467.341 µs]|75.69 µs (20.4%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|372.68 µs [352.893 µs, 392.467 µs]|-| |iast|485.546 µs [464.287 µs, 506.804 µs]|112.865 µs (30.3%)| |iast_FULL|555.695 µs [534.301 µs, 577.09 µs]|183.015 µs (49.1%)| |iast_GLOBAL|510.492 µs [488.507 µs, 532.477 µs]|137.812 µs (37.0%)| |iast_HARDCODED_SECRET_DISABLED|488.874 µs [467.368 µs, 510.38 µs]|116.194 µs (31.2%)| |iast_INACTIVE|434.686 µs [412.531 µs, 456.841 µs]|62.006 µs (16.6%)| |iast_TELEMETRY_OFF|475.306 µs [453.137 µs, 497.476 µs]|102.626 µs (27.5%)| |tracing|448.884 µs [427.186 µs, 470.582 µs]|76.204 µs (20.4%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master malvarez/fix-too-many-invocations-stack-overflow
git_commit_date 1727466491 1727620127
git_commit_sha 201bcbe8ed 376d6618b0
release_version 1.40.0-SNAPSHOT~201bcbe8ed 1.40.0-SNAPSHOT~376d6618b0
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1727622058 |1727622058 | |ci_job_id |654941260 |654941260 | |ci_pipeline_id|45375753 |45375753 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~376d6618b0, baseline=1.40.0-SNAPSHOT~201bcbe8ed dateFormat X axisFormat %s section baseline no_agent (1.465 ms) : 1454, 1476 . : milestone, 1465, appsec (2.317 ms) : 2276, 2358 . : milestone, 2317, iast (2.07 ms) : 2018, 2122 . : milestone, 2070, iast_GLOBAL (2.091 ms) : 2041, 2141 . : milestone, 2091, profiling (2.41 ms) : 2224, 2595 . : milestone, 2410, tracing (1.899 ms) : 1861, 1937 . : milestone, 1899, section candidate no_agent (1.466 ms) : 1455, 1478 . : milestone, 1466, appsec (2.314 ms) : 2275, 2354 . : milestone, 2314, iast (2.073 ms) : 2022, 2124 . : milestone, 2073, iast_GLOBAL (2.104 ms) : 2053, 2155 . : milestone, 2104, profiling (1.928 ms) : 1888, 1968 . : milestone, 1928, tracing (1.915 ms) : 1877, 1954 . : milestone, 1915, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.465 ms [1.454 ms, 1.476 ms]|-| |appsec|2.317 ms [2.276 ms, 2.358 ms]|852.115 µs (58.2%)| |iast|2.07 ms [2.018 ms, 2.122 ms]|605.152 µs (41.3%)| |iast_GLOBAL|2.091 ms [2.041 ms, 2.141 ms]|626.131 µs (42.7%)| |profiling|2.41 ms [2.224 ms, 2.595 ms]|944.739 µs (64.5%)| |tracing|1.899 ms [1.861 ms, 1.937 ms]|434.394 µs (29.7%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.466 ms [1.455 ms, 1.478 ms]|-| |appsec|2.314 ms [2.275 ms, 2.354 ms]|848.091 µs (57.8%)| |iast|2.073 ms [2.022 ms, 2.124 ms]|606.514 µs (41.4%)| |iast_GLOBAL|2.104 ms [2.053 ms, 2.155 ms]|637.527 µs (43.5%)| |profiling|1.928 ms [1.888 ms, 1.968 ms]|461.958 µs (31.5%)| |tracing|1.915 ms [1.877 ms, 1.954 ms]|449.144 µs (30.6%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~376d6618b0, baseline=1.40.0-SNAPSHOT~201bcbe8ed dateFormat X axisFormat %s section baseline no_agent (15.568 s) : 15568000, 15568000 . : milestone, 15568000, appsec (15.244 s) : 15244000, 15244000 . : milestone, 15244000, iast (18.921 s) : 18921000, 18921000 . : milestone, 18921000, iast_GLOBAL (17.997 s) : 17997000, 17997000 . : milestone, 17997000, profiling (15.993 s) : 15993000, 15993000 . : milestone, 15993000, tracing (15.366 s) : 15366000, 15366000 . : milestone, 15366000, section candidate no_agent (14.998 s) : 14998000, 14998000 . : milestone, 14998000, appsec (15.337 s) : 15337000, 15337000 . : milestone, 15337000, iast (18.835 s) : 18835000, 18835000 . : milestone, 18835000, iast_GLOBAL (17.859 s) : 17859000, 17859000 . : milestone, 17859000, profiling (15.263 s) : 15263000, 15263000 . : milestone, 15263000, tracing (15.228 s) : 15228000, 15228000 . : milestone, 15228000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.568 s [15.568 s, 15.568 s]|-| |appsec|15.244 s [15.244 s, 15.244 s]|-324.0 ms (-2.1%)| |iast|18.921 s [18.921 s, 18.921 s]|3.353 s (21.5%)| |iast_GLOBAL|17.997 s [17.997 s, 17.997 s]|2.429 s (15.6%)| |profiling|15.993 s [15.993 s, 15.993 s]|425.0 ms (2.7%)| |tracing|15.366 s [15.366 s, 15.366 s]|-202.0 ms (-1.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|14.998 s [14.998 s, 14.998 s]|-| |appsec|15.337 s [15.337 s, 15.337 s]|339.0 ms (2.3%)| |iast|18.835 s [18.835 s, 18.835 s]|3.837 s (25.6%)| |iast_GLOBAL|17.859 s [17.859 s, 17.859 s]|2.861 s (19.1%)| |profiling|15.263 s [15.263 s, 15.263 s]|265.0 ms (1.8%)| |tracing|15.228 s [15.228 s, 15.228 s]|230.0 ms (1.5%)|