DataDog / dd-trace-java

Datadog APM client for Java
https://docs.datadoghq.com/tracing/languages/java
Apache License 2.0
572 stars 284 forks source link

Improve onboarding documentation and add stale PR cleanup automation #7663

Open PerfectSlayer opened 1 week ago

PerfectSlayer commented 1 week ago

What Does This Do

Motivation

Keep the repository fresh and welcoming

Additional Notes

Contributor Checklist

Jira ticket: APMJAVA-1358

pr-commenter[bot] commented 1 week ago

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/gh-cleanup
git_commit_date 1727166392 1727179825
git_commit_sha 0dcde7931e e15ae1b0da
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~e15ae1b0da
See matching parameters | |Baseline |Candidate | |---------------------|---------------------------------------------|---------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727183024 |1727183024 | |ci_job_id |649585183 |649585183 | |ci_pipeline_id|45003853 |45003853 | |cpu_model |Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz| |module |Agent |Agent | |parent |None |None | |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 48 metrics, 15 unstable metrics.

Startup time reports for insecure-bank ```mermaid gantt title insecure-bank - global startup overhead: candidate=1.40.0-SNAPSHOT~e15ae1b0da, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section tracing Agent [baseline] (1.566 s) : 0, 1565883 Total [baseline] (11.85 s) : 0, 11850443 Agent [candidate] (1.562 s) : 0, 1561989 Total [candidate] (11.818 s) : 0, 11817712 section iast Agent [baseline] (1.73 s) : 0, 1729990 Total [baseline] (12.489 s) : 0, 12488729 Agent [candidate] (1.738 s) : 0, 1737936 Total [candidate] (12.51 s) : 0, 12509647 section iast_HARDCODED_SECRET_DISABLED Agent [baseline] (1.741 s) : 0, 1741328 Total [baseline] (12.446 s) : 0, 12446000 Agent [candidate] (1.734 s) : 0, 1733914 Total [candidate] (12.448 s) : 0, 12448155 section iast_TELEMETRY_OFF Agent [baseline] (1.731 s) : 0, 1730538 Total [baseline] (12.507 s) : 0, 12506768 Agent [candidate] (1.724 s) : 0, 1723669 Total [candidate] (12.521 s) : 0, 12520930 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.566 s |-| |Agent|iast|1.73 s |164.107 ms (10.5%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.741 s |175.445 ms (11.2%)| |Agent|iast_TELEMETRY_OFF|1.731 s |164.655 ms (10.5%)| |Total|tracing|11.85 s |-| |Total|iast|12.489 s |638.286 ms (5.4%)| |Total|iast_HARDCODED_SECRET_DISABLED|12.446 s |595.557 ms (5.0%)| |Total|iast_TELEMETRY_OFF|12.507 s |656.325 ms (5.5%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.562 s |-| |Agent|iast|1.738 s |175.948 ms (11.3%)| |Agent|iast_HARDCODED_SECRET_DISABLED|1.734 s |171.925 ms (11.0%)| |Agent|iast_TELEMETRY_OFF|1.724 s |161.68 ms (10.4%)| |Total|tracing|11.818 s |-| |Total|iast|12.51 s |691.935 ms (5.9%)| |Total|iast_HARDCODED_SECRET_DISABLED|12.448 s |630.443 ms (5.3%)| |Total|iast_TELEMETRY_OFF|12.521 s |703.218 ms (6.0%)| ```mermaid gantt title insecure-bank - break down per module: candidate=1.40.0-SNAPSHOT~e15ae1b0da, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (1.003 s) : 0, 1002629 BytebuddyAgent [candidate] (999.867 ms) : 0, 999867 GlobalTracer [baseline] (457.453 ms) : 0, 457453 GlobalTracer [candidate] (456.301 ms) : 0, 456301 AppSec [baseline] (75.038 ms) : 0, 75038 AppSec [candidate] (75.017 ms) : 0, 75017 Remote Config [baseline] (813.047 µs) : 0, 813 Remote Config [candidate] (808.865 µs) : 0, 809 Telemetry [baseline] (9.794 ms) : 0, 9794 Telemetry [candidate] (9.836 ms) : 0, 9836 section iast BytebuddyAgent [baseline] (1.161 s) : 0, 1160668 BytebuddyAgent [candidate] (1.165 s) : 0, 1164984 GlobalTracer [baseline] (436.438 ms) : 0, 436438 GlobalTracer [candidate] (437.354 ms) : 0, 437354 AppSec [baseline] (73.64 ms) : 0, 73640 AppSec [candidate] (75.499 ms) : 0, 75499 IAST [baseline] (29.136 ms) : 0, 29136 IAST [candidate] (29.096 ms) : 0, 29096 Remote Config [baseline] (808.466 µs) : 0, 808 Remote Config [candidate] (778.162 µs) : 0, 778 Telemetry [baseline] (9.08 ms) : 0, 9080 Telemetry [candidate] (9.877 ms) : 0, 9877 section iast_HARDCODED_SECRET_DISABLED BytebuddyAgent [baseline] (1.168 s) : 0, 1167627 BytebuddyAgent [candidate] (1.161 s) : 0, 1161498 GlobalTracer [baseline] (439.285 ms) : 0, 439285 GlobalTracer [candidate] (436.842 ms) : 0, 436842 AppSec [baseline] (75.724 ms) : 0, 75724 AppSec [candidate] (73.702 ms) : 0, 73702 IAST [baseline] (28.46 ms) : 0, 28460 IAST [candidate] (31.664 ms) : 0, 31664 Remote Config [baseline] (775.689 µs) : 0, 776 Remote Config [candidate] (873.083 µs) : 0, 873 Telemetry [baseline] (9.153 ms) : 0, 9153 Telemetry [candidate] (9.082 ms) : 0, 9082 section iast_TELEMETRY_OFF BytebuddyAgent [baseline] (1.159 s) : 0, 1158743 BytebuddyAgent [candidate] (1.155 s) : 0, 1154722 GlobalTracer [baseline] (437.46 ms) : 0, 437460 GlobalTracer [candidate] (436.124 ms) : 0, 436124 AppSec [baseline] (74.814 ms) : 0, 74814 AppSec [candidate] (73.68 ms) : 0, 73680 IAST [baseline] (27.947 ms) : 0, 27947 IAST [candidate] (27.647 ms) : 0, 27647 Remote Config [baseline] (2.321 ms) : 0, 2321 Remote Config [candidate] (2.367 ms) : 0, 2367 Telemetry [baseline] (9.026 ms) : 0, 9026 Telemetry [candidate] (8.913 ms) : 0, 8913 ```
Startup time reports for petclinic ```mermaid gantt title petclinic - global startup overhead: candidate=1.40.0-SNAPSHOT~e15ae1b0da, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section tracing Agent [baseline] (1.568 s) : 0, 1568050 Total [baseline] (14.29 s) : 0, 14289733 Agent [candidate] (1.574 s) : 0, 1573630 Total [candidate] (14.292 s) : 0, 14291813 section appsec Agent [baseline] (1.769 s) : 0, 1768612 Total [baseline] (14.6 s) : 0, 14599686 Agent [candidate] (1.768 s) : 0, 1767949 Total [candidate] (14.656 s) : 0, 14656491 section iast Agent [baseline] (1.731 s) : 0, 1731464 Total [baseline] (14.772 s) : 0, 14772118 Agent [candidate] (1.731 s) : 0, 1730985 Total [candidate] (14.751 s) : 0, 14750906 section profiling Agent [baseline] (1.886 s) : 0, 1885546 Total [baseline] (14.428 s) : 0, 14428349 Agent [candidate] (1.9 s) : 0, 1899672 Total [candidate] (14.51 s) : 0, 14509915 ``` * **baseline** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.568 s |-| |Agent|appsec|1.769 s |200.562 ms (12.8%)| |Agent|iast|1.731 s |163.413 ms (10.4%)| |Agent|profiling|1.886 s |317.495 ms (20.2%)| |Total|tracing|14.29 s |-| |Total|appsec|14.6 s |309.954 ms (2.2%)| |Total|iast|14.772 s |482.385 ms (3.4%)| |Total|profiling|14.428 s |138.616 ms (1.0%)| * **candidate** results |Module|Variant|Duration|Δ tracing| |---|---|---|---| |Agent|tracing|1.574 s |-| |Agent|appsec|1.768 s |194.319 ms (12.3%)| |Agent|iast|1.731 s |157.355 ms (10.0%)| |Agent|profiling|1.9 s |326.042 ms (20.7%)| |Total|tracing|14.292 s |-| |Total|appsec|14.656 s |364.679 ms (2.6%)| |Total|iast|14.751 s |459.093 ms (3.2%)| |Total|profiling|14.51 s |218.102 ms (1.5%)| ```mermaid gantt title petclinic - break down per module: candidate=1.40.0-SNAPSHOT~e15ae1b0da, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section tracing BytebuddyAgent [baseline] (1.004 s) : 0, 1004261 BytebuddyAgent [candidate] (1.008 s) : 0, 1007511 GlobalTracer [baseline] (457.629 ms) : 0, 457629 GlobalTracer [candidate] (459.168 ms) : 0, 459168 AppSec [baseline] (75.232 ms) : 0, 75232 AppSec [candidate] (75.885 ms) : 0, 75885 Remote Config [baseline] (818.988 µs) : 0, 819 Remote Config [candidate] (825.136 µs) : 0, 825 Telemetry [baseline] (9.892 ms) : 0, 9892 Telemetry [candidate] (9.932 ms) : 0, 9932 section appsec BytebuddyAgent [baseline] (1.035 s) : 0, 1035467 BytebuddyAgent [candidate] (1.034 s) : 0, 1034108 GlobalTracer [baseline] (447.769 ms) : 0, 447769 GlobalTracer [candidate] (448.098 ms) : 0, 448098 AppSec [baseline] (242.11 ms) : 0, 242110 AppSec [candidate] (240.205 ms) : 0, 240205 Remote Config [baseline] (765.548 µs) : 0, 766 Remote Config [candidate] (813.581 µs) : 0, 814 Telemetry [baseline] (9.912 ms) : 0, 9912 Telemetry [candidate] (11.407 ms) : 0, 11407 IAST [baseline] (24.957 ms) : 0, 24957 IAST [candidate] (26.279 ms) : 0, 26279 section iast BytebuddyAgent [baseline] (1.161 s) : 0, 1161002 BytebuddyAgent [candidate] (1.16 s) : 0, 1159991 GlobalTracer [baseline] (435.929 ms) : 0, 435929 GlobalTracer [candidate] (435.581 ms) : 0, 435581 AppSec [baseline] (71.192 ms) : 0, 71192 AppSec [candidate] (73.65 ms) : 0, 73650 Remote Config [baseline] (814.353 µs) : 0, 814 Remote Config [candidate] (860.106 µs) : 0, 860 Telemetry [baseline] (8.998 ms) : 0, 8998 Telemetry [candidate] (8.987 ms) : 0, 8987 IAST [baseline] (33.317 ms) : 0, 33317 IAST [candidate] (31.636 ms) : 0, 31636 section profiling ProfilingAgent [baseline] (161.332 ms) : 0, 161332 ProfilingAgent [candidate] (166.138 ms) : 0, 166138 BytebuddyAgent [baseline] (994.379 ms) : 0, 994379 BytebuddyAgent [candidate] (998.844 ms) : 0, 998844 GlobalTracer [baseline] (586.295 ms) : 0, 586295 GlobalTracer [candidate] (589.839 ms) : 0, 589839 AppSec [baseline] (75.927 ms) : 0, 75927 AppSec [candidate] (76.744 ms) : 0, 76744 Remote Config [baseline] (804.437 µs) : 0, 804 Remote Config [candidate] (821.101 µs) : 0, 821 Telemetry [baseline] (9.46 ms) : 0, 9460 Telemetry [candidate] (9.62 ms) : 0, 9620 Profiling [baseline] (161.386 ms) : 0, 161386 Profiling [candidate] (166.195 ms) : 0, 166195 ```

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
end_time 2024-09-24T12:21:48 2024-09-24T12:28:41
git_branch master bbujon/gh-cleanup
git_commit_date 1727166392 1727179825
git_commit_sha 0dcde7931e e15ae1b0da
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~e15ae1b0da
start_time 2024-09-24T12:21:35 2024-09-24T12:28:27
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |insecure-bank |insecure-bank | |ci_job_date |1727181269 |1727181269 | |ci_job_id |649585184 |649585184 | |ci_pipeline_id|45003853 |45003853 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |iast |iast |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 16 unstable metrics.

Request duration reports for insecure-bank ```mermaid gantt title insecure-bank - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~e15ae1b0da, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section baseline no_agent (368.569 µs) : 348, 389 . : milestone, 369, iast (491.388 µs) : 470, 513 . : milestone, 491, iast_FULL (565.645 µs) : 544, 587 . : milestone, 566, iast_GLOBAL (510.518 µs) : 488, 533 . : milestone, 511, iast_HARDCODED_SECRET_DISABLED (495.284 µs) : 474, 517 . : milestone, 495, iast_INACTIVE (471.515 µs) : 450, 493 . : milestone, 472, iast_TELEMETRY_OFF (487.221 µs) : 464, 510 . : milestone, 487, tracing (450.622 µs) : 430, 471 . : milestone, 451, section candidate no_agent (377.989 µs) : 358, 398 . : milestone, 378, iast (499.895 µs) : 477, 523 . : milestone, 500, iast_FULL (559.155 µs) : 538, 580 . : milestone, 559, iast_GLOBAL (520.796 µs) : 499, 543 . : milestone, 521, iast_HARDCODED_SECRET_DISABLED (489.224 µs) : 468, 510 . : milestone, 489, iast_INACTIVE (455.249 µs) : 433, 477 . : milestone, 455, iast_TELEMETRY_OFF (487.161 µs) : 464, 511 . : milestone, 487, tracing (447.194 µs) : 427, 467 . : milestone, 447, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|368.569 µs [347.731 µs, 389.407 µs]|-| |iast|491.388 µs [470.268 µs, 512.509 µs]|122.82 µs (33.3%)| |iast_FULL|565.645 µs [544.284 µs, 587.006 µs]|197.076 µs (53.5%)| |iast_GLOBAL|510.518 µs [488.387 µs, 532.65 µs]|141.949 µs (38.5%)| |iast_HARDCODED_SECRET_DISABLED|495.284 µs [474.028 µs, 516.539 µs]|126.715 µs (34.4%)| |iast_INACTIVE|471.515 µs [450.34 µs, 492.69 µs]|102.946 µs (27.9%)| |iast_TELEMETRY_OFF|487.221 µs [464.224 µs, 510.219 µs]|118.652 µs (32.2%)| |tracing|450.622 µs [430.048 µs, 471.196 µs]|82.053 µs (22.3%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|377.989 µs [357.642 µs, 398.337 µs]|-| |iast|499.895 µs [476.651 µs, 523.139 µs]|121.906 µs (32.3%)| |iast_FULL|559.155 µs [537.91 µs, 580.401 µs]|181.166 µs (47.9%)| |iast_GLOBAL|520.796 µs [498.778 µs, 542.815 µs]|142.807 µs (37.8%)| |iast_HARDCODED_SECRET_DISABLED|489.224 µs [468.25 µs, 510.198 µs]|111.234 µs (29.4%)| |iast_INACTIVE|455.249 µs [433.353 µs, 477.145 µs]|77.259 µs (20.4%)| |iast_TELEMETRY_OFF|487.161 µs [463.763 µs, 510.559 µs]|109.172 µs (28.9%)| |tracing|447.194 µs [427.071 µs, 467.317 µs]|69.205 µs (18.3%)|
Request duration reports for petclinic ```mermaid gantt title petclinic - request duration [CI 0.99] : candidate=1.40.0-SNAPSHOT~e15ae1b0da, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section baseline no_agent (1.361 ms) : 1341, 1381 . : milestone, 1361, appsec (1.727 ms) : 1702, 1752 . : milestone, 1727, appsec_no_iast (1.717 ms) : 1692, 1741 . : milestone, 1717, iast (1.476 ms) : 1454, 1498 . : milestone, 1476, profiling (1.487 ms) : 1462, 1511 . : milestone, 1487, tracing (1.485 ms) : 1461, 1510 . : milestone, 1485, section candidate no_agent (1.345 ms) : 1325, 1364 . : milestone, 1345, appsec (1.726 ms) : 1702, 1751 . : milestone, 1726, appsec_no_iast (1.737 ms) : 1713, 1761 . : milestone, 1737, iast (1.489 ms) : 1467, 1511 . : milestone, 1489, profiling (1.503 ms) : 1478, 1527 . : milestone, 1503, tracing (1.455 ms) : 1431, 1480 . : milestone, 1455, ``` * **baseline** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.361 ms [1.341 ms, 1.381 ms]|-| |appsec|1.727 ms [1.702 ms, 1.752 ms]|366.009 µs (26.9%)| |appsec_no_iast|1.717 ms [1.692 ms, 1.741 ms]|355.683 µs (26.1%)| |iast|1.476 ms [1.454 ms, 1.498 ms]|115.148 µs (8.5%)| |profiling|1.487 ms [1.462 ms, 1.511 ms]|125.724 µs (9.2%)| |tracing|1.485 ms [1.461 ms, 1.51 ms]|124.448 µs (9.1%)| * **candidate** results |Variant|Request duration [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.345 ms [1.325 ms, 1.364 ms]|-| |appsec|1.726 ms [1.702 ms, 1.751 ms]|381.568 µs (28.4%)| |appsec_no_iast|1.737 ms [1.713 ms, 1.761 ms]|392.163 µs (29.2%)| |iast|1.489 ms [1.467 ms, 1.511 ms]|144.107 µs (10.7%)| |profiling|1.503 ms [1.478 ms, 1.527 ms]|157.95 µs (11.7%)| |tracing|1.455 ms [1.431 ms, 1.48 ms]|110.655 µs (8.2%)|

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master bbujon/gh-cleanup
git_commit_date 1727166392 1727179825
git_commit_sha 0dcde7931e e15ae1b0da
release_version 1.40.0-SNAPSHOT~0dcde7931e 1.40.0-SNAPSHOT~e15ae1b0da
See matching parameters | |Baseline |Candidate | |---------------------|----------------------------------------------|----------------------------------------------| |application |biojava |biojava | |ci_job_date |1727181692 |1727181692 | |ci_job_id |649585185 |649585185 | |ci_pipeline_id|45003853 |45003853 | |cpu_model |Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz|Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz| |variant |appsec |appsec |

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 12 metrics, 0 unstable metrics.

Execution time for tomcat ```mermaid gantt title tomcat - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~e15ae1b0da, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section baseline no_agent (1.471 ms) : 1459, 1482 . : milestone, 1471, appsec (2.317 ms) : 2276, 2357 . : milestone, 2317, iast (2.061 ms) : 2011, 2112 . : milestone, 2061, iast_GLOBAL (2.095 ms) : 2044, 2146 . : milestone, 2095, profiling (1.937 ms) : 1895, 1978 . : milestone, 1937, tracing (1.901 ms) : 1863, 1939 . : milestone, 1901, section candidate no_agent (1.46 ms) : 1448, 1471 . : milestone, 1460, appsec (2.324 ms) : 2283, 2364 . : milestone, 2324, iast (2.054 ms) : 2004, 2103 . : milestone, 2054, iast_GLOBAL (2.1 ms) : 2049, 2151 . : milestone, 2100, profiling (1.925 ms) : 1886, 1965 . : milestone, 1925, tracing (1.902 ms) : 1863, 1940 . : milestone, 1902, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.471 ms [1.459 ms, 1.482 ms]|-| |appsec|2.317 ms [2.276 ms, 2.357 ms]|845.877 µs (57.5%)| |iast|2.061 ms [2.011 ms, 2.112 ms]|590.609 µs (40.2%)| |iast_GLOBAL|2.095 ms [2.044 ms, 2.146 ms]|624.232 µs (42.4%)| |profiling|1.937 ms [1.895 ms, 1.978 ms]|465.837 µs (31.7%)| |tracing|1.901 ms [1.863 ms, 1.939 ms]|430.474 µs (29.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|1.46 ms [1.448 ms, 1.471 ms]|-| |appsec|2.324 ms [2.283 ms, 2.364 ms]|863.775 µs (59.2%)| |iast|2.054 ms [2.004 ms, 2.103 ms]|593.733 µs (40.7%)| |iast_GLOBAL|2.1 ms [2.049 ms, 2.151 ms]|640.212 µs (43.9%)| |profiling|1.925 ms [1.886 ms, 1.965 ms]|465.211 µs (31.9%)| |tracing|1.902 ms [1.863 ms, 1.94 ms]|442.076 µs (30.3%)|
Execution time for biojava ```mermaid gantt title biojava - execution time [CI 0.99] : candidate=1.40.0-SNAPSHOT~e15ae1b0da, baseline=1.40.0-SNAPSHOT~0dcde7931e dateFormat X axisFormat %s section baseline no_agent (15.302 s) : 15302000, 15302000 . : milestone, 15302000, appsec (15.293 s) : 15293000, 15293000 . : milestone, 15293000, iast (18.793 s) : 18793000, 18793000 . : milestone, 18793000, iast_GLOBAL (18.338 s) : 18338000, 18338000 . : milestone, 18338000, profiling (15.535 s) : 15535000, 15535000 . : milestone, 15535000, tracing (15.098 s) : 15098000, 15098000 . : milestone, 15098000, section candidate no_agent (15.652 s) : 15652000, 15652000 . : milestone, 15652000, appsec (15.23 s) : 15230000, 15230000 . : milestone, 15230000, iast (19.079 s) : 19079000, 19079000 . : milestone, 19079000, iast_GLOBAL (17.838 s) : 17838000, 17838000 . : milestone, 17838000, profiling (15.394 s) : 15394000, 15394000 . : milestone, 15394000, tracing (15.232 s) : 15232000, 15232000 . : milestone, 15232000, ``` * **baseline** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.302 s [15.302 s, 15.302 s]|-| |appsec|15.293 s [15.293 s, 15.293 s]|-9.0 ms (-0.1%)| |iast|18.793 s [18.793 s, 18.793 s]|3.491 s (22.8%)| |iast_GLOBAL|18.338 s [18.338 s, 18.338 s]|3.036 s (19.8%)| |profiling|15.535 s [15.535 s, 15.535 s]|233.0 ms (1.5%)| |tracing|15.098 s [15.098 s, 15.098 s]|-204.0 ms (-1.3%)| * **candidate** results |Variant|Execution Time [CI 0.99]|Δ no_agent| |---|---|---| |no_agent|15.652 s [15.652 s, 15.652 s]|-| |appsec|15.23 s [15.23 s, 15.23 s]|-422.0 ms (-2.7%)| |iast|19.079 s [19.079 s, 19.079 s]|3.427 s (21.9%)| |iast_GLOBAL|17.838 s [17.838 s, 17.838 s]|2.186 s (14.0%)| |profiling|15.394 s [15.394 s, 15.394 s]|-258.0 ms (-1.6%)| |tracing|15.232 s [15.232 s, 15.232 s]|-420.0 ms (-2.7%)|
PerfectSlayer commented 6 days ago

@jordan-wong Following on #7618 how do you feel about the following change?