Open dudikeleti opened 1 week ago
Branch report: dudik/3rdparty-includes-excludes
Commit report: f81b6ef
Test service: dd-trace-dotnet
:white_check_mark: 0 Failed, 44334 Passed, 106 Skipped, 25m 23.38s Total Time
Execution-time results for samples comparing the following branches/commits:
Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.
Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).
gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5722) - mean (74ms) : 63, 85
. : milestone, 74,
master - mean (74ms) : 65, 84
. : milestone, 74,
section CallTarget+Inlining+NGEN
This PR (5722) - mean (913ms) : 891, 935
. : milestone, 913,
master - mean (911ms) : 883, 939
. : milestone, 911,
gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5722) - mean (110ms) : 107, 114
. : milestone, 110,
master - mean (109ms) : 106, 112
. : milestone, 109,
section CallTarget+Inlining+NGEN
This PR (5722) - mean (636ms) : 619, 654
. : milestone, 636,
master - mean (632ms) : 618, 647
. : milestone, 632,
gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5722) - mean (95ms) : 93, 97
. : milestone, 95,
master - mean (93ms) : 90, 96
. : milestone, 93,
section CallTarget+Inlining+NGEN
This PR (5722) - mean (596ms) : 576, 616
. : milestone, 596,
master - mean (594ms) : 574, 614
. : milestone, 594,
gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5722) - mean (192ms) : 188, 197
. : milestone, 192,
master - mean (191ms) : 187, 195
. : milestone, 191,
section CallTarget+Inlining+NGEN
This PR (5722) - mean (1,015ms) : 986, 1045
. : milestone, 1015,
master - mean (1,009ms) : 979, 1040
. : milestone, 1009,
gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5722) - mean (276ms) : 271, 281
. : milestone, 276,
master - mean (275ms) : 271, 279
. : milestone, 275,
section CallTarget+Inlining+NGEN
This PR (5722) - mean (818ms) : 795, 842
. : milestone, 818,
master - mean (824ms) : 791, 856
. : milestone, 824,
gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5722) - mean (266ms) : 261, 271
. : milestone, 266,
master - mean (266ms) : 262, 270
. : milestone, 266,
section CallTarget+Inlining+NGEN
This PR (5722) - mean (820ms) : 790, 851
. : milestone, 820,
master - mean (810ms) : 782, 837
. : milestone, 810,
Throughput results for AspNetCoreSimpleController comparing the following branches/commits:
Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.
Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!
gantt
title Throughput Linux x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5722) (11.540M) : 0, 11539570
master (11.716M) : 0, 11716370
benchmarks/2.9.0 (11.959M) : 0, 11959218
section Automatic
This PR (5722) (7.721M) : 0, 7721103
master (8.019M) : 0, 8019217
benchmarks/2.9.0 (8.424M) : 0, 8423539
section Trace stats
master (8.211M) : 0, 8210949
section Manual
This PR (5722) (10.015M) : 0, 10014833
master (10.165M) : 0, 10165125
section Manual + Automatic
This PR (5722) (7.408M) : 0, 7407863
master (7.491M) : 0, 7491415
section Version Conflict
master (6.704M) : 0, 6704048
gantt
title Throughput Linux arm64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5722) (9.657M) : 0, 9656850
master (9.678M) : 0, 9677607
benchmarks/2.9.0 (9.647M) : 0, 9646678
section Automatic
This PR (5722) (6.642M) : 0, 6642457
master (6.494M) : 0, 6493916
section Trace stats
master (6.867M) : 0, 6866744
section Manual
This PR (5722) (8.097M) : 0, 8097218
master (8.353M) : 0, 8353119
section Manual + Automatic
This PR (5722) (6.106M) : 0, 6105819
master (6.149M) : 0, 6148874
section Version Conflict
master (5.635M) : 0, 5635422
gantt
title Throughput Windows x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5722) (10.154M) : 0, 10154316
master (10.277M) : 0, 10276790
benchmarks/2.9.0 (10.154M) : 0, 10153990
section Automatic
This PR (5722) (7.125M) : 0, 7124662
master (7.193M) : 0, 7193100
benchmarks/2.9.0 (7.563M) : 0, 7562893
section Trace stats
master (7.542M) : 0, 7542132
section Manual
This PR (5722) (8.943M) : 0, 8943155
master (9.045M) : 0, 9045425
section Manual + Automatic
This PR (5722) (6.910M) : 0, 6910064
master (6.963M) : 0, 6963205
section Version Conflict
master (6.250M) : 0, 6250263
Benchmarks for #5722 compared to master:
The following thresholds were used for comparing the benchmark speeds:
Allocation changes below 0.5% are ignored.
Summary of changes
Add the default 3rd party detection includes\excludes