Open lucaspimentel opened 3 months ago
Branch report: lpimentel/dockerignore
Commit report: 8b7985b
Test service: dd-trace-dotnet
:white_check_mark: 0 Failed, 342266 Passed, 1783 Skipped, 14h 39m 51.39s Total Time
Execution-time results for samples comparing the following branches/commits:
Execution-time benchmarks measure the whole time it takes to execute a program. And are intended to measure the one-off costs. Cases where the execution time results for the PR are worse than latest master results are shown in red. The following thresholds were used for comparing the execution times:
Note that these results are based on a single point-in-time result for each branch. For full results, see the dashboard.
Graphs show the p99 interval based on the mean and StdDev of the test run, as well as the mean value of the run (shown as a diamond below the graph).
gantt
title Execution time (ms) FakeDbCommand (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5719) - mean (75ms) : 64, 85
. : milestone, 75,
master - mean (70ms) : 66, 75
. : milestone, 70,
section CallTarget+Inlining+NGEN
This PR (5719) - mean (1,049ms) : 1030, 1069
. : milestone, 1049,
master - mean (1,048ms) : 1028, 1068
. : milestone, 1048,
gantt
title Execution time (ms) FakeDbCommand (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5719) - mean (109ms) : 106, 113
. : milestone, 109,
master - mean (108ms) : 105, 110
. : milestone, 108,
section CallTarget+Inlining+NGEN
This PR (5719) - mean (747ms) : 729, 766
. : milestone, 747,
master - mean (745ms) : 722, 769
. : milestone, 745,
gantt
title Execution time (ms) FakeDbCommand (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5719) - mean (94ms) : 89, 98
. : milestone, 94,
master - mean (92ms) : 89, 95
. : milestone, 92,
section CallTarget+Inlining+NGEN
This PR (5719) - mean (697ms) : 678, 717
. : milestone, 697,
master - mean (696ms) : 678, 714
. : milestone, 696,
gantt
title Execution time (ms) HttpMessageHandler (.NET Framework 4.6.2)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5719) - mean (191ms) : 187, 196
. : milestone, 191,
master - mean (192ms) : 188, 196
. : milestone, 192,
section CallTarget+Inlining+NGEN
This PR (5719) - mean (1,192ms) : 1171, 1213
. : milestone, 1192,
master - mean (1,187ms) : 1164, 1210
. : milestone, 1187,
gantt
title Execution time (ms) HttpMessageHandler (.NET Core 3.1)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5719) - mean (278ms) : 271, 285
. : milestone, 278,
master - mean (277ms) : 271, 283
. : milestone, 277,
section CallTarget+Inlining+NGEN
This PR (5719) - mean (966ms) : 942, 990
. : milestone, 966,
master - mean (967ms) : 944, 990
. : milestone, 967,
gantt
title Execution time (ms) HttpMessageHandler (.NET 6)
dateFormat X
axisFormat %s
todayMarker off
section Baseline
This PR (5719) - mean (265ms) : 261, 270
. : milestone, 265,
master - mean (265ms) : 259, 271
. : milestone, 265,
section CallTarget+Inlining+NGEN
This PR (5719) - mean (950ms) : 924, 976
. : milestone, 950,
master - mean (949ms) : 926, 971
. : milestone, 949,
Throughput results for AspNetCoreSimpleController comparing the following branches/commits:
Cases where throughput results for the PR are worse than latest master (5% drop or greater), results are shown in red.
Note that these results are based on a single point-in-time result for each branch. For full results, see one of the many, many dashboards!
gantt
title Throughput Linux x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5719) (11.564M) : 0, 11564333
master (11.512M) : 0, 11511804
benchmarks/2.9.0 (11.486M) : 0, 11485944
section Automatic
This PR (5719) (7.852M) : 0, 7852091
master (7.843M) : 0, 7842926
benchmarks/2.9.0 (8.079M) : 0, 8078652
section Trace stats
master (8.151M) : 0, 8151401
section Manual
This PR (5719) (10.077M) : 0, 10077184
master (10.013M) : 0, 10013455
section Manual + Automatic
This PR (5719) (7.377M) : 0, 7377141
master (7.489M) : 0, 7488707
section Version Conflict
master (6.642M) : 0, 6641889
gantt
title Throughput Linux arm64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5719) (9.549M) : 0, 9549125
master (9.495M) : 0, 9494938
benchmarks/2.9.0 (9.655M) : 0, 9655153
section Automatic
This PR (5719) (6.520M) : 0, 6520035
master (6.479M) : 0, 6478710
section Trace stats
master (6.879M) : 0, 6879028
section Manual
This PR (5719) (8.131M) : 0, 8130685
master (8.078M) : 0, 8078195
section Manual + Automatic
This PR (5719) (6.064M) : 0, 6064104
master (6.175M) : 0, 6175368
section Version Conflict
master (5.559M) : 0, 5559377
gantt
title Throughput Windows x64 (Total requests)
dateFormat X
axisFormat %s
section Baseline
This PR (5719) (9.963M) : 0, 9963415
master (10.125M) : 0, 10125420
benchmarks/2.9.0 (10.359M) : 0, 10359271
section Automatic
This PR (5719) (7.086M) : 0, 7085765
master (7.228M) : 0, 7227689
benchmarks/2.9.0 (7.441M) : 0, 7440770
section Trace stats
master (7.543M) : 0, 7543465
section Manual
This PR (5719) (8.677M) : 0, 8677296
master (9.037M) : 0, 9037258
section Manual + Automatic
This PR (5719) (6.765M) : 0, 6765240
master (6.948M) : 0, 6947618
section Version Conflict
master (6.297M) : 0, 6296514
Benchmarks for #5719 compared to master:
The following thresholds were used for comparing the benchmark speeds:
Allocation changes below 0.5% are ignored.
Summary of changes
Reason for change
Implementation details
Test coverage
Other details