Open performanceautofiler[bot] opened 10 months ago
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
278.74 ΞΌs | 306.36 ΞΌs | 1.10 | 0.03 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
1.73 ΞΌs | 2.02 ΞΌs | 1.16 | 0.21 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEach<String>*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
244.95 ms | 325.89 ms | 1.33 | 0.04 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Benchstone.BenchI.BenchE*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
20.69 ns | 28.25 ns | 1.37 | 0.10 | False | |||
|
16.50 ns | 32.06 ns | 1.94 | 0.20 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_Char*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
14.33 ΞΌs | 16.53 ΞΌs | 1.15 | 0.02 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.TryGetValueFalse<Int32, Int32>*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
1.36 ΞΌs | 1.59 ΞΌs | 1.17 | 0.08 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateForEachNonGeneric<String>*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
150.59 ns | 290.16 ns | 1.93 | 0.03 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Collections.IterateFor<String>*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
2.80 ns | 5.49 ns | 1.96 | 0.22 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Memory.ReadOnlySequence*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
11.96 ns | 13.84 ns | 1.16 | 0.12 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'Microsoft.Extensions.Logging.ScopesOverheadBenchmark*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
11.06 ns | 13.53 ns | 1.22 | 0.05 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Linq.Tests.Perf_Enumerable*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
435.01 ms | 462.70 ms | 1.06 | 0.15 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SciMark2.kernel*'
Name | Value |
---|---|
Architecture | x64 |
OS | Windows 10.0.19042 |
Queue | OwlWindows |
Baseline | 0cd1774178907472dcd6348489a61a7e43a93389 |
Compare | 0151c4696eb14f52f567ceee91d2896ff2586edf |
Diff | Diff |
Configs | CompilationMode:tiered, RunKind:micro |
Benchmark | Baseline | Test | Test/Base | Test Quality | Edge Detector | Baseline IR | Compare IR | IR Ratio |
---|---|---|---|---|---|---|---|---|
|
445.92 ΞΌs | 541.33 ΞΌs | 1.21 | 0.07 | False |
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
git clone https://github.com/dotnet/performance.git
py .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'PerfLabTests.CastingPerf2.CastingPerf*'
The diff is mostly (where it's not a noise) pointing to https://github.com/dotnet/runtime/compare/04ede0dadfbf2f1082d3bd218cea6fe46bbbed4a...50f6502c146af42b45601f3b1a3e73403b9be113. For example for the System.Tests.Perf_String.IndexerCheckLengthHoisting
the regression is only win-x64 (both AMD and Intel). Could https://github.com/dotnet/runtime/pull/93704 be the reason? cc @AndyAyersMS
Could dotnet/runtime#93704 be the reason? cc @AndyAyersMS
Seems unlikely as that change had no diffs (other than making the JIT a bit faster). No good theory here.
Let's see if this persists and if so perhaps we can transfer and try and bisect this.
Run Information
Regressions in PerfLabTests.DelegatePerf
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Text.RegularExpressions.Tests.Perf_Regex_Industry_RustLang_Sherlock
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Text.Json.Document.Tests.Perf_EnumerateArray
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Memory.Span<Byte>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Collections.Tests.Perf_BitArray
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Memory.Span<Char>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Text.Json.Tests.Perf_Get
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.MathBenchmarks.Single
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Collections.IterateForEachNonGeneric<Int32>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Tests.Perf_String
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md
Run Information
Regressions in System.Collections.Tests.Perf_PriorityQueue<String, String>
Repro
General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md