[Perf] Linux/x64: 4 Regressions on 10/25/2023 10:16:22 PM

[performanceautofiler[bot]]

Run Information

Name	Value
Architecture	x64
OS	ubuntu 22.04
Queue	TigerUbuntu
Baseline	47873d852ec64eb2cff7a934935686d04430e380
Compare	40f23e33881df2ff1c3451bbb28d5c3dce7ecf68
Diff	Diff
Configs	AOT:true, CompilationMode:wasm, RunKind:micro

Regressions in System.Tests.Perf_String

Benchmark	Baseline	Test	Test/Base	Test Quality	Edge Detector	Baseline IR	Compare IR	IR Ratio
[Replace_Char - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_String.Replace_Char(text%3a%20%22This%20is%20a%20very%20nice%20sentence%22%2c%20oldChar%3a%20%27z%27%2c%20newChar%3a%20%27y%27).html>) 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	17.88 ns	24.86 ns	1.39	0.79	False
[Substring_IntInt - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_String.Substring_IntInt(s%3a%20%22dzsdzsDDZSDZSDZSddsz%22%2c%20i1%3a%200%2c%20i2%3a%208).html>) 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	67.83 ns	74.84 ns	1.10	0.30	False
[TrimEnd_CharArr - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_String.TrimEnd_CharArr(s%3a%20%22Test%22%2c%20c%3a%20%5b%27%20%27%2c%20%27%e2%80%85%27%5d).html>) 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	13.19 ns	23.63 ns	1.79	0.64	False
[Replace_String - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/refs/heads/main_x64_ubuntu 22.04_AOT=true_CompilationMode=wasm_RunKind=micro/System.Tests.Perf_String.Replace_String(text%3a%20%22This%20is%20a%20very%20nice%20sentence%22%2c%20oldValue%3a%20%22bad%22%2c%20newValue%3a%20%22nice%22).html>) 📝 - Benchmark Source 📈 - ADX Test Multi Config Graph	25.24 ns	27.88 ns	1.10	0.66	False

Test Report

Repro

General Docs link: https://github.com/dotnet/performance/blob/main/docs/benchmarking-workflow-dotnet-runtime.md

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'System.Tests.Perf_String*'

### Payloads [Baseline]() [Compare]() ### System.Tests.Perf_String.Replace_Char(text: "This is a very nice sentence", oldChar: 'z', newChar: 'y') #### ETL Files #### Histogram #### JIT Disasms ### System.Tests.Perf_String.Substring_IntInt(s: "dzsdzsDDZSDZSDZSddsz", i1: 0, i2: 8) #### ETL Files #### Histogram #### JIT Disasms ### System.Tests.Perf_String.TrimEnd_CharArr(s: "Test", c: [' ', ' ']) #### ETL Files #### Histogram #### JIT Disasms ### System.Tests.Perf_String.Replace_String(text: "This is a very nice sentence", oldValue: "bad", newValue: "nice") #### ETL Files #### Histogram #### JIT Disasms ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

[radekdoulik]

the range is probably https://github.com/dotnet/runtime/compare/9c64c56269f473527a831e0bc3d804d3c7d8b9a3...8812857fef5847a423cc3bc0106441db3e57a1d3

might be one of the bumps?

[radekdoulik]

all the measurements are noisy, so it could be noise too

[radical]

the range is probably dotnet/runtime@9c64c56...8812857

might be one of the bumps?

what bump?