dotnet / perf-autofiling-issues

A landing place for auto-filed performance issues before they receive triage
MIT License
9 stars 4 forks source link

[Perf] Linux/x64: 3 Regressions on 11/28/2022 7:14:24 PM #10095

Open performanceautofiler[bot] opened 1 year ago

performanceautofiler[bot] commented 1 year ago

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 4140814b80c3236a1c5930e8ca398535db79f77d
Compare 24f595040d104553a809179a7093dde2f01c1f9c
Diff Diff

Regressions in SixLabors.ImageSharp.Benchmarks.DetectEdges

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[ImageProcessorCoreDetectEdges - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/8.0_x64_ubuntu 18.04_RunKind=imagesharp/SixLabors.ImageSharp.Benchmarks.DetectEdges.ImageProcessorCoreDetectEdges.html>) 3.63 ms 9.79 ms 2.70 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SixLabors.ImageSharp.Benchmarks.DetectEdges*'
### Histogram #### SixLabors.ImageSharp.Benchmarks.DetectEdges.ImageProcessorCoreDetectEdges ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 4140814b80c3236a1c5930e8ca398535db79f77d
Compare 24f595040d104553a809179a7093dde2f01c1f9c
Diff Diff

Regressions in SixLabors.ImageSharp.Benchmarks.Codecs.Jpeg.DecodeJpeg

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[JpegBaselineInterleaved444 - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/8.0_x64_ubuntu 18.04_RunKind=imagesharp/SixLabors.ImageSharp.Benchmarks.Codecs.Jpeg.DecodeJpeg.JpegBaselineInterleaved444.html>) 9.44 ms 10.11 ms 1.07 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SixLabors.ImageSharp.Benchmarks.Codecs.Jpeg.DecodeJpeg*'
### Histogram #### SixLabors.ImageSharp.Benchmarks.Codecs.Jpeg.DecodeJpeg.JpegBaselineInterleaved444 ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)

Run Information

Architecture x64
OS ubuntu 18.04
Baseline 4140814b80c3236a1c5930e8ca398535db79f77d
Compare 24f595040d104553a809179a7093dde2f01c1f9c
Diff Diff

Regressions in SixLabors.ImageSharp.Benchmarks.Samplers.GaussianBlur

Benchmark Baseline Test Test/Base Test Quality Edge Detector Baseline IR Compare IR IR Ratio Baseline ETL Compare ETL
[Blur - Duration of single invocation](<https://pvscmdupload.z22.web.core.windows.net/reports/allTestHistory/8.0_x64_ubuntu 18.04_RunKind=imagesharp/SixLabors.ImageSharp.Benchmarks.Samplers.GaussianBlur.Blur.html>) 1.88 ms 2.00 ms 1.06 0.00 True

Test Report

Repro

git clone https://github.com/dotnet/performance.git
python3 .\performance\scripts\benchmarks_ci.py -f net8.0 --filter 'SixLabors.ImageSharp.Benchmarks.Samplers.GaussianBlur*'
### Histogram #### SixLabors.ImageSharp.Benchmarks.Samplers.GaussianBlur.Blur ```log ``` ### Description of detection logic ```IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. IsRegressionBase: Marked as regression because the compare was 5% greater than the baseline, and the value was not too small. IsImprovementBase: Marked as not an improvement because the compare was not 5% less than the baseline, or the value was too small. ``` ### Docs [Profiling workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/profiling-workflow-dotnet-runtime.md) [Benchmarking workflow for dotnet/runtime repository](https://github.com/dotnet/performance/blob/master/docs/benchmarking-workflow-dotnet-runtime.md)
kunalspathak commented 1 year ago

Exciting to see the real world benchmarks here. CC: @JimBobSquarePants and @antonfirsov

JimBobSquarePants commented 1 year ago

AMAZING!