search

dotnet / runtime

.NET is a cross-platform runtime for cloud, mobile, desktop, and IoT apps.
https://docs.microsoft.com/dotnet/core/
MIT License
15.07k stars 4.69k forks source link

System.Numerics.Tensors.Tests.TensorSpanTests test failure #103525

Closed jkotas closed 1 month ago

jkotas commented 3 months ago 
  Discovering: System.Numerics.Tensors.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Numerics.Tensors.Tests (found 2422 of 4294 test cases)
  Starting:    System.Numerics.Tensors.Tests (parallel test collections = on [6 threads], stop on fail = off)
    System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut<Single>(tensorPrimitivesOperation: TensorPrimitivesSpanInSpanOut`1 { Method = Void SoftMax(System.ReadOnlySpan`1[System.Single], System.Span`1[System.Single]), Target = null }, tensorOperation: TensorSpanInSpanOut`1 { Method = System.Numerics.Tensors.TensorSpan`1[System.Single] SoftMaxInPlace[Single](System.Numerics.Tensors.TensorSpan`1[System.Single]), Target = null }) [FAIL]
      Assert.All() Failure: 1 out of 11 items in the collection did not pass.
      [10]: Item:  [4, 4, 4, 4, 4]
            Error: Assert.Equal() Failure: Values differ
                   Expected: 1.15352677E-23
                   Actual:   1.15352685E-23
      Stack Trace:
        /_/src/libraries/System.Numerics.Tensors/tests/TensorSpanTests.cs(143,0): at System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut[T](TensorPrimitivesSpanInSpanOut`1 tensorPrimitivesOperation, TensorSpanInSpanOut`1 tensorOperation)
           at InvokeStub_TensorSpanTests.TensorExtensionsSpanInSpanOut(Object, Span`1)
           at System.Reflection.MethodBaseInvoker.InvokeWithFewArgs(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
  Finished:    System.Numerics.Tensors.Tests

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=709057 Build error leg or test failing: System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut Pull request: https://github.com/dotnet/runtime/pull/103519

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": ["System.Numerics.Tensors", "items in the collection did not pass", "Failure: Values differ" ],
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: :mag_right: https://dev.azure.com/dnceng-public/public/_build/results?buildId=709057 Error message validated: [System.Numerics.Tensors items in the collection did not pass Failure: Values differ] Result validation: :white_check_mark: Known issue matched with the provided build. Validation performed at: 6/15/2024 7:11:03 PM UTC

Report

Build Definition Test Pull Request
773673 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#106294
773418 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.Dot_AllLengths dotnet/runtime#106166
773213 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.SumOfMagnitudes_AllLengths dotnet/runtime#106166
773114 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#106285
773036 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.SumOfMagnitudes_AllLengths dotnet/runtime#106166
772593 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#106257
772519 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInTOut dotnet/runtime#106252
771366 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.SoftMax_AllLengths dotnet/runtime#106166
771264 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#106156
770680 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#106179
770472 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInTOut dotnet/runtime#106169
770358 dotnet/runtime System.Numerics.Tensors.Tests.DoubleGenericTensorPrimitives.Distance_AllLengths dotnet/runtime#106166
770020 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#106151
770010 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#106100
769813 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#106111
769293 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#106107
768415 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#106014
768462 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105866
768382 dotnet/runtime System.Numerics.Tensors.Tests.NFloatGenericTensorPrimitives.SpanScalarSpanDestination_SpecialValues
768349 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#99596
767914 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#106050
766803 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInTOut dotnet/runtime#104964
765968 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105868
764532 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105894
764230 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#105879
763503 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#105847
763422 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInTOut dotnet/runtime#105761
763040 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105816
762985 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105812
762880 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105647
762573 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105789
761337 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#103752
761191 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105671
760039 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105427
759277 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#105581
758407 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#104849
757147 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105541
756714 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105308
756409 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#105544
756082 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105531
755785 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105517
754695 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105207
754100 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.Log_AllValues dotnet/runtime#104964
754191 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#85344
753057 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105308
752619 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#104957
751070 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105268
751836 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInTOut dotnet/runtime#104957
751024 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#104957
749527 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#105205
749028 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105181
748782 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#104959
746673 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#104848
746420 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105084
744934 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#105003
744859 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#104961
744435 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsTwoSpanInFloatOut dotnet/runtime#105016
743917 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut dotnet/runtime#104393
743452 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#104848
743262 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#104552
743196 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationDestinationFunctions_InPlace dotnet/runtime#104848
742229 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationDestinationFunctions_SpecialValues dotnet/runtime#104848
741281 dotnet/runtime System.Numerics.Tensors.Tests.DoubleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#104848
741278 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#104536
740696 dotnet/runtime System.Numerics.Tensors.Tests.DoubleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#104848
740646 dotnet/runtime System.Numerics.Tensors.Tests.DoubleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues dotnet/runtime#104848
740442 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut dotnet/runtime#104857

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
7 21 67
dotnet-policy-service[bot] commented 3 months ago

Tagging subscribers to this area: @dotnet/area-system-numerics-tensors See info in area-owners.md if you want to be subscribed.

v-wenyuxu commented 3 months ago

Failed in: runtime-coreclr libraries-jitstress 20240619.1

Failed tests:

net9.0-linux-Release-x64-jitstress1_tiered-Ubuntu.2204.Amd64.Open
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
net9.0-linux-Release-x64-jitstress2_tiered-Ubuntu.2204.Amd64.Open
    - System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
net9.0-windows-Release-x64-jitstress1_tiered-Windows.10.Amd64.Open
    - System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.CosineSimilarity_AllLengths

Error message:

 Assert.All() Failure: 4 out of 256 items in the collection did not pass.
[3]: Item:  4
     Error: Assert.Equal() Failure: Values differ
            Expected: 0.151808769
            Actual:   0.25312683
[4]: Item:  5
     Error: Assert.Equal() Failure: Values differ
            Expected: 0.253379166
            Actual:   0.138663024
[5]: Item:  6
     Error: Assert.Equal() Failure: Values differ
            Expected: -0.344092488
            Actual:   -0.0114496415
[6]: Item:  7
     Error: Assert.Equal() Failure: Values differ
            Expected: -0.410494238
            Actual:   -0.248638168

Stack trace:

   at System.Numerics.Tensors.Tests.TensorPrimitivesTests`1.CosineSimilarity_AllLengths() in /_/src/libraries/System.Numerics.Tensors/tests/TensorPrimitivesTests.cs:line 740
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs:line 57
v-wenyuxu commented 3 months ago

Failed in: runtime-coreclr libraries-pgo 20240623.1

Failed tests:

net9.0-windows-Release-x86-jitosr_stress_random-Windows.10.Amd64.Open
    - System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut<Single>

Error message:

Assert.All() Failure: 1 out of 12 items in the collection did not pass.
[11]: Item:  [1, 2, 3, 4, 5, ···]
Error: Assert.Equal() Failure: Values differ
Expected: 0.000104251681
Actual:   0.000104251689

Stack trace:

   at System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut[T](PerformCalculationSpanInSpanOut`1 tensorPrimitivesOperation, Func`2 tensorOperation) in /_/src/libraries/System.Numerics.Tensors/tests/TensorTests.cs:line 96
   at InvokeStub_TensorTests.TensorExtensionsSpanInSpanOut(Object, Span`1)
   at System.Reflection.MethodBaseInvoker.InvokeWithFewArgs(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)