Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

System.Numerics.Tensors.Tests.TensorSpanTests test failure #103525

Closed
jkotas opened this issue Jun 15, 2024 · 3 comments · Fixed by #106166
Closed

System.Numerics.Tensors.Tests.TensorSpanTests test failure #103525

jkotas opened this issue Jun 15, 2024 · 3 comments · Fixed by #106166
Assignees
Labels
area-System.Numerics.Tensors blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' in-pr There is an active PR which will close this issue when it is merged Known Build Error Use this to report build issues in the .NET Helix tab
Milestone

Comments

@jkotas
Copy link
Member

jkotas commented Jun 15, 2024

  Discovering: System.Numerics.Tensors.Tests (method display = ClassAndMethod, method display options = None)
  Discovered:  System.Numerics.Tensors.Tests (found 2422 of 4294 test cases)
  Starting:    System.Numerics.Tensors.Tests (parallel test collections = on [6 threads], stop on fail = off)
    System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut<Single>(tensorPrimitivesOperation: TensorPrimitivesSpanInSpanOut`1 { Method = Void SoftMax(System.ReadOnlySpan`1[System.Single], System.Span`1[System.Single]), Target = null }, tensorOperation: TensorSpanInSpanOut`1 { Method = System.Numerics.Tensors.TensorSpan`1[System.Single] SoftMaxInPlace[Single](System.Numerics.Tensors.TensorSpan`1[System.Single]), Target = null }) [FAIL]
      Assert.All() Failure: 1 out of 11 items in the collection did not pass.
      [10]: Item:  [4, 4, 4, 4, 4]
            Error: Assert.Equal() Failure: Values differ
                   Expected: 1.15352677E-23
                   Actual:   1.15352685E-23
      Stack Trace:
        /_/src/libraries/System.Numerics.Tensors/tests/TensorSpanTests.cs(143,0): at System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut[T](TensorPrimitivesSpanInSpanOut`1 tensorPrimitivesOperation, TensorSpanInSpanOut`1 tensorOperation)
           at InvokeStub_TensorSpanTests.TensorExtensionsSpanInSpanOut(Object, Span`1)
           at System.Reflection.MethodBaseInvoker.InvokeWithFewArgs(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
  Finished:    System.Numerics.Tensors.Tests

Build Information

Build: https://dev.azure.com/dnceng-public/cbb18261-c48f-4abb-8651-8cdcb5474649/_build/results?buildId=709057
Build error leg or test failing: System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut
Pull request: #103519

Error Message

Fill the error message using step by step known issues guidance.

{
  "ErrorMessage": ["System.Numerics.Tensors", "items in the collection did not pass", "Failure: Values differ" ],
  "ErrorPattern": "",
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Known issue validation

Build: 🔎 https://dev.azure.com/dnceng-public/public/_build/results?buildId=709057
Error message validated: [System.Numerics.Tensors items in the collection did not pass Failure: Values differ]
Result validation: ✅ Known issue matched with the provided build.
Validation performed at: 6/15/2024 7:11:03 PM UTC

Report

Build Definition Test Pull Request
773673 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut #106294
773418 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.Dot_AllLengths #106166
773213 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.SumOfMagnitudes_AllLengths #106166
773114 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #106285
773036 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.SumOfMagnitudes_AllLengths #106166
772593 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #106257
772519 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInTOut #106252
771366 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.SoftMax_AllLengths #106166
771264 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #106156
770680 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #106179
770472 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInTOut #106169
770358 dotnet/runtime System.Numerics.Tensors.Tests.DoubleGenericTensorPrimitives.Distance_AllLengths #106166
770020 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #106151
770010 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut #106100
769813 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsTwoSpanInFloatOut #106111
769293 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #106107
768415 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #106014
768462 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105866
768382 dotnet/runtime System.Numerics.Tensors.Tests.NFloatGenericTensorPrimitives.SpanScalarSpanDestination_SpecialValues
768349 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #99596
767914 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #106050
766803 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInTOut #104964
765968 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105868
764532 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #105894
764230 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut #105879
763503 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsTwoSpanInFloatOut #105847
763422 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInTOut #105761
763040 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105816
762985 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105812
762880 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105647
762573 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105789
761337 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #103752
761191 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105671
760039 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105427
759277 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut #105581
758407 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #104849
757147 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105541
756714 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #105308
756409 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut #105544
756082 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105531
755785 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105517
754695 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105207
754100 dotnet/runtime System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.Log_AllValues #104964
754191 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut #85344
753057 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #105308
752619 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsTwoSpanInFloatOut #104957
751070 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #105268
751836 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInTOut #104957
751024 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #104957
749527 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsTwoSpanInFloatOut #105205
749028 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #105181
748782 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #104959
746673 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues #104848
746420 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #105084
744934 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #105003
744859 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #104961
744435 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsTwoSpanInFloatOut #105016
743917 dotnet/runtime System.Numerics.Tensors.Tests.TensorSpanTests.TensorExtensionsSpanInSpanOut #104393
743452 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #104848
743262 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #104552
743196 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationDestinationFunctions_InPlace #104848
742229 dotnet/runtime System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.SpanDestinationDestinationFunctions_SpecialValues #104848
741281 dotnet/runtime System.Numerics.Tensors.Tests.DoubleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues #104848
741278 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #104536
740696 dotnet/runtime System.Numerics.Tensors.Tests.DoubleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues #104848
740646 dotnet/runtime System.Numerics.Tensors.Tests.DoubleGenericTensorPrimitives.SpanDestinationFunctions_SpecialValues #104848
740442 dotnet/runtime System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut #104857

Summary

24-Hour Hit Count 7-Day Hit Count 1-Month Count
7 21 67
@jkotas jkotas added blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' Known Build Error Use this to report build issues in the .NET Helix tab labels Jun 15, 2024
@dotnet-policy-service dotnet-policy-service bot added the untriaged New issue has not been triaged by the area owner label Jun 15, 2024
Copy link
Contributor

Tagging subscribers to this area: @dotnet/area-system-numerics-tensors
See info in area-owners.md if you want to be subscribed.

@v-wenyuxu
Copy link

Failed in: runtime-coreclr libraries-jitstress 20240619.1

Failed tests:

net9.0-linux-Release-x64-jitstress1_tiered-Ubuntu.2204.Amd64.Open
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
net9.0-linux-Release-x64-jitstress2_tiered-Ubuntu.2204.Amd64.Open
    - System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
net9.0-windows-Release-x64-jitstress1_tiered-Windows.10.Amd64.Open
    - System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.NonGenericSingleTensorPrimitivesTests.CosineSimilarity_AllLengths
    - System.Numerics.Tensors.Tests.SingleGenericTensorPrimitives.CosineSimilarity_AllLengths

Error message:

 Assert.All() Failure: 4 out of 256 items in the collection did not pass.
[3]: Item:  4
     Error: Assert.Equal() Failure: Values differ
            Expected: 0.151808769
            Actual:   0.25312683
[4]: Item:  5
     Error: Assert.Equal() Failure: Values differ
            Expected: 0.253379166
            Actual:   0.138663024
[5]: Item:  6
     Error: Assert.Equal() Failure: Values differ
            Expected: -0.344092488
            Actual:   -0.0114496415
[6]: Item:  7
     Error: Assert.Equal() Failure: Values differ
            Expected: -0.410494238
            Actual:   -0.248638168

Stack trace:

   at System.Numerics.Tensors.Tests.TensorPrimitivesTests`1.CosineSimilarity_AllLengths() in /_/src/libraries/System.Numerics.Tensors/tests/TensorPrimitivesTests.cs:line 740
   at System.RuntimeMethodHandle.InvokeMethod(Object target, Void** arguments, Signature sig, Boolean isConstructor)
   at System.Reflection.MethodBaseInvoker.InvokeWithNoArgs(Object obj, BindingFlags invokeAttr) in /_/src/libraries/System.Private.CoreLib/src/System/Reflection/MethodBaseInvoker.cs:line 57

@v-wenyuxu
Copy link

Failed in: runtime-coreclr libraries-pgo 20240623.1

Failed tests:

net9.0-windows-Release-x86-jitosr_stress_random-Windows.10.Amd64.Open
    - System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut<Single>

Error message:

Assert.All() Failure: 1 out of 12 items in the collection did not pass.
[11]: Item:  [1, 2, 3, 4, 5, ···]
Error: Assert.Equal() Failure: Values differ
Expected: 0.000104251681
Actual:   0.000104251689

Stack trace:

   at System.Numerics.Tensors.Tests.TensorTests.TensorExtensionsSpanInSpanOut[T](PerformCalculationSpanInSpanOut`1 tensorPrimitivesOperation, Func`2 tensorOperation) in /_/src/libraries/System.Numerics.Tensors/tests/TensorTests.cs:line 96
   at InvokeStub_TensorTests.TensorExtensionsSpanInSpanOut(Object, Span`1)
   at System.Reflection.MethodBaseInvoker.InvokeWithFewArgs(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)

@jeffhandley jeffhandley added this to the 9.0.0 milestone Jul 20, 2024
@jeffhandley jeffhandley removed the untriaged New issue has not been triaged by the area owner label Jul 20, 2024
@dotnet-policy-service dotnet-policy-service bot added the in-pr There is an active PR which will close this issue when it is merged label Aug 8, 2024
@github-actions github-actions bot locked and limited conversation to collaborators Sep 12, 2024
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-System.Numerics.Tensors blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' in-pr There is an active PR which will close this issue when it is merged Known Build Error Use this to report build issues in the .NET Helix tab
Projects
None yet
Development

Successfully merging a pull request may close this issue.

4 participants