Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Test failure: System.Tests.DoubleTests.AtanPiTest on Android #71252

Closed
karelz opened this issue Jun 24, 2022 · 4 comments · Fixed by #74080
Closed

Test failure: System.Tests.DoubleTests.AtanPiTest on Android #71252

karelz opened this issue Jun 24, 2022 · 4 comments · Fixed by #74080
Labels
area-Codegen-meta-mono bug disabled-test The test is disabled in source code against the issue os-android
Milestone

Comments

@karelz
Copy link
Member

karelz commented Jun 24, 2022

Started failing on 6/22 in every Rolling run -- 7 failures in last 7 days

  • 6/29: 14 failures in last 7 days

Affected test:

  • System.Tests.DoubleTests.AtanPiTest

Platform:

  • net7.0-Android-Release-x86-Mono_Release-Ubuntu.1804.Amd64.Android.29.Open

Failure:

Assert.Equal() Failure
Expected:                 -0.0
Actual:                   +0.0

   at System.AssertExtensions.Equal(Double expected, Double actual, Double variance) in /_/src/libraries/Common/tests/TestUtilities/System/AssertExtensions.cs:line 747
   at System.Tests.DoubleTests.AtanPiTest(Double value, Double expectedResult, Double allowedVariance) in /_/src/libraries/System.Runtime/tests/System/DoubleTests.cs:line 1475
   at System.Reflection.MethodInvoker.InterpretedInvoke(Object obj, Span`1 args, BindingFlags invokeAttr)
@karelz karelz added area-System.Runtime blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' os-android labels Jun 24, 2022
@ghost ghost added the untriaged New issue has not been triaged by the area owner label Jun 24, 2022
@ghost
Copy link

ghost commented Jun 24, 2022

Tagging subscribers to this area: @dotnet/area-system-runtime
See info in area-owners.md if you want to be subscribed.

Issue Details

Started failing on 6/22 in every Rolling run -- 7 failures in last 7 days

Affected test:

  • System.Tests.DoubleTests.AtanPiTest

Failure:

Assert.Equal() Failure
Expected:                 -0.0
Actual:                   +0.0

   at System.AssertExtensions.Equal(Double expected, Double actual, Double variance) in /_/src/libraries/Common/tests/TestUtilities/System/AssertExtensions.cs:line 747
   at System.Tests.DoubleTests.AtanPiTest(Double value, Double expectedResult, Double allowedVariance) in /_/src/libraries/System.Runtime/tests/System/DoubleTests.cs:line 1475
   at System.Reflection.MethodInvoker.InterpretedInvoke(Object obj, Span`1 args, BindingFlags invokeAttr)
Author: karelz
Assignees: -
Labels:

area-System.Runtime, blocking-clean-ci, os-android

Milestone: -

@karelz karelz changed the title Test failure: System.Tests.DoubleTests.AtanPiTest Test failure: System.Tests.DoubleTests.AtanPiTest on Android Jun 24, 2022
@karelz
Copy link
Member Author

karelz commented Jun 24, 2022

Due to large impact on CI, we should disable the tests ASAP

mkhamoyan added a commit to mkhamoyan/runtime that referenced this issue Jun 24, 2022
@steveisok steveisok removed the untriaged New issue has not been triaged by the area owner label Jun 24, 2022
@dakersnar
Copy link
Contributor

Investigating this now. I am not able to reproduce it locally on a non-android device. I immediately notice that AtanPi uses the Math.Atan() intrinsic, which could have incorrect behavior on android devices. What this boils down to is that we expect Atan(-0) to produce -0, but instead it is probably producing 0. I'm unsure if there is a flaw in our logic or a flaw in the intrinsic's behavior.

@dakersnar dakersnar added the bug label Jun 24, 2022
@dakersnar
Copy link
Contributor

dakersnar commented Jun 24, 2022

Here is the current implementation of AtanPi: return Math.Atan(x) / Pi;

We have a test verifying that Math.Atan(-0) returns -0. A simple example also shows that -0 divided by Pi should return -0. Given this, I believe that there is a bug in Mono for Math.AtanPi.

I'm unsure which mono area this should fall under so I'm putting it under "meta".

mkhamoyan added a commit to mkhamoyan/runtime that referenced this issue Jun 27, 2022
mkhamoyan added a commit to mkhamoyan/runtime that referenced this issue Jun 28, 2022
@stephentoub stephentoub added the disabled-test The test is disabled in source code against the issue label Jun 28, 2022
mkhamoyan added a commit to mkhamoyan/runtime that referenced this issue Jun 29, 2022
mkhamoyan added a commit to mkhamoyan/runtime that referenced this issue Jun 29, 2022
mkhamoyan added a commit that referenced this issue Jun 30, 2022
* #71252 disable AtanPiTest on Android x86
@agocke agocke removed the blocking-clean-ci Blocking PR or rolling runs of 'runtime' or 'runtime-extra-platforms' label Jul 1, 2022
@steveisok steveisok added this to the Future milestone Jul 18, 2022
@ghost ghost added the in-pr There is an active PR which will close this issue when it is merged label Aug 18, 2022
@ghost ghost removed the in-pr There is an active PR which will close this issue when it is merged label Aug 18, 2022
@ghost ghost locked as resolved and limited conversation to collaborators Sep 17, 2022
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
area-Codegen-meta-mono bug disabled-test The test is disabled in source code against the issue os-android
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants