Test failure Color.RedirectedOutputDoesNotUseAnsiSequences

[VincentBu]

Run: runtime 20211024.12

Failed test:

net7.0-windows-Release-x64-CoreCLR_checked-Windows.10.Amd64.Open

- Color.RedirectedOutputDoesNotUseAnsiSequences

Error message:

System.IO.IOException : Unknown error (0xa5b8)


Stack trace
   at System.ConsolePal.GetBufferInfo(Boolean throwOnNoConsole, Boolean& succeeded) in /_/src/libraries/System.Console/src/System/ConsolePal.Windows.cs:line 1076
   at System.ConsolePal.ResetColor() in /_/src/libraries/System.Console/src/System/ConsolePal.Windows.cs:line 519
   at System.Console.ResetColor() in /_/src/libraries/System.Console/src/System/Console.cs:line 349
   at Color.<>c.<RedirectedOutputDoesNotUseAnsiSequences>b__5_0(MemoryStream data) in /_/src/libraries/System.Console/tests/Color.cs:line 67
   at Helpers.RunInRedirectedOutput(Action`1 command) in /_/src/libraries/System.Console/tests/Helpers.cs:line 46
   at Color.RedirectedOutputDoesNotUseAnsiSequences() in /_/src/libraries/System.Console/tests/Color.cs:line 60

[ghost]

Tagging subscribers to this area: @dotnet/area-system-console
See info in area-owners.md if you want to be subscribed.

Issue Details

---

Run: runtime 20211024.12

Failed test:

net7.0-windows-Release-x64-CoreCLR_checked-Windows.10.Amd64.Open

- Color.RedirectedOutputDoesNotUseAnsiSequences

Error message:

System.IO.IOException : Unknown error (0xa5b8)


Stack trace
   at System.ConsolePal.GetBufferInfo(Boolean throwOnNoConsole, Boolean& succeeded) in /_/src/libraries/System.Console/src/System/ConsolePal.Windows.cs:line 1076
   at System.ConsolePal.ResetColor() in /_/src/libraries/System.Console/src/System/ConsolePal.Windows.cs:line 519
   at System.Console.ResetColor() in /_/src/libraries/System.Console/src/System/Console.cs:line 349
   at Color.<>c.<RedirectedOutputDoesNotUseAnsiSequences>b__5_0(MemoryStream data) in /_/src/libraries/System.Console/tests/Color.cs:line 67
   at Helpers.RunInRedirectedOutput(Action`1 command) in /_/src/libraries/System.Console/tests/Helpers.cs:line 46
   at Color.RedirectedOutputDoesNotUseAnsiSequences() in /_/src/libraries/System.Console/tests/Color.cs:line 60

Author:	VincentBu
Assignees:	-
Labels:	area-System.Console, os-windows, arch-x64, untriaged
Milestone:	-

[danmoseley]

GetConsoleScreenBufferInfo returned 0xa5b8. @jkotas do you know what kind of code this is? It's not any kind of Windows error that I can find.

[jkotas]

This is the special LAST_ERROR_TRASH_VALUE that is used by checked runtime to explicitly tag places where the last last error may be getting corrupted.

I do not see anything wrong with the code in System.Console. It is likely a problem introduced by switching to the DllImport source generator.

cc @elinor-fung @jkoritzinsky @AaronRobinsonMSFT

[danmoseley]

This is the special LAST_ERROR_TRASH_VALUE that is used by checked runtime to explicitly tag places where the last last error may be getting corrupted.

Ah! That explains it. I have added this to the team crib sheet.

[danmoseley]

If it helps, in the last month this is may be the only test that encountered this error code - albeit 3 times.

TestResults
| join kind=inner WorkItems on WorkItemId
| join kind=inner Jobs on JobId
| where Finished >= now(-30d)
| where Result == 'Fail'
| where Message contains "0xa5b8"
| project Started, Duration, Type, Method, FriendlyName, MachineName, QueueName1, Message, StackTrace, Arguments, Branch

gives 3 hits, all on RedirectedOutputDoesNotUseAnsiSequences specifically. Something special about GetConsoleScreenBufferInfo?

[jkotas]

Given that this failure is intermittent, my guess is that there is a path in tiered compilation corrupting the last error.

[jkotas]

Fix in #60886