Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[wasm] Move EnableAggressiveTrimming build to runtime pipeline #52252

Merged
merged 2 commits into from
May 5, 2021

Conversation

radical
Copy link
Member

@radical radical commented May 4, 2021

.. from runtime-staging, so any changes that break that can be caught,
and fixed. Any test failures in runtime-staging don't fail the job
itself, so it gets missed.

.. from `runtime-staging`, so any changes that break that can be caught,
and fixed. Any test failures in `runtime-staging` don't fail the job
itself, so it gets missed.
@radical radical added arch-wasm WebAssembly architecture trimming-for-aot `EnableAggressiveTrimming=true` used for running tests with AOT labels May 4, 2021
@ghost
Copy link

ghost commented May 4, 2021

Tagging subscribers to 'arch-wasm': @lewing
See info in area-owners.md if you want to be subscribed.

Issue Details

.. from runtime-staging, so any changes that break that can be caught,
and fixed. Any test failures in runtime-staging don't fail the job
itself, so it gets missed.

Author: radical
Assignees: -
Labels:

arch-wasm, trimming-for-aot

Milestone: -

@radical
Copy link
Member Author

radical commented May 4, 2021

This will need a fix for #52194 (comment) which @eerhardt is looking at, to get a green build.

@steveisok
Copy link
Member

The work items on this leg have had a > 90% pass rate for at least the last 14 days.

@lewing
Copy link
Member

lewing commented May 4, 2021

based on the new lanes failing in #52194 (comment) that is probably trimming related?

@ViktorHofer
Copy link
Member

Is this just about building or also testing on helix? If the former then there's no need to move it over from runtime-staging as in case of build errors, the legs turns red and marks the PR as failed. Only test failures in the runtime-staging leg are ignored in the PR's success mark.

@radical
Copy link
Member Author

radical commented May 4, 2021

Tests are built for AOT (in runtime-staging), and those have to use EnableAggressiveTrimming(EAT). To make sure that the AOT test run doesn't fail because of EAT failures, we use a separate job for just building tests with EAT. This is that job.

We need to keep this job green, and since it can break with any library change, we want it to be in runtime, so it can get caught+fixed at the time of the change.

@radical
Copy link
Member Author

radical commented May 4, 2021

Err.. sorry, I misspoke. For the EAT job, we do build and run the tests. This ensures that the tests pass with trimming.

And the AOT job in runtime-staging runs the same set of tests as above.

@ViktorHofer
Copy link
Member

Cool. What's the current pass rate of these tests in runtime-staging? We usually move stuff over when they reach 80-90% pass rate.

@radical
Copy link
Member Author

radical commented May 4, 2021

According to @steveisok:

The work items on this leg have had a > 90% pass rate for at least the last 14 days.

@ViktorHofer
Copy link
Member

Great 👍 thanks a lot

@eerhardt
Copy link
Member

eerhardt commented May 4, 2021

This will need a fix for #52194 (comment) which @eerhardt is looking at, to get a green build.

#52265 should address the wasm EAT test failures in Microsoft.Extensions.HostFactoryResolver.Tests.

@lewing
Copy link
Member

lewing commented May 5, 2021

runtime (Build Browser wasm Release AllSubsets_Mono) failure is #51131

Please see https://chromedriver.chromium.org/security-considerations for suggestions on keeping ChromeDriver safe.
ChromeDriver was started successfully.
[03:49:29] info: browser: Console websocket connected.
[03:49:29] info: Arguments: --run,WasmTestRunner.dll,System.Data.Common.Tests.dll,-notrait,category=IgnoreForCI,-notrait,category=OuterLoop,-notrait,category=failing
[03:49:31] info: Initializing.....
[03:50:07] info: Discovering: System.Data.Common.Tests.dll (method display = ClassAndMethod, method display options = None)
[03:50:07] info: Discovered:  System.Data.Common.Tests.dll (found 1787 of 1813 test cases)
[03:50:07] info: Starting:    System.Data.Common.Tests.dll
[03:50:07] fail: [FAIL] System.Data.Tests.AppDomainsAndFormatInfo.Bug55978
[03:50:07] info: Assert.Equal() Failure
[03:50:07] info: Expected: 2
[03:50:07] info: Actual:   3
[03:50:07] info:    at System.Data.Tests.AppDomainsAndFormatInfo.Bug55978()
[03:50:07] info:    at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
[03:50:07] info: Finished:    System.Data.Common.Tests.dll
[03:50:07] info: 
[03:50:07] info: === TEST EXECUTION SUMMARY ===
[03:50:07] info: Total: 11692, Errors: 0, Failed: 1, Skipped: 10, Time: 27.68769s
[03:50:07] info: 

@radical radical merged commit 342df93 into dotnet:main May 5, 2021
@radical radical deleted the wasm-eat-runtime branch May 5, 2021 13:59
@karelz karelz added this to the 6.0.0 milestone May 20, 2021
@ghost ghost locked as resolved and limited conversation to collaborators Jun 19, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
arch-wasm WebAssembly architecture area-Infrastructure-mono trimming-for-aot `EnableAggressiveTrimming=true` used for running tests with AOT
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants