-
Notifications
You must be signed in to change notification settings - Fork 27.5k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Mac_x64 module_test_ios is 3.00% flaky #144680
Comments
The simulator rebooted in the middle of the test, which would be an Xcode issue. This looks the same as #142125. #143967 added retry logic for |
It's rebooting randomly in the middle of these tests on random "waits" so just doing the retry on "Increment via Flutter" isn't enough, it needs to be all |
<!-- meta-tags: To be used by the automation script only, DO NOT MODIFY. { "name": "Mac_x64 module_test_ios" } --> Issue link: #144680
[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-01 and 2024-03-07 is 5.10%. Flaky number: 5; total number: 98. Recent test runs: |
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-13 and 2024-03-19 is 4.00%. Flaky number: 4; total number: 100. Recent test runs: |
[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-01 and 2024-03-07 is 5.10%. Flaky number: 5; total number: 98. Recent test runs: |
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-19 and 2024-03-26 is 2.00%. Flaky number: 2; total number: 100. Recent test runs: |
[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-04 and 2024-03-07 is 4.23%. Flaky number: 3; total number: 71. Recent test runs: |
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-26 and 2024-04-02 is 2.00%. Flaky number: 2; total number: 100. Recent test runs: |
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-03 and 2024-04-09 is 3.00%. Flaky number: 3; total number: 100. Recent test runs: |
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-06 and 2024-04-16 is 4.00%. Flaky number: 4; total number: 100. Recent test runs: |
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-17 and 2024-04-23 is 1.00%. Flaky number: 1; total number: 100. Recent test runs: |
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-04-23 and 2024-04-30 is 3.00%. Flaky number: 3; total number: 100. Recent test runs: |
[staging pool] flaky ratio for the past (up to) 100 commits between 2024-05-01 and 2024-05-07 is 2.00%. Flaky number: 2; total number: 100. Recent test runs: |
Deleting with #148264, this test isn't adding anything. |
This thread has been automatically locked since there has not been any recent activity after it was closed. If you are still experiencing a similar issue, please open a new bug, including the output of |
The post-submit test builder
Mac_x64 module_test_ios
had a flaky ratio 3.00% for the past (up to) 100 commits, which is above our 2.00% threshold.One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
Commit: d3c274b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668
Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios
Please follow https://github.com/flutter/flutter/wiki/Reducing-Test-Flakiness#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).
The text was updated successfully, but these errors were encountered: