Mac_x64 module_test_ios is 3.00% flaky

[fluttergithubbot]

The post-submit test builder Mac_x64 module_test_ios had a flaky ratio 3.00% for the past (up to) 100 commits, which is above our 2.00% threshold.

One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
Commit: d3c274b

Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

Please follow https://github.com/flutter/flutter/wiki/Reducing-Test-Flakiness#fixing-flaky-tests to fix the flakiness and enable the test back after validating the fix (internal dashboard to validate: go/flutter_test_flakiness).

[jmagman]

 [2024-03-03 19:56:51.382516] [STDOUT] stdout:     t =    34.02s Get number of matches for: Elements matching predicate '"This is Marquee" IN identifiers'
 [2024-03-03 19:56:52.057342] [STDOUT] stdout: /Volumes/Work/s/w/ir/x/t/flutter_module_test.tfsA5B/hello_host_app/FlutterUITests/FlutterUITests.m:122: error: -[FlutterUITests testDualCold] : Asynchronous wait failed: Exceeded timeout of 30 seconds, with unfulfilled expectations: "Expect predicate `count == 2` for object <XCUIElementQuery: 0x600002140230>".
 [2024-03-03 19:56:52.059265] [STDOUT] stdout:     t =    34.70s Tear Down
 [2024-03-03 19:56:52.303887] [STDOUT] stdout: Test Case '-[FlutterUITests testDualCold]' failed (34.944 seconds).

The simulator rebooted in the middle of the test, which would be an Xcode issue.

This looks the same as #142125. #143967 added retry logic for testFlutterViewWarm but this one is testDualCold.

[jmagman]

 [2024-03-01 04:45:29.765690] [STDOUT] stdout:     t =    66.75s     Checking `Expect predicate `exists == 1` for object "Flutter iOS Demos Home" NavigationBar`
 [2024-03-01 04:45:29.766683] [STDOUT] stdout:     t =    66.75s         Checking existence of `"Flutter iOS Demos Home" NavigationBar`
 [2024-03-01 04:45:29.791278] [STDOUT] stdout:     t =    66.77s         Capturing element debug description
 [2024-03-01 04:45:29.968312] [STDOUT] stdout:     t =    66.95s Checking existence of `"Flutter iOS Demos Home" NavigationBar`
 [2024-03-01 04:45:29.991019] [STDOUT] stdout:     t =    66.97s Capturing debug information
 [2024-03-01 04:45:29.992448] [STDOUT] stdout:     t =    66.97s     Requesting snapshot of accessibility hierarchy for app with pid 45473
 [2024-03-01 04:45:30.174742] [STDOUT] stdout: /Volumes/Work/s/w/ir/x/t/flutter_module_test.Yt9NmR/hello_host_app/FlutterUITests/FlutterUITests.m:126: error: -[FlutterUITests testDualCold] : (([app.navigationBars[@"Flutter iOS Demos Home"] waitForExistenceWithTimeout:kStandardTimeOut]) is true) failed
 [2024-03-01 04:45:30.176602] [STDOUT] stdout:     t =    67.16s Tear Down
 [2024-03-01 04:45:30.445736] [STDOUT] stdout: Test Case '-[FlutterUITests testDualCold]' failed (67.426 seconds).

It's rebooting randomly in the middle of these tests on random "waits" so just doing the retry on "Increment via Flutter" isn't enough, it needs to be all waits. 🤮

[fluttergithubbot]

[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-01 and 2024-03-07 is 5.10%. Flaky number: 5; total number: 98.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
Commit: 894620b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/734
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-13 and 2024-03-19 is 4.00%. Flaky number: 4; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/260
Commit: 98369bd
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/260
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/240
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/235
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/215

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-01 and 2024-03-07 is 5.10%. Flaky number: 5; total number: 98.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
Commit: 894620b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/734
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/673
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/668

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[staging pool] flaky ratio for the past (up to) 100 commits between 2024-03-19 and 2024-03-26 is 2.00%. Flaky number: 2; total number: 100.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/360
Commit: 3373961
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/360
https://ci.chromium.org/ui/p/flutter/builders/staging/Mac_x64%20module_test_ios/311

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios

[fluttergithubbot]

[prod pool] flaky ratio for the past (up to) 100 commits between 2024-03-04 and 2024-03-07 is 4.23%. Flaky number: 3; total number: 71.
One recent flaky example for a same commit: https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
Commit: 894620b
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/744
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/734
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac_x64%20module_test_ios/692

Recent test runs:
https://flutter-dashboard.appspot.com/#/build?taskFilter=Mac_x64%20module_test_ios