Skip to content

fix(locator): include deadline setup in waitFor elapsed time - #1635

Closed
okwasniewski wants to merge 2 commits into
mainfrom
oskar/fix-main-failing-tests
Closed

okwasniewski wants to merge 2 commits into
mainfrom
oskar/fix-main-failing-tests

Conversation

@okwasniewski

@okwasniewski okwasniewski commented Nov 8, 2026 •

Copy link
Copy Markdown
Member

What and why

  • Start measuring waitFor before constructing its deadline. Previously, crossing a millisecond boundary during setup made a 300 ms wait report 299 ms.
  • Keep polling, timeout values, and existing assertions unchanged. Add a deterministic regression that forces the boundary, plus documentation and a patch changeset.

Issue

Addresses the Node 22.22.3 failure in https://github.com/tester-army/e2e/actions/runs/42445682374/job/128623992220 on main a016b3e4e99f0ad09a2466221740d244241f602f. Reproduced against main c9783a0666ffea9af4d156d1154657fb94b4af1b, whose latest CI passed. The separate screenshot-navigation failure is covered by existing PR #1614.

Verified

Ran it locally: yes

main this branch
Deterministic regression reports waitedMs: 299 instead of 300 Reports 300; all 22 locator-wait unit tests pass
pnpm --filter e2e exec vitest run tests/unit/locator-wait-for.test.ts
Before: 1 failed, 21 passed
After: 22 passed

pnpm --filter e2e exec vitest run --project integration tests/integration/failure-evidence.test.ts --reporter verbose
Test Files  1 passed (1)
Tests       8 passed (8)

The integration suite uses the built runner and validates the emitted failure evidence and reports. The deterministic regression ran against unchanged main source before the fix. Independent T3 review found no issues and independently reran the 22 unit tests. The final post-review run passed all 30 focused unit and integration tests.

The built CLI also passed the Chromium testbed forms suite:

cd apps/testbed
node node_modules/e2e/dist/cli/bin.js run tests/forms.e2e.ts
Test Files  1 passed (1)
Tests       4 passed (4)

Full pnpm test passed, including 4,307 core tests, 723 web tests, the remaining packages, and 140 script tests. Core and web each retain one existing skip.

Full pnpm check passed, including lint, dead-code, builds, all package typechecks, documentation, changesets, plugins, and MCP metadata.

Full pnpm --filter @e2e-dev/testbed test also passed before opening this PR.

Checklist

  • Patch changeset added for e2e.
  • Breaking change: not applicable.
  • Docs updated in docs/reference/screen.mdx; the consumer skill does not describe waitedMs.
  • Public API or wire contract change: not applicable.
  • Engine contract change: not applicable.

View guided diff Turn on auto-fix

Verification after merging #1614

Merged main at f6aba97257700339b60fb67722178d23ee2c5f93 into this branch without rewriting published history. The previous web-agent failure matched #1614's infinite-scroll bug: scrolling stopped at item 60 while more items were loading.

The unchanged committed recording now passes locally with strict replay:

CI=1 E2E_CACHE_DIR= node node_modules/e2e/dist/cli/bin.js run --config e2e.agent.config.ts --grep '^act completes infinite-scroll$' --strict-cache --reporter list
Tests  1 passed (1)
Cache  1 replayed

Rebuilt all packages and the benchmark app. All 50 focused core tests passed across locator waits, failure evidence, and scroll behavior; all 6 screenshot-navigation tests passed. No recording was replaced. CI has finished for the merge commit; see the remaining failure below.

Remaining CI failure

The Node 22.22.3 job passed all 314 core test files, including the original failure-evidence case, then failed packages/acp/tests/executor.test.ts:522: retries the session directory removal after the agent exits when the first try fails. Its fake agent had already exited at the 500 ms liveness check (kill ESRCH). This ACP code is unchanged by this PR and came from #1626.

The focused ACP test passes locally on both Node 24.19.0 and Node 22.22.3. The full ACP suite also passes locally on Node 22.22.3, all 39 tests. These runs were on macOS; the CI failure was on Linux. The cause of the early child exit has not been reproduced or established. No assertion was weakened and no CI retry was requested to hide it. This PR is not yet green.

All web and mobile benchmark jobs passed on 1b8e421: web 91, web agent 33, Android 57 plus one documented skip, Android agent 20, iOS 55 plus one documented skip, and iOS agent 21 plus one documented skip. No checks remain pending. The Node 22.22.3 ACP cleanup test and its dependent spec gate are the only failed checks. No review threads are open. The PR has not been labeled Ready for Human Review because that failure remains unresolved.

Starting the elapsed timer after creating the deadline can report 299 ms for a 300 ms wait when setup crosses a millisecond boundary. Record the start first and cover the boundary deterministically without changing polling or weakening failure-evidence assertions.
@github-actions github-actions Bot added the size:S Up to 29 changed lines, not counting tests, fixtures, translated docs, or the lockfile label Nov 8, 2026

@cubic-dev-ai cubic-dev-ai Bot left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

No issues found across 4 files

View guided diff | Turn on auto-fix | Re-trigger cubic

@github-actions

github-actions Bot commented Nov 8, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e web: 91 passed

All 91 tests in 41 files
Test Time
🟢 tests/aria-hidden-flow.e2e.ts · 2 passed 591ms
🟢 aria hidden flow › picks the Pro plan by its visible text and confirms it 422ms
🟢 aria hidden flow › another plan shows the error and keeps the picker open 169ms
🟢 tests/async-states.e2e.ts · 2 passed 7.0s
🟢 async states › reads the code off the transient toast and verifies it once the button enables 2.2s
🟢 async states › a wrong code is rejected after the toast has gone 4.7s
🟢 tests/canvas-only.e2e.ts · 2 passed 232ms
🟢 canvas only › taps square, circle, then diamond at their pixel coordinates 118ms
🟢 canvas only › a shape out of order paints the error and resets progress 114ms
🟢 tests/canvas-whiteboard.e2e.ts · 2 passed 356ms
🟢 canvas whiteboard › drags both shapes into their slots and saves 223ms
🟢 canvas whiteboard › bounces a shape off the wrong slot and refuses to save early 133ms
🟢 tests/cart-totals.e2e.ts · 2 passed 314ms
🟢 cart totals › increasing a quantity updates the line total but the order summary stays stale (planted bug) 179ms
🟢 cart totals › a quantity never drops below one 135ms
🟢 tests/checkout-review.e2e.ts · 1 passed 147ms
🟢 shows a raw greeting token and an undefined delivery date (planted bug), yet places the order 147ms
🟢 tests/context-menu-trap.e2e.ts · 2 passed 508ms
🟢 context menu trap › right-click opens nothing; the row menu renames the file 249ms
🟢 context menu trap › the decoy menu items refuse and keep the file 259ms
🟢 tests/control-inventory.e2e.ts · 8 passed 3.4s
🟢 control inventory › check sets the checkbox and the radio without flipping a set one 232ms
🟢 control inventory › check picks a radio the pick replaces with its summary 146ms
🟢 control inventory › a long press and a double click are told apart from a tap 972ms
🟢 control inventory › the file menu opens on right-click only and Rename renames the file 238ms
🟢 control inventory › setInputFiles attaches files named from the project root 139ms
🟢 control inventory › the details view is left through the browser history 152ms
🟢 control inventory › scrollIntoView brings the footnote into view 238ms
🟢 control inventory › every exercise done shows the success message 1.3s
🟢 tests/css-content-ui.e2e.ts · 2 passed 296ms
🟢 css content ui › the tile labelled Ship it advances and confirming ships 161ms
🟢 css content ui › a wrong tile shows the CSS-rendered error and keeps the picker 135ms
🟢 tests/date-picker.e2e.ts · 2 passed 547ms
🟢 date picker › navigates three months ahead and books the required date 312ms
🟢 date picker › confirming without the exact date shows the error 235ms
🟢 tests/debounced-search.e2e.ts · 2 passed 2.8s
🟢 debounced search › a decoy one character off is refused 1.4s
🟢 debounced search › picking the exact item adds it to the cart 1.4s
🟢 tests/deferred-dialog.e2e.ts · 1 passed 1.0s
🟢 one submit opens one confirm, even when double-clicked 1.0s
🟢 tests/div-soup.e2e.ts · 2 passed 598ms
🟢 div soup › a wrong code is rejected 266ms
🟢 div soup › the right code grants access after the delete tile fixes a typo 332ms
🟢 tests/drag-and-drop.e2e.ts · 2 passed 628ms
🟢 drag and drop › an out-of-order item resets the dropzone 333ms
🟢 drag and drop › dropping Banana then Cherry passes 295ms
🟢 tests/filter-deep-link.e2e.ts · 2 passed 208ms
🟢 filter deep link › filtering writes the query to the URL 116ms
🟢 filter deep link › opening a shared link restores the filter 92ms
🟢 tests/gift-card-purchase.e2e.ts · 3 passed 490ms
🟢 gift card purchase › refuses to buy without an amount 123ms
🟢 gift card purchase › refuses a recipient without an at sign 180ms
🟢 gift card purchase › sends the gift card 187ms
🟢 tests/hover-menu.e2e.ts · 2 passed 411ms
🟢 hover menu › a decoy leaf is refused 179ms
🟢 hover menu › hovering Account, then Billing, reaches Redeem voucher 232ms
🟢 tests/iframe-form.e2e.ts · 2 passed 543ms
🟢 iframe form › a wrong code is refused by the host page 211ms
🟢 iframe form › the code read from one frame applies through the other 332ms
🟢 tests/image-only-ui.e2e.ts · 3 passed 403ms
🟢 image only ui › the icons have no names, so the bare svg locator is ambiguous 105ms
🟢 image only ui › a wrong icon shows the error image and keeps the icons 137ms
🟢 image only ui › tapping the star, then the heart, verifies the icons 161ms
🟢 tests/infinite-scroll.e2e.ts · 1 passed 2.6s
🟢 scrolls the feed until the Golden Ticket loads, then claims it 2.6s
🟢 tests/kanban-board.e2e.ts · 3 passed 652ms
🟢 kanban board › pointer drags move both cards into the goal layout 317ms
🟢 kanban board › a swipe along a path drags a card as well 134ms
🟢 kanban board › a plain tap moves nothing and the untouched board is rejected 201ms
🟢 tests/login-form.e2e.ts · 4 passed 728ms
🟢 login form › rejects a malformed email 167ms
🟢 login form › rejects a short password 180ms
🟢 login form › rejects an unknown account 170ms
🟢 login form › signs in and logs out 211ms
🟢 tests/lying-labels.e2e.ts · 4 passed 596ms
🟢 lying labels › the button whose accessible name says Pay now is the wrong one 133ms
🟢 lying labels › a text match for Pay now catches the decoy phrase too 95ms
🟢 lying labels › the field whose accessible name says Amount is the wrong one 186ms
🟢 lying labels › visible text drives the payment through 182ms
🟢 tests/native-dialogs.e2e.ts · 3 passed 401ms
🟢 native dialogs › answers the confirm, prompt, and alert chain 135ms
🟢 native dialogs › dismissing the confirm cancels the order 132ms
🟢 native dialogs › a wrong gift code is rejected 134ms
🟢 tests/newsletter-signup.e2e.ts · 1 passed 2.2s
🟢 subscribe renders no feedback and logs a TypeError (planted bug) 2.2s
🟢 tests/onboarding-wizard.e2e.ts · 5 passed 4.3s
🟢 onboarding wizard › back keeps what was typed and the brief comes back with it 230ms
🟢 onboarding wizard › the address step takes the brief through its bare-div dropdown 316ms
🟢 onboarding wizard › the profile step steers the calendar three decades back 1.1s
🟢 onboarding wizard › the preferences step flips the toggles the brief names and leaves the trap off 1.3s
🟢 onboarding wizard › the review step repeats the brief and finishes with the PIN 1.4s
🟢 tests/order-history.e2e.ts · 2 passed 1.4s
🟢 order history › overview and settings render their panels 182ms
🟢 order history › the orders tab never leaves its loading state (planted bug) 1.2s
🟢 tests/otp-auto-advance.e2e.ts · 3 passed 1.4s
🟢 otp auto-advance › focus advances with each digit and the full code verifies 462ms
🟢 otp auto-advance › backspace on an empty box clears and refocuses the previous one 138ms
🟢 otp auto-advance › a wrong code clears every box and starts over 774ms
🟢 tests/overlay-trap.e2e.ts · 1 passed 702ms
🟢 continues only after the banner and the overlay are gone 702ms
🟢 tests/playbook-cleanup.e2e.ts · 2 passed 447ms
🟢 playbook cleanup › deleting the draft removes it from an exact-name search 218ms
🟢 playbook cleanup › cancelling the dialog keeps the draft searchable 229ms
🟢 tests/price-sorting.e2e.ts · 3 passed 368ms
🟢 price sorting › opens in the featured order with sale prices struck through 100ms
🟢 price sorting › low to high sorts by the original price, not the paid one (planted bug) 123ms
🟢 price sorting › high to low is the same wrong order reversed (planted bug) 145ms
🟢 tests/product-reviews.e2e.ts · 1 passed 1.1s
🟢 the running-shoe page lists coffee-grinder reviews (planted bug) 1.1s
🟢 tests/promo-storefront.e2e.ts · 1 passed 1.4s
🟢 buys a deal once the promo chrome is out of the way 1.4s
🟢 tests/rich-text-editor.e2e.ts · 2 passed 427ms
🟢 rich text editor › bolding exactly the required word passes the check 209ms
🟢 rich text editor › bold that spills into the previous word fails the check 218ms
🟢 tests/saved-addresses.e2e.ts · 3 passed 532ms
🟢 saved addresses › adds an address and clears the form 174ms
🟢 saved addresses › ignores an add with an empty field 177ms
🟢 saved addresses › delete shows its toast but keeps the address, on retry too (planted bug) 181ms
🟢 tests/shadow-dom-form.e2e.ts · 2 passed 532ms
🟢 shadow DOM form › rejects a wrong access code 268ms
🟢 shadow DOM form › grants access with the code from the hint inside the root 264ms
🟢 tests/smoke.e2e.ts · 1 passed 395ms
🟢 home lists the scenarios and opens one 395ms
🟢 tests/stale-dom.e2e.ts · 1 passed 2.1s
🟢 taps the moving target three times across rebuilds of the list 2.1s
🟢 tests/sticky-chrome.e2e.ts · 1 passed 169ms
🟢 accepts the terms once the button clears the sticky footer 169ms
🟢 tests/virtualized-table.e2e.ts · 1 passed 14.6s
🟢 scrolls the windowed table to the Golden Row and claims it 14.6s
🟢 tests/wishlist.e2e.ts · 2 passed 1.5s
🟢 wishlist › saving toggles the button and the tab badge 211ms
🟢 wishlist › the wishlist tab renders the empty state despite the badge count (planted bug) 1.3s

Tested by e2e 0.23.0 · 59.5s · web · run artifacts

@github-actions

github-actions Bot commented Nov 8, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e web agent: 33 passed

34 agent steps · 26 replayed from cache · 20 model calls · 87.7k tokens (94% cached) · $0.0035

All 33 tests in 5 files
Test Agent Time
🟢 tests-agent/control-inventory.e2e.ts · 7 passed 7 steps 7.0s
🟢 control inventory › check sets the checkbox and the radio 1 step 566ms
🟢 control inventory › check picks a radio the pick replaces with its summary 1 step 229ms
🟢 control inventory › a long press and a double click are chosen over a plain tap 1 step 834ms
🟢 control inventory › a right-click opens the file menu and Rename renames the file 1 step 2.4s
🟢 control inventory › upload attaches the named project files 1 step 2.4s
🟢 control inventory › back returns from the details view to the inventory 1 step 241ms
🟢 control inventory › scroll_to brings the footnote into view 1 step 325ms
🟢 tests-agent/login-form.e2e.ts · 1 passed 1 step 310ms
🟢 act signs in with the benchmark account 1 step 310ms
🟢 tests-agent/planted-bugs.e2e.ts · 3 passed 4 steps · 8 calls 12.4s
🟢 cart totals: a judgment catches the stale order summary 2 steps · 4 calls 6.2s
🟢 checkout review: a judgment catches the broken copy 1 step · 1 call 1.7s
🟢 wishlist: a judgment catches the lost saved items 1 step · 3 calls 4.4s
🟢 tests-agent/scenarios.e2e.ts · 21 passed 21 steps · 12 calls 1m 3s
🟢 act completes shadow-dom-form 1 step · 3 calls 3.8s
🟢 act completes lying-labels 1 step · 3 calls 4.7s
🟢 act completes iframe-form 1 step · 3 calls 3.8s
🟢 act completes infinite-scroll 1 step 3.2s
🟢 act completes virtualized-table 1 step 15.3s
🟢 act completes overlay-trap 1 step 829ms
🟢 act completes sticky-chrome 1 step 886ms
🟢 act completes async-states 1 step · 3 calls 7.2s
🟢 act completes debounced-search 1 step 2.2s
🟢 act completes hover-menu 1 step 450ms
🟢 act completes drag-and-drop 1 step 417ms
🟢 act completes kanban-board 1 step 564ms
🟢 act completes context-menu-trap 1 step 2.5s
🟢 act completes stale-dom 1 step 418ms
🟢 act completes otp-auto-advance 1 step 643ms
🟢 act completes date-picker 1 step 706ms
🟢 act completes rich-text-editor 1 step 10.0s
🟢 act completes playbook-cleanup 1 step 510ms
🟢 act completes promo-storefront 1 step 2.3s
🟢 act completes gift-card-purchase 1 step 2.4s
🟢 act filters the list and the URL carries the filter 1 step 189ms
🟢 tests-agent/unique-cache.e2e.ts · 1 passed 1 step 243ms
🟢 act adds an address with a run-unique label 1 step 243ms

Tested by e2e 0.23.0 · 1m 23s · web · run artifacts

@github-actions

github-actions Bot commented Nov 8, 2026 •

Copy link
Copy Markdown
Contributor

🟢 e2e ios agent: 21 passed, 1 skipped

25 agent steps · 12 replayed from cache · 58 model calls · 362.7k tokens (82% cached) · $0.0242

All 22 tests in 1 file
Test Agent Time
⏭️ tests-agent/scenarios.e2e.ts · 21 passed, 1 skipped 25 steps · 58 calls 8m 34s
🟢 act completes Login Form 1 step 47.2s
🟢 act completes Infinite Scroll List 1 step 26.3s
🟢 act completes Modal Flow 1 step 10.6s
🟢 act completes Bottom Tabs 1 step 7.9s
🟢 act completes Text Input Variations 1 step 14.1s
🟢 act completes Broken Accessibility 2 steps · 6 calls 26.5s
🟢 act completes Vision Only 2 steps · 6 calls 30.5s
🟢 act completes Gestures 1 step · 9 calls 40.4s
🟢 act completes Async States 1 step · 9 calls 32.4s
🟢 act completes Debounced Search 1 step · 1 call 27.9s
🟢 act completes Flattened Registration Form 2 steps · 1 call 30.2s
🟢 act completes Flattened Login 2 steps · 10 calls 55.3s
🟢 act completes Sticky Chrome Target 1 step 10.8s
🟢 act completes WebView Accessibility 1 step 12.6s
🟢 act completes Permission Prompt 1 step 12.1s
🟢 act completes Photo Picker 1 step · 2 calls 30.3s
🟢 act completes Product Catalog 1 step 10.1s
🟢 act completes Error Recovery 1 step 9.5s
🟢 act completes Choice Controls 1 step · 6 calls 35.8s
🟢 act completes Stripe PaymentSheet 1 step · 8 calls 32.3s
🟢 act completes Apple Pay 1 step 11.0s
⏭️ act completes Apple Pay Billing Address (skipped: the CI simulator's Apple Pay sheet skips the billing-address step, so the scenario cannot be completed there)

Tested by e2e 0.23.0 · 8m 35s · ios-simulator · run artifacts

@github-actions

github-actions Bot commented Nov 8, 2026

Copy link
Copy Markdown
Contributor

🟢 e2e android agent: 20 passed

24 agent steps · 15 replayed from cache · 49 model calls · 332.0k tokens (80% cached) · $0.0242

All 20 tests in 1 file
Test Agent Time
🟢 tests-agent/scenarios.e2e.ts · 20 passed 24 steps · 49 calls 5m 0s
🟢 act completes Login Form 1 step 20.6s
🟢 act completes Infinite Scroll List 1 step 19.0s
🟢 act completes Modal Flow 1 step 9.2s
🟢 act completes Bottom Tabs 1 step 6.4s
🟢 act completes Text Input Variations 1 step 6.1s
🟢 act completes Broken Accessibility 2 steps · 5 calls 13.2s
🟢 act completes Vision Only 2 steps · 1 call 5.9s
🟢 act completes Gestures 1 step · 7 calls 19.1s
🟢 act completes Async States 1 step · 24 calls 58.4s
🟢 act completes Debounced Search 1 step 6.3s
🟢 act completes Huge Virtualized List 1 step 47.3s
🟢 act completes Flattened Registration Form 2 steps · 1 call 7.3s
🟢 act completes Flattened Login 2 steps · 6 calls 16.1s
🟢 act completes Sticky Chrome Target 1 step 6.6s
🟢 act completes WebView Accessibility 1 step · 5 calls 18.2s
🟢 act completes Permission Prompt 1 step 6.3s
🟢 act completes Product Catalog 1 step 8.0s
🟢 act completes Error Recovery 1 step 8.5s
🟢 act completes Choice Controls 1 step 8.1s
🟢 act completes Sequential Onboarding 1 step 9.1s

Tested by e2e 0.23.0 · 5m 0s · android-emulator · run artifacts

@github-actions

github-actions Bot commented Nov 8, 2026

Copy link
Copy Markdown
Contributor

🟢 e2e android: 57 passed, 1 skipped

All 58 tests in 7 files
Test Time
⏭️ tests/controls.e2e.ts · 24 passed, 1 skipped 2m 23s
🟢 control inventory › a label query resolves a labeled text field 16.9s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 9.5s
🟢 control inventory › a placeholder query and attribute reads find the field 4.4s
🟢 control inventory › a secure field takes a fill and denies value reads 5.2s
🟢 control inventory › press sends a character and Enter through the soft keyboard 6.7s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 7.1s
🟢 control inventory › toBeFocused follows the focus 7.4s
🟢 control inventory › a switch checks, unchecks, and reports its state 7.7s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 6.3s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 9.6s
🟢 control inventory › a tab role answers getByRole 3.3s
🟢 control inventory › a radio group reports the checked option 7.0s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 6.3s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 5.9s
🟢 control inventory › a header answers its accessible name 3.3s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 5.0s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 5.0s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 6.6s
🟢 control inventory › a double tap lands inside the 300 ms window 6.1s
🟢 control inventory › an ambiguous locator fails at once 4.6s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 6.0s
🟢 refusals › verbs a device never declares are refused before the engine 2ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 1.7s
🟢 refusals › a missing locator fails as not found once its timeout passes 1.1s
🟢 tests/device-fixture.e2e.ts · 10 passed 1m 8s
🟢 device fixture › setOrientation rotates the window the app measures 4.8s
🟢 device fixture › home leaves the app, openApp brings it back where it was 3.7s
🟢 device fixture › foregroundApp sees the home screen after home() 3.7s
🟢 device fixture › closeApp then openApp relaunches on the home list 5.5s
🟢 device fixture › closeApp leaves the next commands on the same device 5.3s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 3.9s
🟢 device fixture › device.back pops the scenario 4.0s
🟢 device fixture › unstable_raw reaches the test session through agent-device 3.3s
🟢 device fixture › setNetwork and setAirplaneMode change what the app sees 14.6s
🟢 device fixture › setLocation and clearLocation change what the app reads 19.5s
🟢 tests/device.e2e.ts · 5 passed 35.5s
🟢 permission prompt › allowing the system dialog enables the microphone 4.8s
🟢 permission prompt › a denied prompt recovers once the permission is granted outside 10.7s
🟢 sequential onboarding echoes the exact values 9.1s
🟢 onboarding rejects a malformed email before advancing 4.9s
🟢 dismissing the keyboard over choice controls leaves them as they were 6.0s
🟢 tests/flows-lists.e2e.ts · 7 passed 1m 43s
🟢 infinite scroll reaches the target item 14.4s
🟢 product catalog adds exactly two of the right variant 8.0s
🟢 gestures: long-press, then swipe left 7.7s
🟢 gestures: double-tap completes the flow 8.4s
🟢 sticky chrome: accept below the fold, then continue 8.1s
🟢 async states: load, pull to refresh, claim through the toast 10.8s
🟢 huge virtualized list reaches row 512 45.8s
🟢 tests/flows.e2e.ts · 7 passed 46.0s
🟢 text inputs unlock the submit button 5.6s
🟢 filled text inputs report their values 4.9s
🟢 modal flow confirms through the native alert 8.2s
🟢 bottom tabs act inside the last tab 5.9s
🟢 error recovery retries, then confirms the delete 8.0s
🟢 choice controls place the exact order 5.2s
🟢 debounced search selects the target once results arrive 8.1s
🟢 tests/login-form.e2e.ts · 3 passed 25.4s
🟢 login form › rejects a malformed email 7.0s
🟢 login form › rejects an unknown account 6.6s
🟢 login form › signs in and logs out 11.8s
🟢 tests/smoke.e2e.ts · 1 passed 4.5s
🟢 home lists the scenarios and opens one 4.5s

Tested by e2e 0.23.0 · 7m 6s · android-emulator · run artifacts

@github-actions

github-actions Bot commented Nov 8, 2026

Copy link
Copy Markdown
Contributor

🟢 e2e ios: 55 passed, 1 skipped

All 56 tests in 7 files
Test Time
⏭️ tests/controls.e2e.ts · 23 passed, 1 skipped 3m 8s
🟢 control inventory › a label query resolves a labeled text field 14.6s
🟢 control inventory › a labeled field answers name, display value, value reads, fill, and clear 16.7s
🟢 control inventory › a placeholder query and attribute reads find the field 5.3s
🟢 control inventory › a secure field takes a fill and denies value reads 8.6s
🟢 control inventory › press sends a character and Enter through the soft keyboard 9.4s
🟢 control inventory › a field autofocuses on mount and focus() moves the focus 10.6s
🟢 control inventory › toBeFocused follows the focus 9.9s
🟢 control inventory › a switch checks, unchecks, and reports its state 9.8s
🟢 control inventory › checkbox and radio roles answer getByRole, and a checkbox toggles by tap 8.4s
🟢 control inventory › checkbox and radio roles check, uncheck, and report their state 13.7s
🟢 control inventory › a radio group reports the checked option 9.0s
🟢 control inventory › buttons report disabled, enabled, and a state that arrives later 8.0s
🟢 control inventory › a display: none element is absent rather than hidden, its visible twin attached 7.4s
🟢 control inventory › a header answers its accessible name 4.2s
🟢 control inventory › a tab row answers count, all, texts, filters, positions, and switching 6.1s
🟢 control inventory › a list answers counts, list-form text, reads, and boxes in order 6.7s
⏭️ control inventory › a row contains its texts (skipped: React Native flattens a plain View out of the accessibility tree on both platforms: XCTest and the Android helper report a View with a testID as a leaf beside its children, so filter({ has }) and a query scoped to it match nothing; only Sc…)
🟢 control inventory › a long press lands as one 8.2s
🟢 control inventory › pointer verbs land at the point asked for 9.8s
🟢 control inventory › an ambiguous locator fails at once 6.6s
🟢 control inventory › screenshot, restart, and clearState reopen the app on its home list 13.2s
🟢 refusals › verbs a device never declares are refused before the engine 2ms
🟢 refusals › keys the soft keyboard cannot send are refused by the engine 313ms
🟢 refusals › a missing locator fails as not found once its timeout passes 1.2s
🟢 tests/device-fixture.e2e.ts · 11 passed 1m 45s
🟢 device fixture › setAppearance flips the color scheme the app reads 17.3s
🟢 device fixture › setOrientation rotates the window the app measures 10.3s
🟢 device fixture › the clipboard reads back what was written 9.6s
🟢 device fixture › home leaves the app, openApp brings it back where it was 7.9s
🟢 device fixture › closeApp then openApp relaunches on the home list 8.1s
🟢 device fixture › closeApp leaves the next commands on the same device 14.1s
🟢 device fixture › foregroundApp after closeApp reports the closed session as APP_NOT_OPEN 5.8s
🟢 device fixture › device.back pops the scenario 6.4s
🟢 device fixture › unstable_raw reaches the test session through agent-device 4.5s
🟢 device fixture › setLocation and clearLocation change what the app reads 10.4s
🟢 device fixture › enrollBiometrics and setBiometrics answer a biometric prompt 10.6s
🟢 tests/device.e2e.ts · 3 passed 1m 7s
🟢 sequential onboarding echoes the exact values 41.1s
🟢 onboarding rejects a malformed email before advancing 13.6s
🟢 dismissing the keyboard over choice controls leaves them as they were 12.5s
🟢 tests/flows-lists.e2e.ts · 7 passed 3m 26s
🟢 infinite scroll reaches the target item 26.6s
🟢 product catalog adds exactly two of the right variant 10.8s
🟢 gestures: long-press, then swipe left 9.6s
🟢 sticky chrome: accept below the fold, then continue 11.3s
🟢 async states: load, pull to refresh, claim through the toast 12.6s
🟢 huge virtualized list reaches row 512 2m 3s
🟢 web view coupon form applies the code shown on the page 12.5s
🟢 tests/flows.e2e.ts · 7 passed 1m 15s
🟢 text inputs unlock the submit button 14.5s
🟢 filled text inputs report their values 11.3s
🟢 modal flow confirms through the native alert 10.6s
🟢 bottom tabs act inside the last tab 8.3s
🟢 error recovery retries, then confirms the delete 10.0s
🟢 choice controls place the exact order 8.5s
🟢 debounced search selects the target once results arrive 12.1s
🟢 tests/login-form.e2e.ts · 3 passed 51.4s
🟢 login form › rejects a malformed email 14.9s
🟢 login form › rejects an unknown account 14.8s
🟢 login form › signs in and logs out 21.7s
🟢 tests/smoke.e2e.ts · 1 passed 8.5s
🟢 home lists the scenarios and opens one 8.5s

Tested by e2e 0.23.0 · 6m 19s · ios-simulator · run artifacts

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

size:S Up to 29 changed lines, not counting tests, fixtures, translated docs, or the lockfile

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant