pkg/dartdev/test/commands/info_macos_test failing on unittest-asserts-release-mac-arm64 due to unexpected process information

[sstrickl]

There are new test failures on [pkg/vm] Update test/transformations/type_flow/transformer_test expects..

The tests

pkg/dartdev/test/commands/info_macos_test RuntimeError (expected Pass)

are failing on configurations

unittest-asserts-release-mac-arm64

Log:

--- Command "vm" (took 02.000100s):
DART_CONFIGURATION=ReleaseARM64 CHROME_PATH="/opt/s/w/ir/cache/builder/sdk/third_party/browsers/chrome/Google Chrome.app/Contents/MacOS/Google Chrome" xcodebuild/ReleaseARM64/dart-sdk/bin/dart --enable_asserts --sound-null-safety -Dtest_runner.configuration=unittest-asserts-release-mac-arm64 --ignore-unrecognized-flags --packages=/opt/s/w/ir/cache/builder/sdk/.dart_tool/package_config.json /opt/s/w/ir/cache/builder/sdk/pkg/dartdev/test/commands/info_macos_test.dart

exit code:
255

stdout:
00:00 �[32m+0�[0m: process listing macos�[0m

00:00 �[32m+0�[0m�[31m -1�[0m: process listing macos �[1m�[31m[E]�[0m�[0m

  Expected: a string starting with 'dart'
    Actual: 'analysis_server.dart.snapshot --suppress-analytics --client-id=dart-fix --disable-server-feature-completion --disable-server-feature-search --sdk <path>/dart-sdk'
  

  package:matcher/src/expect/expect.dart 149:31        fail
  package:matcher/src/expect/expect.dart 144:3         _expect
  package:matcher/src/expect/expect.dart 56:3          expect
  pkg/dartdev/test/commands/info_macos_test.dart 24:9  main.<fn>.<fn>
  package:test_api/src/backend/declarer.dart 215:19    Declarer.test.<fn>.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/declarer.dart 213:7     Declarer.test.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/invoker.dart 258:9      Invoker._waitForOutstandingCallbacks.<fn>
  

00:00 �[32m+0�[0m�[31m -1�[0m: process listing parseMacos�[0m

00:00 �[32m+1�[0m�[31m -1�[0m: info macos shows process info�[0m

00:00 �[32m+2�[0m�[31m -1�[0m: �[31mSome tests failed.�[0m



Consider enabling the flag chain-stack-traces to receive more detailed exceptions.
For example, 'dart test --chain-stack-traces'.

stderr:
Unhandled exception:
Dummy exception to set exit code.

--- Re-run this test:
python3 tools/test.py -n unittest-asserts-release-mac-arm64 pkg/dartdev/test/commands/info_macos_test

I can't get this to happen on my local ARM64 Mac laptop, so it might be something specific to the bots that needs to be accounted for in the test?

/cc @devoncarew

[alexmarkov]

Failed once again: https://dart-ci.appspot.com/log/pkg-mac-release-arm64/unittest-asserts-release-mac-arm64/8452/pkg/dartdev/test/commands/info_macos_test

/cc @helin24 @bkonyi

[dcharkes]

https://dart-ci.web.app/#showLatestFailures=false&test=pkg/dartdev/test/commands/info_macos_test&configurations=unittest-asserts-release-mac-arm64

This test is showing up every time as a failure again (meta flaking).

[helin24]

@devoncarew I think you were considering making this test more contained or mocking out some parts of it. Are you still planning to submit a change for this?

[devoncarew]

Yes, I landed a change here, but it may not have addressed the issue. I'll circle back to this.

[devoncarew]

From the CI:

stdout:
00:00 �[32m+0�[0m: process listing macos�[0m

00:00 �[32m+0�[0m�[31m -1�[0m: process listing macos �[1m�[31m[E]�[0m�[0m

  Expected: a string starting with 'dart'
    Actual: 'analysis_server.dart.snapshot --suppress-analytics --client-id=dart-fix --disable-server-feature-completion --disable-server-feature-search --sdk <path>/dart-sdk'
  

  package:matcher/src/expect/expect.dart 149:31        fail
  package:matcher/src/expect/expect.dart 144:3         _expect
  package:matcher/src/expect/expect.dart 56:3          expect
  pkg/dartdev/test/commands/info_macos_test.dart 24:9  main.<fn>.<fn>
  package:test_api/src/backend/declarer.dart 215:19    Declarer.test.<fn>.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/declarer.dart 213:7     Declarer.test.<fn>
  ===== asynchronous gap ===========================
  package:test_api/src/backend/invoker.dart 258:9      Invoker._waitForOutstandingCallbacks.<fn>
  

00:00 �[32m+0�[0m�[31m -1�[0m: process listing parseMacos�[0m

00:00 �[32m+1�[0m�[31m -1�[0m: info macos shows process info�[0m

00:00 �[32m+2�[0m�[31m -1�[0m: �[31mSome tests failed.�[0m

[aam]

Failed again https://logs.chromium.org/logs/dart/buildbucket/cr-buildbucket/8776288900501885041/+/u/test_results/new_test_failures__logs

[bkonyi]

I think this is resolved.