Skip to content

CI Reliability 2023-09-01 #652

New issue
New issue
Open
Open
CI Reliability 2023-09-01#652
@github-actions

Description

@github-actions
github-actions
bot
opened on Sep 1, 2023

Failures in node-test-pull-request/53575 to node-test-pull-request/53669 that failed 2 or more PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2023-09-01 00:13 2 0 24 0 74 0.00%

Jenkins Failure

Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 6 (nodejs/node#49327, nodejs/node#49150, nodejs/node#49155, nodejs/node#49275, nodejs/node#49161, nodejs/node#49312)
Appeared test-rackspace-win2019_vs2019-x64-2, test-digitalocean-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53608/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53663/
Example 
Build timed out (after 60 minutes). Marking the build as failed.

CCTest Failure

Reason Value of: (!expectation.read_expected)
Type CC_TEST_FAILURE
Failed PR 4 (nodejs/node#48919, nodejs/node#49185, nodejs/node#49150, nodejs/node#49413)
Appeared test-digitalocean-alpine315_container-x64-2, test-digitalocean-alpine318_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53594/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53660/
Example 
Value of: (!expectation.read_expected)
  Actual: true
Expected: false

[  FAILED  ] InspectorSocketTest.HostIPv6NonRoutable (5000 ms)

Build Failure

Reason Failed to trigger fanned build
Type BUILD_FAILURE
Failed PR 14 (nodejs/node#49341, nodejs/node#49155, nodejs/node#49335, nodejs/node#49320, nodejs/node#49274, nodejs/node#49348, nodejs/node#49346, nodejs/node#48919, nodejs/node#49239, nodejs/node#49161, nodejs/node#49185, nodejs/node#49150, nodejs/node#49238, nodejs/node#49340)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/53576/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53602/
Example 
Failed to trigger fanned build
Reason sh: line 0: printf: write error: No space left on device
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#49327, nodejs/node#49404, nodejs/node#49397, nodejs/node#49391)
Appeared test-nearform-macos10.15-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53608/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53654/
Example 
sh: line 0: printf: write error: No space left on device
Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#49185, nodejs/node#49220)
Appeared test-equinix-rhel8_container-arm64-2, test-equinix-ubuntu1804_container-arm64-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-4, test-equinix-ubuntu2004_container-armv7l-2, test-equinix_mnx-smartos20-x64-3, test-equinix-ubuntu2004_sharedlibs_container-arm64-3, test-osuosl-aix72-ppc64_be-2, test-osuosl-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53614/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53630/
Example 
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
Reason ERROR: Step �Publish JUnit test result report� failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#49150, nodejs/node#49275)
Appeared test-azure_msft-win2022_vs2019-x64-3, test-azure_msft-win11_vs2022-arm64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/53623/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53638/
Example 
ERROR: Step �Publish JUnit test result report� failed: no workspace for node-test-binary-windows-js-suites/RUN_SUBSET=3,nodes=win2022-COMPILED_BY-vs2019 #22796
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
Reason fatal error: /Library/Developer/CommandLineTools/usr/bin/libtool: can't write to output file (No space left on device)
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#49155, nodejs/node#49335)
Appeared test-nearform-macos10.15-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53636/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53662/
Example 
fatal error: /Library/Developer/CommandLineTools/usr/bin/libtool: can't write to output file (No space left on device)
Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#49220, nodejs/node#49400)
Appeared test-nearform-macos10.15-x64-1, test-digitalocean-alpine315_container-x64-2, test-digitalocean-alpine318_container-x64-2, test-rackspace-debian10-x64-1, test-rackspace-fedora32-x64-1, test-digitalocean-fedora38-x64-1, test-ibm-rhel8-x64-1, test-orka-macos11-x64-2, test-osuosl-rhel8-ppc64_le-3, test-digitalocean-ubi81_container-x64-1, test-macstadium-macos11.0-arm64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/53630/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53639/
Example 
fatal: No rebase in progress?

JSTest Failure

Reason node-api/test_threadsafe_function/test
Type JS_TEST_FAILURE
Failed PR 4 (nodejs/node#49185, nodejs/node#49341, nodejs/node#49401, nodejs/node#49400)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53605/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53639/
Example 
not ok 3793 node-api/test_threadsafe_function/test
  ---
  duration_ms: 360048.10300
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 4 (nodejs/node#49404, nodejs/node#48655, nodejs/node#49391, nodejs/node#49274)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-ibm-rhel8-s390x-1, test-ibm-rhel8-s390x-4, test-digitalocean-ubuntu1804-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53642/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53659/
Example 
not ok 200 parallel/test-blob-file-backed
  ---
  duration_ms: 458.42300
  severity: fail
  exitcode: 1
  stack: |-
    
    node:internal/per_context/domexception:53
        ErrorCaptureStackTrace(this);
        ^
    DOMException [NotReadableError]: The blob could not be read
        at new DOMException (node:internal/per_context/domexception:53:5)
        at __node_internal_ (node:internal/util:665:10)
        at BlobReader.<anonymous> (node:internal/blob:289:25)
    
    Node.js v21.0.0-pre
  ...
Reason sequential/test-http-regr-gh-2928
Type JS_TEST_FAILURE
Failed PR 4 (nodejs/node#49238, nodejs/node#49150, nodejs/node#49161, nodejs/node#49185)
Appeared test-digitalocean-freebsd12-x64-2, test-rackspace-win2012r2_vs2019-x64-1, test-digitalocean-freebsd12-x64-1, test-azure_msft-win2016_vs2017-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/53603/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53669/
Example 
not ok 3922 sequential/test-http-regr-gh-2928
  ---
  duration_ms: 120028.37300
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+....
Reason sequential/test-single-executable-application-snapshot-and-code-cache
Type JS_TEST_FAILURE
Failed PR 4 (nodejs/node#49155, nodejs/node#49274, nodejs/node#49400, nodejs/node#49401)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-2, test-equinix-ubuntu2004_container-arm64-2, test-rackspace-debian10-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53578/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53617/
Example 
not ok 3975 sequential/test-single-executable-application-snapshot-and-code-cache
  ---
  duration_ms: 10665.40800
  severity: fail
  exitcode: 1
  stack: |-
    warning: Can't find string offset for section name '.note'
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    + actual - expected
    
    + ''
    - 'Hello from snapshot'
        at Object.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test/sequential/test-single-executable-application-snapshot-and-code-cache.js:62:10)
        at Module._compile (node:internal/modules/cjs/loader:1241:14)
        at Module._extensions..js (node:internal/modules/cjs/loader:1295:10)
        at Module.load (node:internal/modules/cjs/loader:1091:32)
        at Module._load (node:internal/modules/cjs/loader:938:12)
        at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:83:12)
        at node:internal/main/run_main_mod...
Reason parallel/test-inspector-stop-profile-after-done
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#49346, nodejs/node#49150, nodejs/node#49413)
Appeared test-ibm-rhel8-s390x-1, test-ibm-rhel8-s390x-4, test-ibm-rhel8-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/53590/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53660/
Example 
not ok 2714 parallel/test-inspector-stop-profile-after-done
  ---
  duration_ms: 120141.84000
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:42127/b5a2a44f-a1e3-414e-a5e9-ee998bc23cf3
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
  ...
Reason parallel/test-runner-watch-mode
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#49401, nodejs/node#49155, nodejs/node#49340)
Appeared test-osuosl-ubuntu2004_container-armv7l-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53617/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53665/
Example 
not ok 2825 parallel/test-runner-watch-mode
  ---
  duration_ms: 360047.37200
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    Updating /home/iojs/tmp/.tmp.2346/dependent.js
    # Subtest: test runner watch mode
        # Subtest: should run tests repeatedly
        ok 1 - should run tests repeatedly
          ---
          duration_ms: 1287.004742
          ...
Reason sequential/test-cli-syntax-require
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#49238, nodejs/node#49274, nodejs/node#49150)
Appeared test-osuosl-aix72-ppc64_be-3, test-ibm-aix72-ppc64_be-2, test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53577/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53658/
Example 
not ok 3887 sequential/test-cli-syntax-require
  ---
  duration_ms: 494.27400
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:1026
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: The input did not match the regular expression /^SyntaxError: \b/m. Input:
    
    ''
    
        at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-aix/nodes/aix72-ppc64/test/sequential/test-cli-syntax-require.js:34:14)
        at ChildProcess.<anonymous> (/home/iojs/build/workspace/node-test-commit-aix/nodes/aix72-ppc64/test/common/index.js:474:15)
        at ChildProcess.emit (node:events:514:28)
        at ChildProcess._handle.onexit (node:internal/child_process:294:12) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: '',
      expected: /^SyntaxError: \b/m,
      operator: 'match'
    }
    
    Node.js v21.0.0-pre
  ...
Reason sequential/test-worker-prof
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#49346, nodejs/node#49161, nodejs/node#49404)
Appeared test-azure_msft-win2022_vs2019-x64-3, test-rackspace-win2022_vs2022-x64-3, test-macstadium-macos11.0-arm64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/53590/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53635/
Example 
not ok 940 sequential/test-worker-prof
  ---
  duration_ms: 30264.37200
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: child exited with signal: {
      error: Error: spawnSync C:\workspace\node-test-binary-windows-js-suites\node\Release\node.exe ETIMEDOUT
          at Object.spawnSync (node:internal/child_process:1124:20)
          at spawnSync (node:child_process:876:24)
          at Object.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-worker-prof.js:52:23)
          at Module._compile (node:internal/modules/cjs/loader:1241:14)
          at Module._extensions..js (node:internal/modules/cjs/loader:1295:10)
          at Module.load (node:internal/modules/cjs/loader:1091:32)
          at Module._load (node:internal/modules/cjs/loader:938:12)
          at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:83:12)
          at node:internal/main/ru...
Reason parallel/test-fs-watch-recursive-symlink
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#49274, nodejs/node#49335)
Appeared test-ibm-rhel8-s390x-2, test-ibm-rhel8-s390x-4
First CI https://ci.nodejs.org/job/node-test-pull-request/53584/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53662/
Example 
not ok 1359 parallel/test-fs-watch-recursive-symlink
  ---
  duration_ms: 120041.05100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason parallel/test-http-remove-connection-header-persists-connection
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#49275, nodejs/node#49274)
Appeared test-ibm-rhel8-s390x-3, test-ibm-rhel8-s390x-1, test-ibm-rhel8-s390x-4
First CI https://ci.nodejs.org/job/node-test-pull-request/53634/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53655/
Example 
not ok 1271 parallel/test-http-remove-connection-header-persists-connection
  ---
  duration_ms: 477.53200
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at /home/iojs/build/workspace/node-test-commit-linuxone/test/parallel/test-http-remove-connection-header-persists-connection.js:67:16
        at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-linuxone/test/parallel/test-http-remove-connection-header-persists-connection.js:54:7)
        at listOnTimeout (node:internal/timers:573:17)
        at process.processTimers (node:internal/timers:514:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v21.0.0-pre
  ...
Reason pummel/test-heapdump-shadow-realm
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#49185, nodejs/node#49397)
Appeared test-rackspace-debian10-x64-1, test-softlayer-debian10-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/53605/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53646/
Example 
not ok 3616 pummel/test-heapdump-shadow-realm
  ---
  duration_ms: 50765.08400
  severity: crashed
  exitcode: -6
  stack: |-
    
    <--- Last few GCs --->
    
    [14959:0x561503e4bbb0]    48729 ms: Mark-Compact (reduce) 996.0 (1012.6) -> 995.2 (1012.9) MB, 1033.82 / 0.01 ms  (+ 159.2 ms in 42 steps since start of marking, biggest step 18.3 ms, walltime since start of marking 1386 ms) (average mu = 0.315, current m[14959:0x561503e4bbb0]    50369 ms: Mark-Compact (reduce) 996.1 (1012.9) -> 995.8 (1013.4) MB, 1322.75 / 0.01 ms  (+ 62.9 ms in 10 steps since start of marking, biggest step 13.3 ms, walltime since start of marking 1397 ms) (average mu = 0.243, current mu
    
    <--- JS stacktrace --->
    
    FATAL ERROR: Reached heap limit Allocation failed - JavaScript heap out of memory
     1: 0x5614fe8904d0 node::Abort() [out/Release/node]
     2: 0x5614fe76b515  [out/Release/node]
     3: 0x5614feaccfb0 v8::Utils::ReportOOMFailure(v8::internal::Isolate*, char const*, v8::OOMDetails const&) [out/Release...
Reason sequential/test-perf-hooks
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#49346, nodejs/node#49161)
Appeared test-azure_msft-win11_vs2022-arm64-6, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/53590/
Last CI https://ci.nodejs.org/job/node-test-pull-request/53667/
Example 
not ok 932 sequential/test-perf-hooks
  ---
  duration_ms: 229.23600
  severity: fail
  exitcode: 1
  stack: |-
    check initial nodeTiming
    {
      "name": "node",
      "entryType": "node",
      "startTime": 0,
      "duration": 147.57630002498627,
      "nodeStart": 0.7022000551223755,
      "v8Start": 5.008900046348572,
      "environment": 19.22030007839203,
      "loopStart": -1,
      "loopExit": -1,
      "bootstrapComplete": 73.78420007228851,
      "idleTime": 0
    }
    node:assert:399
        throw err;
        ^
    
    AssertionError [ERR_ASSERTION]: now (160.24030005931854) - timing.duration (147.57630002498627) = 12.664000034332275 >= 10
        at checkNodeTiming (d:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-perf-hooks.js:104:3)
        at Object.<anonymous> (d:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-perf-hooks.js:119:1)
        at Module._compile (node:internal/modules/cjs/loader:1241:14)
        at Module._extensions..js (n...

Progress

  • Build timed out (after 60 minutes). Marking the build as failed. (6)
  • Value of: (!expectation.read_expected) (4)
  • Failed to trigger fanned build (14)
  • sh: line 0: printf: write error: No space left on device (4)
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? (2)
  • ERROR: Step �Publish JUnit test result report� failed: no workspace for ... (2)
  • fatal error: /Library/Developer/CommandLineTools/usr/bin/libtool: can't write to output file (No space left on device) (2)
  • fatal: No rebase in progress? (2)
  • node-api/test_threadsafe_function/test (4)
  • parallel/test-blob-file-backed (4)
  • sequential/test-http-regr-gh-2928 (4)
  • sequential/test-single-executable-application-snapshot-and-code-cache (4)
  • parallel/test-inspector-stop-profile-after-done (3)
  • parallel/test-runner-watch-mode (3)
  • sequential/test-cli-syntax-require (3)
  • sequential/test-worker-prof (3)
  • parallel/test-fs-watch-recursive-symlink (2)
  • parallel/test-http-remove-connection-header-persists-connection (2)
  • pummel/test-heapdump-shadow-realm (2)
  • sequential/test-perf-hooks (2)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions