Skip to content

CI Reliability 2022-07-23 #329

New issue
New issue
Open
Open
CI Reliability 2022-07-23#329
@github-actions

Description

@github-actions
github-actions
bot
opened on Jul 23, 2022

Failures in node-test-pull-request/45504 to node-test-pull-request/45598 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-07-23 00:16 1 8 26 3 62 8.33%

Jenkins Failure

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 10 (nodejs/node#43870, nodejs/node#43883, nodejs/node#43010, nodejs/node#43806, nodejs/node#43881, nodejs/node#43892, nodejs/node#43824, nodejs/node#43885, nodejs/node#38905, nodejs/node#43922)
Appeared test-digitalocean-freebsd12-x64-2, test-orka-macos10.15-x64-2, test-rackspace-win2012r2_vs2019-x64-3, test-equinix-ubuntu2004_container-armv7l-2, test-nearform-macos11.0-arm64-1, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45504/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45584/
Example 
java.io.IOException: Backing channel 'JNLP4-connect connection from 107.170.28.213/107.170.28.213:25817' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
	at com.sun.proxy.$Proxy79.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205)
Reason Build timed out (after 15 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (nodejs/node#38905, nodejs/node#43826)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/45531/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45549/
Example 
Build timed out (after 15 minutes). Marking the build as failed.

Build Failure

Reason ERROR: Build step failed with exception
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#43886, nodejs/node#43919, nodejs/node#38905, nodejs/node#43912)
Appeared test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45516/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45575/
Example 
ERROR: Build step failed with exception
java.lang.NullPointerException: no workspace from node hudson.slaves.DumbSlave[test-equinix-ubuntu2004_container-armv7l-2] which is computer hudson.slaves.SlaveComputer@2ad6001 and has channel null
	at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:113)
	at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:91)
	at org.jenkinsci.plugins.postbuildscript.processor.Processor.processBuildSteps(Processor.java:180)
	at org.jenkinsci.plugins.postbuildscript.processor.Processor.processScripts(Processor.java:91)
Reason ERROR: Step ?Publish JUnit test result report? failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#43884, nodejs/node#43886, nodejs/node#43802, nodejs/node#43919)
Appeared test-equinix-ubuntu2004_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45506/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45577/
Example 
ERROR: Step ?Publish JUnit test result report? failed: no workspace for node-test-commit-arm/nodes=ubuntu2004-armv7l #42864
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 3 (nodejs/node#43889, nodejs/node#43086, nodejs/node#43903)
Appeared test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2, test-equinix-debian10_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45538/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45598/
Example 
ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
[PostBuildScript] - [INFO] Executing post build scripts.
[node-test-binary-armv7l] $ /bin/bash -ex /tmp/jenkins611241727256395923.sh
+ '[' -d .git ']'
+ git clean -fdx

undefined

Reason Unknown
Type undefined
Failed PR 26 (nodejs/node#43870, nodejs/node#43883, nodejs/node#43010, nodejs/node#43879, nodejs/node#43886, nodejs/node#43806, nodejs/node#43881, nodejs/node#43890, nodejs/node#43875, nodejs/node#43802, nodejs/node#43892, nodejs/node#43889, nodejs/node#43824, nodejs/node#43826, nodejs/node#43891, nodejs/node#43858, nodejs/node#42256, nodejs/node#43919, nodejs/node#38905, nodejs/node#43912, nodejs/node#43922, nodejs/node#43933, nodejs/node#43902, nodejs/node#43086, nodejs/node#43747, nodejs/node#43903)
Appeared test-equinix-debian10_container-armv7l-1, test-nearform_arm-win10_vs2019-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45504/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45598/
Example 
Unknown

JSTest Failure

Reason pummel/test-http-upload-timeout
Type JS_TEST_FAILURE
Failed PR 19 (nodejs/node#43881, nodejs/node#43714, nodejs/node#43747, nodejs/node#43886, nodejs/node#43806, nodejs/node#43883, nodejs/node#43891, nodejs/node#43889, nodejs/node#43885, nodejs/node#43896, nodejs/node#43826, nodejs/node#43802, nodejs/node#43858, nodejs/node#43741, nodejs/node#38905, nodejs/node#43919, nodejs/node#43917, nodejs/node#43903, nodejs/node#43933)
Appeared test-equinix-ubuntu2004_container-arm64-2, test-softlayer-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8, test-digitalocean-fedora34-x64-1, test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-1, test-rackspace-debian10-x64-1, test-ibm-rhel8-s390x-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-3, test-equinix-ubuntu1804_sharedlibs_container-arm64-3, test-equinix-ubuntu1804_container-arm64-2, test-nearform-macos11.0-arm64-1, test-orka-macos10.15-x64-2, test-softlayer-ubi81_container-x64-1, test-digitalocean-alpine311_container-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-4, test-macstadium-macos11.0-arm64-3, test-softlayer-alpine311_container-x64-1, test-softlayer-ubuntu1804_sharedlibs_container-x64-2, test-rackspace-fedora32-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-5, test-rackspace-win2012r2_vs2015-x64-2, test-orka-macos11-x64-2, test-equinix-debian10_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45510/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45587/
Example 
not ok 3330 pummel/test-http-upload-timeout
  ---
  duration_ms: 5.726
  severity: fail
  exitcode: 1
  stack: |-
    /home/iojs/build/workspace/node-test-commit-arm/test/pummel/test-http-upload-timeout.js:34
        throw new Error('Unexpected timeout');
        ^
    
    Error: Unexpected timeout
        at Socket.<anonymous> (/home/iojs/build/workspace/node-test-commit-arm/test/pummel/test-http-upload-timeout.js:34:11)
        at Socket.emit (node:events:525:35)
        at Socket._onTimeout (node:net:522:8)
        at listOnTimeout (node:internal/timers:564:17)
        at process.processTimers (node:internal/timers:507:7)
    
    Node.js v19.0.0-pre
  ...
Reason sequential/test-gc-http-client
Type JS_TEST_FAILURE
Failed PR 7 (nodejs/node#43879, nodejs/node#43890, nodejs/node#43826, nodejs/node#43891, nodejs/node#43858, nodejs/node#38905, nodejs/node#43010)
Appeared test-equinix-ubuntu2004_container-armv7l-1, test-equinix-rhel8_container-arm64-1, test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45513/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45581/
Example 
not ok 3646 sequential/test-gc-http-client
  ---
  duration_ms: 1.517
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 160/0/640
    done/collected/total: 320/160/640
    done/collected/total: 365/256/640
    done/collected/total: 636/320/640
    done/collected/total: 640/365/640
    done/collected/total: 640/636/640
    done/collected/total: 640/640/640
    node:_http_server:493
        if (connections[i].socket._httpMessage && !connections[i].socket._httpMessage.finished) {
                                  ^
    
    TypeError: Cannot read properties of null (reading '_httpMessage')
        at Server.closeIdleConnections (node:_http_server:493:31)
        at Server.close (node:_http_server:476:8)
        at Immediate.status (/home/iojs/build/workspace/node-test-commit-arm/test/sequential/test-gc-http-client.js:60:14)
        at process.processImmediate (node:internal/timers:471:21)
    
    Node.js v19.0.0-pre
  ...
Reason sequential/test-gc-http-client-onerror
Type JS_TEST_FAILURE
Failed PR 7 (nodejs/node#43870, nodejs/node#43883, nodejs/node#43881, nodejs/node#43891, nodejs/node#43858, nodejs/node#43922, nodejs/node#43902)
Appeared test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu1804_container-arm64-2, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45504/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45589/
Example 
not ok 3429 sequential/test-gc-http-client-onerror
  ---
  duration_ms: 1.623
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 160/0/640
    done/collected/total: 314/160/640
    done/collected/total: 480/256/640
    done/collected/total: 630/314/640
    done/collected/total: 640/480/640
    done/collected/total: 640/630/640
    done/collected/total: 640/640/640
    node:_http_server:493
        if (connections[i].socket._httpMessage && !connections[i].socket._httpMessage.finished) {
                                  ^
    
    TypeError: Cannot read properties of null (reading '_httpMessage')
        at Server.closeIdleConnections (node:_http_server:493:31)
        at Server.close (node:_http_server:476:8)
        at Immediate.status (/home/iojs/build/workspace/node-test-binary-armv7l/test/sequential/test-gc-http-client-onerror.js:65:14)
        at process.processImmediate (node:internal/timers:471:21)
    
    Node.js v19.0.0-pre
  ...
Reason parallel/test-worker-heap-snapshot
Type JS_TEST_FAILURE
Failed PR 6 (nodejs/node#43892, nodejs/node#43889, nodejs/node#43890, nodejs/node#43922, nodejs/node#43933, nodejs/node#43902)
Appeared test-rackspace-win2012r2_vs2013-x64-1, test-rackspace-win2012r2_vs2019-x64-3, test-rackspace-win2012r2_vs2017-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45536/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45589/
Example 
not ok 790 parallel/test-worker-heap-snapshot
  ---
  duration_ms: 1.437
  severity: fail
  exitcode: 134
  stack: |-
    FATAL ERROR: HandleScope::HandleScope Entering the V8 API without proper locking in place
  ...
Reason parallel/test-heapsnapshot-near-heap-limit-worker
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#43824, nodejs/node#43826, nodejs/node#42256)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-equinix-debian10_container-armv7l-2, test-rackspace-win2012r2_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45542/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45567/
Example 
not ok 1391 parallel/test-heapsnapshot-near-heap-limit-worker
  ---
  duration_ms: 3.159
  severity: fail
  exitcode: 1
  stack: |-
    
    Invoked NearHeapLimitCallback, processing=false, current_limit=52428800, initial_limit=52428800
    max_young_gen_size=25165824, young_gen_size=0, old_gen_size=51703208, total_size=51703208
    Estimated available memory=4200755200, estimated overhead=25165824
    Start generating Heap.20220720.185111.1206468.1.001.heapsnapshot...
    Wrote snapshot to /home/iojs/tmp/.tmp.1135/Heap.20220720.185111.1206468.1.001.heapsnapshot
    
    <--- Last few GCs --->
    
    [1206468:0xf4a00708]     1491 ms: Mark-sweep (reduce) 49.2 (52.8) -> 49.2 (52.8) MB, 14.9 / 0.0 ms  (average mu = 0.216, current mu = -0.233) heap profiler; GC in old space requested
    
    
    <--- JS stacktrace --->
    
    FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
    
    node:assert:400
        throw err;
        ^
    
    AssertionError [...
Reason parallel/test-vm-break-on-sigint
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#43891, nodejs/node#43890, nodejs/node#43903)
Appeared test-digitalocean-ubi81_container-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-2, test-softlayer-ubi81_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-9, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/45524/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45585/
Example 
not ok 3012 parallel/test-vm-break-on-sigint
  ---
  duration_ms: 120.157
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason sequential/test-gc-http-client-timeout
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#43822, nodejs/node#43863, nodejs/node#43010)
Appeared test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45518/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45581/
Example 
not ok 3616 sequential/test-gc-http-client-timeout
  ---
  duration_ms: 0.599
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 9/0/485
    done/collected/total: 41/9/485
    done/collected/total: 87/41/485
    done/collected/total: 136/87/485
    node:events:491
          throw er; // Unhandled 'error' event
          ^
    
    Error: connect ECONNRESET ::1:62627
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1242:16)
    Emitted 'error' event on ClientRequest instance at:
        at Socket.socketErrorListener (node:_http_client:475:9)
        at Socket.emit (node:events:513:28)
        at emitErrorNT (node:internal/streams/destroy:151:8)
        at emitErrorCloseNT (node:internal/streams/destroy:116:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
      errno: -54,
      code: 'ECONNRESET',
      syscall: 'connect',
      address: '::1',
      port: 62627
    }
    
    Node.js v19.0.0-pre
  ...
Reason parallel/test-fs-write-stream-file-handle
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43822, nodejs/node#43802)
Appeared test-rackspace-win2012r2_vs2017-x64-4, test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45518/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45533/
Example 
not ok 290 parallel/test-fs-write-stream-file-handle
  ---
  duration_ms: 0.869
  severity: fail
  exitcode: 1
  stack: |-
    Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.282
    Files blocking: [ 'write_stream_filehandle_test.txt' ]
    
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    + actual - expected
    
    + ''
    - 'hello world'
        at WriteStream.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-fs-write-stream-file-handle.js:19:12)
        at WriteStream.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:438:15)
        at WriteStream.emit (node:events:513:28)
        at emitCloseNT (node:internal/streams/destroy:132:10)
        at process.processTicksAndRejections (node:internal/process/task_queues:81:21) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: '',
   ...
Reason parallel/test-worker-fshandles-open-close-on-termination
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43010, nodejs/node#43826)
Appeared test-joyent-smartos20-x64-4, test-rackspace-win2012r2_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45508/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45545/
Example 
not ok 2986 parallel/test-worker-fshandles-open-close-on-termination
  ---
  duration_ms: 1.490
  severity: crashed
  exitcode: -5
  stack: |-
    
    #
    # Fatal process OOM in NewArray
    #
    
  ...

Progress

  • Backing channel 'JNLP4-connect connection from ... is disconnected. (10)
  • Build timed out (after 15 minutes). Marking the build as failed. (2)
  • ERROR: Build step failed with exception (4)
  • ERROR: Step ?Publish JUnit test result report? failed: no workspace for ... (4)
  • ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? (3)
  • Unknown (26)
  • pummel/test-http-upload-timeout (19)
  • sequential/test-gc-http-client (7)
  • sequential/test-gc-http-client-onerror (7)
  • parallel/test-worker-heap-snapshot (6)
  • parallel/test-heapsnapshot-near-heap-limit-worker (3)
  • parallel/test-vm-break-on-sigint (3)
  • sequential/test-gc-http-client-timeout (3)
  • parallel/test-fs-write-stream-file-handle (2)
  • parallel/test-worker-fshandles-open-close-on-termination (2)

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions