Skip to content

CI Reliability 2022-07-22 #328

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom
Open
15 tasks
github-actions bot opened this issue Jul 22, 2022 · 0 comments
Open
15 tasks

CI Reliability 2022-07-22 #328

github-actions bot opened this issue Jul 22, 2022 · 0 comments

Comments

@github-actions
Copy link

Failures in node-test-pull-request/45483 to node-test-pull-request/45582 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-07-22 00:17 0 6 28 2 64 6.12%

JSTest Failure

Reason pummel/test-http-upload-timeout
Type JS_TEST_FAILURE
Failed PR 23 (nodejs/node#43554, nodejs/node#43877, nodejs/node#43010, nodejs/node#43870, nodejs/node#43880, nodejs/node#43881, nodejs/node#43714, nodejs/node#43747, nodejs/node#43886, nodejs/node#43806, nodejs/node#43883, nodejs/node#43891, nodejs/node#43889, nodejs/node#43885, nodejs/node#43896, nodejs/node#43826, nodejs/node#43802, nodejs/node#43858, nodejs/node#43741, nodejs/node#43903, nodejs/node#38905, nodejs/node#43919, nodejs/node#43917)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-8, test-digitalocean-fedora34-x64-1, test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-1, test-rackspace-debian10-x64-1, test-ibm-rhel8-s390x-4, test-softlayer-ubuntu1804_sharedlibs_container-x64-3, test-equinix-ubuntu1804_sharedlibs_container-arm64-3, test-equinix-ubuntu1804_container-arm64-2, test-nearform-macos11.0-arm64-1, test-orka-macos10.15-x64-2, test-softlayer-ubi81_container-x64-1, test-digitalocean-alpine311_container-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-4, test-macstadium-macos11.0-arm64-3, test-softlayer-alpine311_container-x64-1, test-softlayer-ubuntu1804_sharedlibs_container-x64-2, test-rackspace-fedora32-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-5, test-rackspace-win2012r2_vs2015-x64-2, test-orka-macos11-x64-2, test-equinix-debian10_container-armv7l-2, test-digitalocean-fedora32-x64-1, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45486/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45573/
Example 
not ok 3331 pummel/test-http-upload-timeout
  ---
  duration_ms: 5.620
  severity: fail
  exitcode: 1
  stack: |-
    /home/iojs/build/workspace/node-test-commit-linux-containered/test/pummel/test-http-upload-timeout.js:34
        throw new Error('Unexpected timeout');
        ^
    
    Error: Unexpected timeout
        at Socket.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test/pummel/test-http-upload-timeout.js:34:11)
        at Socket.emit (node:events:525:35)
        at Socket._onTimeout (node:net:522:8)
        at listOnTimeout (node:internal/timers:564:17)
        at process.processTimers (node:internal/timers:507:7)
    
    Node.js v19.0.0-pre
  ...
Reason sequential/test-gc-http-client
Type JS_TEST_FAILURE
Failed PR 9 (nodejs/node#43763, nodejs/node#43880, nodejs/node#43879, nodejs/node#43890, nodejs/node#43826, nodejs/node#43891, nodejs/node#43858, nodejs/node#38905, nodejs/node#43010)
Appeared test-equinix-ubuntu2004_container-armv7l-1, test-equinix-rhel8_container-arm64-1, test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45483/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45581/
Example 
not ok 3646 sequential/test-gc-http-client
  ---
  duration_ms: 1.517
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 160/0/640
    done/collected/total: 320/160/640
    done/collected/total: 365/256/640
    done/collected/total: 636/320/640
    done/collected/total: 640/365/640
    done/collected/total: 640/636/640
    done/collected/total: 640/640/640
    node:_http_server:493
        if (connections[i].socket._httpMessage && !connections[i].socket._httpMessage.finished) {
                                  ^
    
    TypeError: Cannot read properties of null (reading '_httpMessage')
        at Server.closeIdleConnections (node:_http_server:493:31)
        at Server.close (node:_http_server:476:8)
        at Immediate.status (/home/iojs/build/workspace/node-test-commit-arm/test/sequential/test-gc-http-client.js:60:14)
        at process.processImmediate (node:internal/timers:471:21)
    
    Node.js v19.0.0-pre
  ...
Reason sequential/test-gc-http-client-onerror
Type JS_TEST_FAILURE
Failed PR 6 (nodejs/node#43873, nodejs/node#43870, nodejs/node#43883, nodejs/node#43881, nodejs/node#43891, nodejs/node#43858)
Appeared test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu1804_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45490/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45559/
Example 
not ok 3426 sequential/test-gc-http-client-onerror
  ---
  duration_ms: 1.516
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 160/0/640
    done/collected/total: 320/160/640
    done/collected/total: 480/256/640
    done/collected/total: 629/320/640
    done/collected/total: 640/480/640
    done/collected/total: 640/629/640
    done/collected/total: 640/640/640
    node:_http_server:493
        connections[i].socket.destroy();
                              ^
    
    TypeError: Cannot read properties of null (reading 'destroy')
        at Server.closeIdleConnections (node:_http_server:493:27)
        at Server.close (node:_http_server:476:8)
        at Immediate.status (/home/iojs/build/workspace/node-test-binary-armv7l/test/sequential/test-gc-http-client-onerror.js:65:14)
        at process.processImmediate (node:internal/timers:471:21)
    
    Node.js v19.0.0-pre
  ...
Reason parallel/test-heapsnapshot-near-heap-limit-worker
Type JS_TEST_FAILURE
Failed PR 4 (nodejs/node#43863, nodejs/node#43824, nodejs/node#43826, nodejs/node#42256)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-equinix-debian10_container-armv7l-2, test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/45485/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45567/
Example 
not ok 1391 parallel/test-heapsnapshot-near-heap-limit-worker
  ---
  duration_ms: 3.159
  severity: fail
  exitcode: 1
  stack: |-
    
    Invoked NearHeapLimitCallback, processing=false, current_limit=52428800, initial_limit=52428800
    max_young_gen_size=25165824, young_gen_size=0, old_gen_size=51703208, total_size=51703208
    Estimated available memory=4200755200, estimated overhead=25165824
    Start generating Heap.20220720.185111.1206468.1.001.heapsnapshot...
    Wrote snapshot to /home/iojs/tmp/.tmp.1135/Heap.20220720.185111.1206468.1.001.heapsnapshot
    
    <--- Last few GCs --->
    
    [1206468:0xf4a00708]     1491 ms: Mark-sweep (reduce) 49.2 (52.8) -> 49.2 (52.8) MB, 14.9 / 0.0 ms  (average mu = 0.216, current mu = -0.233) heap profiler; GC in old space requested
    
    
    <--- JS stacktrace --->
    
    FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
    
    node:assert:400
        throw err;
        ^
    
    AssertionError [...
Reason parallel/test-worker-heap-snapshot
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#43892, nodejs/node#43889, nodejs/node#43890)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45536/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45543/
Example 
not ok 3018 parallel/test-worker-heap-snapshot
  ---
  duration_ms: 0.815
  severity: crashed
  exitcode: -11
  stack: |-
  ...
Reason sequential/test-gc-http-client-timeout
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#43822, nodejs/node#43863, nodejs/node#43010)
Appeared test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45518/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45581/
Example 
not ok 3616 sequential/test-gc-http-client-timeout
  ---
  duration_ms: 0.599
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 9/0/485
    done/collected/total: 41/9/485
    done/collected/total: 87/41/485
    done/collected/total: 136/87/485
    node:events:491
          throw er; // Unhandled 'error' event
          ^
    
    Error: connect ECONNRESET ::1:62627
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1242:16)
    Emitted 'error' event on ClientRequest instance at:
        at Socket.socketErrorListener (node:_http_client:475:9)
        at Socket.emit (node:events:513:28)
        at emitErrorNT (node:internal/streams/destroy:151:8)
        at emitErrorCloseNT (node:internal/streams/destroy:116:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
      errno: -54,
      code: 'ECONNRESET',
      syscall: 'connect',
      address: '::1',
      port: 62627
    }
    
    Node.js v19.0.0-pre
  ...
Reason parallel/test-fs-write-stream-file-handle
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43822, nodejs/node#43802)
Appeared test-rackspace-win2012r2_vs2017-x64-4, test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45518/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45533/
Example 
not ok 290 parallel/test-fs-write-stream-file-handle
  ---
  duration_ms: 0.869
  severity: fail
  exitcode: 1
  stack: |-
    Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.282
    Files blocking: [ 'write_stream_filehandle_test.txt' ]
    
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    + actual - expected
    
    + ''
    - 'hello world'
        at WriteStream.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-fs-write-stream-file-handle.js:19:12)
        at WriteStream.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:438:15)
        at WriteStream.emit (node:events:513:28)
        at emitCloseNT (node:internal/streams/destroy:132:10)
        at process.processTicksAndRejections (node:internal/process/task_queues:81:21) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: '',
   ...
Reason parallel/test-inspector-esm
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43010, nodejs/node#43919)
Appeared test-ibm-rhel8-s390x-4, test-osuosl-rhel8-ppc64_le-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45489/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45570/
Example 
not ok 1955 parallel/test-inspector-esm
  ---
  duration_ms: 15.339
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:33487/e8953f26-6145-46ef-861a-a89b6517926b
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [test] Verifying debugger stops on start (--inspect-brk option)
    [err] Debugger attached.
    [err] 
    Timed out waiting for matching notification (break on file:///home/iojs/build/workspace/node-test-commit-linuxone/test/fixtures/es-modules/message.mjs:0)
    1
  ...
Reason parallel/test-vm-break-on-sigint
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43891, nodejs/node#43890)
Appeared test-softlayer-ubi81_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-9, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/45524/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45543/
Example 
not ok 3119 parallel/test-vm-break-on-sigint
  ---
  duration_ms: 120.72
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason parallel/test-worker-fshandles-open-close-on-termination
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43010, nodejs/node#43826)
Appeared test-joyent-smartos20-x64-4, test-rackspace-win2012r2_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45508/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45545/
Example 
not ok 2986 parallel/test-worker-fshandles-open-close-on-termination
  ---
  duration_ms: 1.490
  severity: crashed
  exitcode: -5
  stack: |-
    
    #
    # Fatal process OOM in NewArray
    #
    
  ...

Jenkins Failure

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 11 (nodejs/node#43863, nodejs/node#43880, nodejs/node#43870, nodejs/node#43883, nodejs/node#43010, nodejs/node#43806, nodejs/node#43881, nodejs/node#43892, nodejs/node#43824, nodejs/node#43885, nodejs/node#38905)
Appeared test-digitalocean-freebsd12-x64-2, test-orka-macos10.15-x64-2, test-rackspace-win2012r2_vs2019-x64-3, test-equinix-ubuntu2004_container-armv7l-2, test-nearform-macos11.0-arm64-1, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45485/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45571/
Example 
java.io.IOException: Backing channel 'JNLP4-connect connection from 107.170.28.213/107.170.28.213:60232' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
	at com.sun.proxy.$Proxy79.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205)
Reason Build timed out (after 15 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (nodejs/node#38905, nodejs/node#43826)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/45531/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45549/
Example 
Build timed out (after 15 minutes). Marking the build as failed.

Build Failure

Reason ERROR: Build step failed with exception
Type BUILD_FAILURE
Failed PR 5 (nodejs/node#43870, nodejs/node#43886, nodejs/node#43919, nodejs/node#38905, nodejs/node#43912)
Appeared test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45499/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45575/
Example 
ERROR: Build step failed with exception
java.lang.NullPointerException: no workspace from node hudson.slaves.DumbSlave[test-equinix-ubuntu2004_container-armv7l-2] which is computer hudson.slaves.SlaveComputer@2ad6001 and has channel null
	at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:113)
	at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:91)
	at org.jenkinsci.plugins.postbuildscript.processor.Processor.processBuildSteps(Processor.java:180)
	at org.jenkinsci.plugins.postbuildscript.processor.Processor.processScripts(Processor.java:91)
Reason ERROR: Step ?Publish JUnit test result report? failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#43884, nodejs/node#43886, nodejs/node#43802, nodejs/node#43919)
Appeared test-equinix-ubuntu2004_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45506/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45577/
Example 
ERROR: Step ?Publish JUnit test result report? failed: no workspace for node-test-commit-arm/nodes=ubuntu2004-armv7l #42864
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

undefined

Reason Unknown
Type undefined
Failed PR 25 (nodejs/node#43763, nodejs/node#43863, nodejs/node#43741, nodejs/node#43880, nodejs/node#43870, nodejs/node#43883, nodejs/node#43010, nodejs/node#43879, nodejs/node#43886, nodejs/node#43806, nodejs/node#43881, nodejs/node#43890, nodejs/node#43875, nodejs/node#43802, nodejs/node#43892, nodejs/node#43889, nodejs/node#43824, nodejs/node#43826, nodejs/node#43891, nodejs/node#43858, nodejs/node#42256, nodejs/node#43919, nodejs/node#38905, nodejs/node#43912, nodejs/node#43747)
Appeared test-nearform_arm-win10_vs2019-arm64-1, test-equinix-debian10_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45483/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45582/
Example 
Unknown

Progress

  • pummel/test-http-upload-timeout (23)
  • sequential/test-gc-http-client (9)
  • sequential/test-gc-http-client-onerror (6)
  • parallel/test-heapsnapshot-near-heap-limit-worker (4)
  • parallel/test-worker-heap-snapshot (3)
  • sequential/test-gc-http-client-timeout (3)
  • parallel/test-fs-write-stream-file-handle (2)
  • parallel/test-inspector-esm (2)
  • parallel/test-vm-break-on-sigint (2)
  • parallel/test-worker-fshandles-open-close-on-termination (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (11)
  • Build timed out (after 15 minutes). Marking the build as failed. (2)
  • ERROR: Build step failed with exception (5)
  • ERROR: Step ?Publish JUnit test result report? failed: no workspace for ... (4)
  • Unknown (25)
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants