Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom

CI Reliability 2022-07-21 #327

Open
16 tasks
github-actions bot opened this issue Jul 21, 2022 · 0 comments
Open
16 tasks

CI Reliability 2022-07-21 #327

github-actions bot opened this issue Jul 21, 2022 · 0 comments

Comments

@github-actions
Copy link

Failures in node-test-pull-request/45470 to node-test-pull-request/45567 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2022-07-21 00:15 0 5 27 2 66 5.10%

JSTest Failure

Reason pummel/test-http-upload-timeout
Type JS_TEST_FAILURE
Failed PR 22 (nodejs/node#43514, nodejs/node#43554, nodejs/node#43877, nodejs/node#43010, nodejs/node#43870, nodejs/node#43880, nodejs/node#43881, nodejs/node#43714, nodejs/node#43747, nodejs/node#43886, nodejs/node#43806, nodejs/node#43883, nodejs/node#43891, nodejs/node#43889, nodejs/node#38905, nodejs/node#43885, nodejs/node#43896, nodejs/node#43826, nodejs/node#43802, nodejs/node#43858, nodejs/node#43741, nodejs/node#43903)
Appeared test-softlayer-ubuntu1804_sharedlibs_container-x64-3, test-equinix-ubuntu1804_sharedlibs_container-arm64-3, test-equinix-ubuntu1804_container-arm64-2, test-nearform-macos11.0-arm64-1, test-orka-macos10.15-x64-2, test-softlayer-ubi81_container-x64-1, test-digitalocean-alpine311_container-x64-1, test-rackspace-debian10-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-4, test-macstadium-macos11.0-arm64-3, test-softlayer-alpine311_container-x64-1, test-softlayer-ubuntu1804_sharedlibs_container-x64-2, test-ibm-rhel8-s390x-4, test-equinix-rhel8_container-arm64-1, test-rackspace-fedora32-x64-1, test-equinix-ubuntu1804_sharedlibs_container-arm64-5, test-rackspace-win2012r2_vs2015-x64-2, test-orka-macos11-x64-2, test-equinix-debian10_container-armv7l-2, test-digitalocean-fedora32-x64-1, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45481/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45564/
Example 
not ok 3330 pummel/test-http-upload-timeout
  ---
  duration_ms: 5.735
  severity: fail
  exitcode: 1
  stack: |-
    /home/iojs/build/workspace/node-test-commit-linux-containered/test/pummel/test-http-upload-timeout.js:34
        throw new Error('Unexpected timeout');
        ^
    
    Error: Unexpected timeout
        at Socket.<anonymous> (/home/iojs/build/workspace/node-test-commit-linux-containered/test/pummel/test-http-upload-timeout.js:34:11)
        at Socket.emit (node:events:525:35)
        at Socket._onTimeout (node:net:522:8)
        at listOnTimeout (node:internal/timers:564:17)
        at process.processTimers (node:internal/timers:507:7)
    
    Node.js v19.0.0-pre
  ...
Reason sequential/test-gc-http-client
Type JS_TEST_FAILURE
Failed PR 10 (nodejs/node#43178, nodejs/node#43863, nodejs/node#43763, nodejs/node#43010, nodejs/node#43880, nodejs/node#43879, nodejs/node#43890, nodejs/node#43826, nodejs/node#43891, nodejs/node#43858)
Appeared test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45472/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45559/
Example 
not ok 3425 sequential/test-gc-http-client
  ---
  duration_ms: 1.415
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 160/0/640
    done/collected/total: 320/160/640
    done/collected/total: 480/256/640
    done/collected/total: 631/320/640
    done/collected/total: 640/480/640
    done/collected/total: 640/631/640
    done/collected/total: 640/640/640
    node:_http_server:493
        connections[i].socket.destroy();
                              ^
    
    TypeError: Cannot read properties of null (reading 'destroy')
        at Server.closeIdleConnections (node:_http_server:493:27)
        at Server.close (node:_http_server:476:8)
        at Immediate.status (/home/iojs/build/workspace/node-test-binary-armv7l/test/sequential/test-gc-http-client.js:60:14)
        at process.processImmediate (node:internal/timers:471:21)
    
    Node.js v19.0.0-pre
  ...
Reason sequential/test-gc-http-client-onerror
Type JS_TEST_FAILURE
Failed PR 6 (nodejs/node#43873, nodejs/node#43870, nodejs/node#43883, nodejs/node#43881, nodejs/node#43891, nodejs/node#43858)
Appeared test-equinix-debian10_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu1804_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45490/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45559/
Example 
not ok 3426 sequential/test-gc-http-client-onerror
  ---
  duration_ms: 1.516
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 160/0/640
    done/collected/total: 320/160/640
    done/collected/total: 480/256/640
    done/collected/total: 629/320/640
    done/collected/total: 640/480/640
    done/collected/total: 640/629/640
    done/collected/total: 640/640/640
    node:_http_server:493
        connections[i].socket.destroy();
                              ^
    
    TypeError: Cannot read properties of null (reading 'destroy')
        at Server.closeIdleConnections (node:_http_server:493:27)
        at Server.close (node:_http_server:476:8)
        at Immediate.status (/home/iojs/build/workspace/node-test-binary-armv7l/test/sequential/test-gc-http-client-onerror.js:65:14)
        at process.processImmediate (node:internal/timers:471:21)
    
    Node.js v19.0.0-pre
  ...
Reason parallel/test-worker-heap-snapshot
Type JS_TEST_FAILURE
Failed PR 5 (nodejs/node#43178, nodejs/node#43783, nodejs/node#43892, nodejs/node#43889, nodejs/node#43890)
Appeared test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-8, test-rackspace-win2012r2_vs2017-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45472/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45543/
Example 
not ok 3018 parallel/test-worker-heap-snapshot
  ---
  duration_ms: 0.815
  severity: crashed
  exitcode: -11
  stack: |-
  ...
Reason parallel/test-heapsnapshot-near-heap-limit-worker
Type JS_TEST_FAILURE
Failed PR 4 (nodejs/node#43863, nodejs/node#43824, nodejs/node#43826, nodejs/node#42256)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-equinix-debian10_container-armv7l-2, test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/45485/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45567/
Example 
not ok 1391 parallel/test-heapsnapshot-near-heap-limit-worker
  ---
  duration_ms: 3.159
  severity: fail
  exitcode: 1
  stack: |-
    
    Invoked NearHeapLimitCallback, processing=false, current_limit=52428800, initial_limit=52428800
    max_young_gen_size=25165824, young_gen_size=0, old_gen_size=51703208, total_size=51703208
    Estimated available memory=4200755200, estimated overhead=25165824
    Start generating Heap.20220720.185111.1206468.1.001.heapsnapshot...
    Wrote snapshot to /home/iojs/tmp/.tmp.1135/Heap.20220720.185111.1206468.1.001.heapsnapshot
    
    <--- Last few GCs --->
    
    [1206468:0xf4a00708]     1491 ms: Mark-sweep (reduce) 49.2 (52.8) -> 49.2 (52.8) MB, 14.9 / 0.0 ms  (average mu = 0.216, current mu = -0.233) heap profiler; GC in old space requested
    
    
    <--- JS stacktrace --->
    
    FATAL ERROR: Ineffective mark-compacts near heap limit Allocation failed - JavaScript heap out of memory
    
    node:assert:400
        throw err;
        ^
    
    AssertionError [...
Reason parallel/test-http-client-response-timeout
Type JS_TEST_FAILURE
Failed PR 3 (nodejs/node#43806, nodejs/node#43010, nodejs/node#43863)
Appeared test-ibm-rhel8-s390x-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45470/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45485/
Example 
not ok 1045 parallel/test-http-client-response-timeout
  ---
  duration_ms: 0.70
  severity: fail
  exitcode: 1
  stack: |-
    Mismatched <anonymous> function calls. Expected exactly 1, actual 0.
        at Proxy.mustCall (/home/iojs/build/workspace/node-test-commit-linuxone/test/common/index.js:396:10)
        at ClientRequest.<anonymous> (/home/iojs/build/workspace/node-test-commit-linuxone/test/parallel/test-http-client-response-timeout.js:10:32)
        at ClientRequest.<anonymous> (/home/iojs/build/workspace/node-test-commit-linuxone/test/common/index.js:438:15)
        at Object.onceWrapper (node:events:628:26)
        at ClientRequest.emit (node:events:513:28)
        at HTTPParser.parserOnIncomingClient [as onIncoming] (node:_http_client:674:27)
        at HTTPParser.parserOnHeadersComplete (node:_http_common:117:17)
        at Socket.socketOnData (node:_http_client:521:22)
        at Socket.emit (node:events:513:28)
  ...
Reason parallel/test-fs-write-stream-file-handle
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43822, nodejs/node#43802)
Appeared test-rackspace-win2012r2_vs2017-x64-4, test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45518/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45533/
Example 
not ok 290 parallel/test-fs-write-stream-file-handle
  ---
  duration_ms: 0.869
  severity: fail
  exitcode: 1
  stack: |-
    Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.282
    Files blocking: [ 'write_stream_filehandle_test.txt' ]
    
    node:assert:124
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    + actual - expected
    
    + ''
    - 'hello world'
        at WriteStream.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-fs-write-stream-file-handle.js:19:12)
        at WriteStream.<anonymous> (C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:438:15)
        at WriteStream.emit (node:events:513:28)
        at emitCloseNT (node:internal/streams/destroy:132:10)
        at process.processTicksAndRejections (node:internal/process/task_queues:81:21) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: '',
   ...
Reason parallel/test-vm-break-on-sigint
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43891, nodejs/node#43890)
Appeared test-softlayer-ubi81_container-x64-1, test-digitalocean-ubuntu1804_sharedlibs_container-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-9, test-digitalocean-ubuntu1804_sharedlibs_container-x64-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/45524/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45543/
Example 
not ok 3119 parallel/test-vm-break-on-sigint
  ---
  duration_ms: 120.72
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...
Reason parallel/test-worker-fshandles-open-close-on-termination
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43010, nodejs/node#43826)
Appeared test-joyent-smartos20-x64-4, test-rackspace-win2012r2_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/45508/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45545/
Example 
not ok 2986 parallel/test-worker-fshandles-open-close-on-termination
  ---
  duration_ms: 1.490
  severity: crashed
  exitcode: -5
  stack: |-
    
    #
    # Fatal process OOM in NewArray
    #
    
  ...
Reason sequential/test-gc-http-client-timeout
Type JS_TEST_FAILURE
Failed PR 2 (nodejs/node#43822, nodejs/node#43863)
Appeared test-nearform-macos11.0-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45518/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45522/
Example 
not ok 3612 sequential/test-gc-http-client-timeout
  ---
  duration_ms: 0.448
  severity: fail
  exitcode: 1
  stack: |-
    done/collected/total: 48/0/503
    done/collected/total: 97/48/503
    done/collected/total: 166/97/503
    node:events:491
          throw er; // Unhandled 'error' event
          ^
    
    Error: connect ECONNRESET ::1:64397
        at TCPConnectWrap.afterConnect [as oncomplete] (node:net:1241:16)
    Emitted 'error' event on ClientRequest instance at:
        at Socket.socketErrorListener (node:_http_client:475:9)
        at Socket.emit (node:events:513:28)
        at emitErrorNT (node:internal/streams/destroy:151:8)
        at emitErrorCloseNT (node:internal/streams/destroy:116:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
      errno: -54,
      code: 'ECONNRESET',
      syscall: 'connect',
      address: '::1',
      port: 64397
    }
    
    Node.js v19.0.0-pre
  ...

Jenkins Failure

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 10 (nodejs/node#43863, nodejs/node#43880, nodejs/node#43870, nodejs/node#43883, nodejs/node#43010, nodejs/node#43806, nodejs/node#43881, nodejs/node#43892, nodejs/node#43824, nodejs/node#43885)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-digitalocean-freebsd12-x64-2, test-nearform-macos11.0-arm64-1, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45485/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45546/
Example 
java.io.IOException: Backing channel 'JNLP4-connect connection from 145.40.99.31/145.40.99.31:58098' is disconnected.
	at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:216)
	at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:286)
	at com.sun.proxy.$Proxy79.isAlive(Unknown Source)
	at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1213)
	at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1205)
Reason Build timed out (after 15 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (nodejs/node#38905, nodejs/node#43826)
Appeared test-joyent-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/45531/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45549/
Example 
Build timed out (after 15 minutes). Marking the build as failed.

Build Failure

Reason ERROR: Build step failed with exception
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#43010, nodejs/node#43747, nodejs/node#43870, nodejs/node#43886)
Appeared test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45479/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45516/
Example 
ERROR: Build step failed with exception
java.lang.NullPointerException: no workspace from node hudson.slaves.DumbSlave[test-equinix-ubuntu2004_container-armv7l-2] which is computer hudson.slaves.SlaveComputer@2ad6001 and has channel null
	at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:113)
	at hudson.tasks.CommandInterpreter.perform(CommandInterpreter.java:91)
	at org.jenkinsci.plugins.postbuildscript.processor.Processor.processBuildSteps(Processor.java:180)
	at org.jenkinsci.plugins.postbuildscript.processor.Processor.processScripts(Processor.java:91)
Reason ERROR: Step ?Publish JUnit test result report? failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 4 (nodejs/node#43010, nodejs/node#43884, nodejs/node#43886, nodejs/node#43802)
Appeared test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45474/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45533/
Example 
ERROR: Step ?Publish JUnit test result report? failed: no workspace for node-test-commit-arm/nodes=ubuntu2004-armv7l #42818
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE
Reason ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (nodejs/node#43010, nodejs/node#43892)
Appeared test-osuosl-rhel8-ppc64_le-2, test-digitalocean-freebsd12-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/45479/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45536/
Example 
ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for node-test-commit-plinux/nodes=rhel8-ppc64le #43996
Sending e-mails to: michael_dawson@ca.ibm.com vieuxtech@gmail.com
Collecting metadata...
Metadata collection done.
Notifying upstream projects of job completion
Finished: FAILURE

undefined

Reason Unknown
Type undefined
Failed PR 23 (nodejs/node#43178, nodejs/node#43763, nodejs/node#43863, nodejs/node#43741, nodejs/node#43880, nodejs/node#43870, nodejs/node#43883, nodejs/node#43010, nodejs/node#43879, nodejs/node#43747, nodejs/node#43886, nodejs/node#43806, nodejs/node#43881, nodejs/node#43890, nodejs/node#43875, nodejs/node#43802, nodejs/node#43892, nodejs/node#43889, nodejs/node#43824, nodejs/node#43826, nodejs/node#43891, nodejs/node#43858, nodejs/node#42256)
Appeared test-equinix-debian10_container-armv7l-1, test-nearform_arm-win10_vs2019-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/45472/
Last CI https://ci.nodejs.org/job/node-test-pull-request/45567/
Example 
Unknown

Progress

  • pummel/test-http-upload-timeout (22)
  • sequential/test-gc-http-client (10)
  • sequential/test-gc-http-client-onerror (6)
  • parallel/test-worker-heap-snapshot (5)
  • parallel/test-heapsnapshot-near-heap-limit-worker (4)
  • parallel/test-http-client-response-timeout (3)
  • parallel/test-fs-write-stream-file-handle (2)
  • parallel/test-vm-break-on-sigint (2)
  • parallel/test-worker-fshandles-open-close-on-termination (2)
  • sequential/test-gc-http-client-timeout (2)
  • Backing channel 'JNLP4-connect connection from ... is disconnected. (10)
  • Build timed out (after 15 minutes). Marking the build as failed. (2)
  • ERROR: Build step failed with exception (4)
  • ERROR: Step ?Publish JUnit test result report? failed: no workspace for ... (4)
  • ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ... (2)
  • Unknown (23)
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants