CI Reliability 2023-05-13 #564

github-actions · 2023-05-13T00:13:18Z

Failures in node-test-pull-request/51670 to node-test-pull-request/51768 that failed more than 2 PRs
(Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time	RUNNING	SUCCESS	UNSTABLE	ABORTED	FAILURE	Green Rate
2023-05-13 00:13	1	6	39	1	53	6.12%

CCTest Failure

Jenkins Failure

Reason	`Build timed out (after 60 minutes). Marking the build as failed.`
Type	JENKINS_FAILURE
Failed PR	2 (nodejs/node#47911, nodejs/node#47931)
Appeared	test-softlayer-ubi81_container-x64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51692/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51754/

Example

Build timed out (after 60 minutes). Marking the build as failed.

Build Failure

Reason	`error: argument --input/-i: can't open 'cctest.tap': [Errno 2] No such file or directory: 'cctest.tap'`
Type	BUILD_FAILURE
Failed PR	3 (nodejs/node#47706, nodejs/node#47891, nodejs/node#47884)
Appeared	test-ibm-rhel7-s390x-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51680/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51685/

Example

error: argument --input/-i: can't open 'cctest.tap': [Errno 2] No such file or directory: 'cctest.tap'
+ true
POST BUILD TASK : SUCCESS
END OF POST BUILD TASK : 0
Recording test results
[Checks API] No suitable checks publisher found.

Reason	`sh: line 12: [: -gt: unary operator expected`
Type	BUILD_FAILURE
Failed PR	3 (nodejs/node#47886, nodejs/node#47909, nodejs/node#47860)
Appeared	test-rackspace-win2012r2_vs2017-x64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51671/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51753/

Example

sh: line 12: [: -gt: unary operator expected

Reason	`ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?`
Type	BUILD_FAILURE
Failed PR	2 (nodejs/node#47886, nodejs/node#47939)
Appeared	test-equinix-ubuntu2004_container-armv7l-1, test-osuosl-ubuntu2004_container-armv7l-1, test-equinix_mnx-smartos20-x64-4, test-ibm-aix72-ppc64_be-2, test-equinix-rhel8_container-arm64-2, test-equinix-ubuntu1804_container-arm64-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-4, test-equinix-ubuntu2004_container-armv7l-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-equinix-debian10_container-armv7l-2
First CI	https://ci.nodejs.org/job/node-test-pull-request/51671/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51759/

Example

ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
[PostBuildScript] - [INFO] Executing post build scripts.
[node-test-binary-armv7l] $ /bin/bash -ex /tmp/jenkins595513339157028404.sh
+ '[' -d .git ']'
+ git clean -fdx

Reason	`error: remote GitHub already exists.`
Type	BUILD_FAILURE
Failed PR	2 (nodejs/node#47909, nodejs/node#47927)
Appeared	test-rackspace-win2012r2_vs2019-x64-4, test-rackspace-win2012r2_vs2019-x64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51698/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51722/

Example

error: remote GitHub already exists.

> git fetch --prune --no-tags GitHub 

> git fetch --prune --no-tags https://github.com/nodejs/build.git +refs/heads/main:refs/remotes/jenkins_tmp

JSTest Failure

Reason	`es-module/test-esm-loader-http-imports`
Type	JS_TEST_FAILURE
Failed PR	9 (nodejs/node#47886, nodejs/node#47884, nodejs/node#47706, nodejs/node#47909, nodejs/node#47727, nodejs/node#47927, nodejs/node#47946, nodejs/node#47957, nodejs/node#47983)
Appeared	test-digitalocean-freebsd12-x64-1, test-digitalocean-freebsd12-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-equinix-ubuntu2004_container-armv7l-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51671/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51768/

Example

not ok 57 es-module/test-esm-loader-http-imports
  ---
  duration_ms: 36801.57700
  severity: fail
  exitcode: 1
  stack: |-
    TAP version 13
    # Subtest: ESM: http import via loader
        # Subtest: should load using --import flag
        ok 1 - should load using --import flag
          ---
          duration_ms: 33635.031089
          ...

Reason	`pummel/test-net-throttle`
Type	JS_TEST_FAILURE
Failed PR	6 (nodejs/node#47886, nodejs/node#47933, nodejs/node#47909, nodejs/node#47860, nodejs/node#47983, nodejs/node#47949)
Appeared	test-digitalocean-freebsd12-x64-2, test-digitalocean-freebsd12-x64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51672/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51767/

Example

not ok 3587 pummel/test-net-throttle
  ---
  duration_ms: 505.05900
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at process.<anonymous> (/usr/home/iojs/build/workspace/node-test-commit-freebsd/nodes/freebsd12-x64/test/pummel/test-net-throttle.js:87:10)
        at process.emit (node:events:523:35) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v21.0.0-pre
  ...

Reason	`parallel/test-http-remove-connection-header-persists-connection`
Type	JS_TEST_FAILURE
Failed PR	4 (nodejs/node#47160, nodejs/node#47919, nodejs/node#47931, nodejs/node#47364)
Appeared	test-orka-macos11-x64-2, test-digitalocean-ubi81_container-x64-2
First CI	https://ci.nodejs.org/job/node-test-pull-request/51679/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51746/

Example

not ok 1233 parallel/test-http-remove-connection-header-persists-connection
  ---
  duration_ms: 343.42900
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    
    false !== true
    
        at /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-http-remove-connection-header-persists-connection.js:67:16
        at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-http-remove-connection-header-persists-connection.js:54:7)
        at listOnTimeout (node:internal/timers:573:17)
        at process.processTimers (node:internal/timers:514:7) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: false,
      expected: true,
      operator: 'strictEqual'
    }
    
    Node.js v21.0.0-pre
  ...

Reason	`parallel/test-runner-watch-mode`
Type	JS_TEST_FAILURE
Failed PR	4 (nodejs/node#47886, nodejs/node#47160, nodejs/node#47881, nodejs/node#47939)
Appeared	test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-equinix-ubuntu2004_container-armv7l-1, test-equinix-ubuntu2004_sharedlibs_container-arm64-5, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7
First CI	https://ci.nodejs.org/job/node-test-pull-request/51671/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51730/

Example

not ok 3931 parallel/test-runner-watch-mode
  ---
  duration_ms: 960039.98100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    TAP version 13
  ...

Reason	`parallel/test-x509-escaping`
Type	JS_TEST_FAILURE
Failed PR	4 (nodejs/node#47903, nodejs/node#47055, nodejs/node#47933, nodejs/node#47931)
Appeared	test-rackspace-win2012r2_vs2019-x64-6, test-rackspace-win2012r2_vs2015-x64-2, test-rackspace-win2012r2_vs2017-x64-4
First CI	https://ci.nodejs.org/job/node-test-pull-request/51691/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51744/

Example

not ok 885 parallel/test-x509-escaping
  ---
  duration_ms: 5805.00300
  severity: fail
  exitcode: 1
  stack: |-
    node:events:489
          throw er; // Unhandled 'error' event
          ^
    
    Error [ERR_SOCKET_CONNECTION_TIMEOUT]: Socket connection timeout
        at new NodeError (node:internal/errors:399:5)
        at internalConnectMultiple (node:net:1099:20)
        at Timeout.internalConnectMultipleTimeout (node:net:1638:3)
        at listOnTimeout (node:internal/timers:575:11)
        at process.processTimers (node:internal/timers:514:7)
    Emitted 'error' event on TLSSocket instance at:
        at emitErrorNT (node:internal/streams/destroy:151:8)
        at emitErrorCloseNT (node:internal/streams/destroy:116:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:82:21) {
      code: 'ERR_SOCKET_CONNECTION_TIMEOUT'
    }
    
    Node.js v21.0.0-pre
  ...

Reason	`parallel/test-runner-output`
Type	JS_TEST_FAILURE
Failed PR	3 (nodejs/node#47886, nodejs/node#47893, nodejs/node#47943)
Appeared	test-osuosl-aix72-ppc64_be-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-equinix-ubuntu2004_container-armv7l-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51671/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51727/

Example

not ok 2505 parallel/test-runner-output
  ---
  duration_ms: 2811.26300
  severity: fail
  exitcode: 1
  stack: |-
    TAP version 13
    # Subtest: test runner output
        # Subtest: test-runner/output/abort.js
        ok 1 - test-runner/output/abort.js
          ---
          duration_ms: 1435.371551
          ...

Reason	`sequential/test-http-regr-gh-2928`
Type	JS_TEST_FAILURE
Failed PR	3 (nodejs/node#47884, nodejs/node#47706, nodejs/node#47364)
Appeared	test-digitalocean-freebsd12-x64-1, test-rackspace-win2012r2_vs2017-x64-4, test-digitalocean-freebsd12-x64-2
First CI	https://ci.nodejs.org/job/node-test-pull-request/51685/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51746/

Example

not ok 3857 sequential/test-http-regr-gh-2928
  ---
  duration_ms: 120031.35100
  severity: fail
  exitcode: -15
  stack: |-
    timeout
    .+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+.+....

Reason	`es-module/test-esm-dynamic-import`
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#47886, nodejs/node#47824)
Appeared	test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win11_vs2022-arm64-1, test-rackspace-win2012r2_vs2017-x64-3, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-equinix-ubuntu2004_container-armv7l-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51671/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51763/

Example

not ok 25 es-module/test-esm-dynamic-import
  ---
  duration_ms: 174.00100
  severity: fail
  exitcode: 1
  stack: |-
    node:internal/process/promises:289
                triggerUncaughtException(err, true /* fromPromise */);
                ^
    
    AssertionError [ERR_ASSERTION]: Expected values to be strictly equal:
    + actual - expected
    
    + "Only URLs with a scheme in: file, data, and node are supported by the default ESM loader. On Windows, absolute paths must be valid file:// URLs. Received protocol 'c:'"
    - "Only URLs with a scheme in: file and data are supported by the default ESM loader. On Windows, absolute paths must be valid file:// URLs. Received protocol 'c:'"
        at C:\workspace\node-test-binary-windows-js-suites\node\test\es-module\test-esm-dynamic-import.js:13:25
        at C:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:465:15 {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: "Only URLs with a scheme in: file, data, and n...

Reason	`es-module/test-esm-loader-resolve-type`
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#47886, nodejs/node#47055)
Appeared	test-digitalocean-freebsd12-x64-2, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-equinix-ubuntu2004_container-armv7l-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51671/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51719/

Example

not ok 3501 es-module/test-esm-loader-resolve-type
  ---
  duration_ms: 4331.89200
  severity: fail
  exitcode: 1
  stack: |-
    (node:12834) ExperimentalWarning: Custom ESM Loaders is an experimental feature and might change at any time
    (Use `node --trace-warnings ...` to show where the warning was created)
    <preload>:10
          const timeout = setTimeout(() => { throw new Error('timeout'); }, 1_000);
                                             ^
    
    Error: timeout
        at Timeout._onTimeout (<preload>:10:48)
        at listOnTimeout (node:internal/timers:573:17)
        at process.processTimers (node:internal/timers:514:7)
    
    Node.js v21.0.0-pre
  ...

Reason	`parallel/test-cluster-fork-stdio`
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#47887, nodejs/node#47891)
Appeared	test-rackspace-win2012r2_vs2015-x64-1, test-azure_msft-win11_vs2022-arm64-4
First CI	https://ci.nodejs.org/job/node-test-pull-request/51670/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51683/

Example

not ok 887 parallel/test-cluster-fork-stdio
  ---
  duration_ms: 120118.00100
  severity: fail
  exitcode: 1
  stack: |-
    timeout
  ...

Reason	`parallel/test-fs-watch-recursive-add-file-with-url`
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#47886, nodejs/node#47943)
Appeared	test-ibm-rhel8-s390x-4, test-digitalocean-ubuntu1804_sharedlibs_container-x64-7, test-equinix-ubuntu2004_container-armv7l-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51671/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51727/

Example

not ok 1320 parallel/test-fs-watch-recursive-add-file-with-url
  ---
  duration_ms: 120098.03200
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...

Reason	`parallel/test-fs-watch-recursive-symlink`
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#47650, nodejs/node#47939)
Appeared	test-ibm-rhel8-s390x-3, test-ibm-rhel8-s390x-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51720/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51730/

Example

not ok 1343 parallel/test-fs-watch-recursive-symlink
  ---
  duration_ms: 120040.27600
  severity: fail
  exitcode: -15
  stack: |-
    timeout
  ...

Reason	`parallel/test-http2-misbehaving-multiplex`
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#47933, nodejs/node#47943)
Appeared	test-ibm-rhel8-s390x-4, test-orka-macos11-x64-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51715/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51747/

Example

not ok 1506 parallel/test-http2-misbehaving-multiplex
  ---
  duration_ms: 70.46900
  severity: fail
  exitcode: 1
  stack: |-
    node:assert:125
      throw new AssertionError(obj);
      ^
    
    AssertionError [ERR_ASSERTION]: Expected "actual" to be strictly unequal to: 5
        at Http2Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-linuxone/test/parallel/test-http2-misbehaving-multiplex.js:45:10)
        at Http2Server.<anonymous> (/home/iojs/build/workspace/node-test-commit-linuxone/test/common/index.js:465:15)
        at Http2Server.emit (node:events:511:28)
        at ServerHttp2Session.sessionOnStream (node:internal/http2/core:3003:19)
        at ServerHttp2Session.emit (node:events:511:28)
        at emit (node:internal/http2/core:331:3)
        at process.processTicksAndRejections (node:internal/process/task_queues:85:22) {
      generatedMessage: true,
      code: 'ERR_ASSERTION',
      actual: 5,
      expected: 5,
      operator: 'notStrictEqual'
    }
    
    Node.js v21.0...

Reason	`parallel/test-inspector-async-stack-traces-promise-then`
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#47706, nodejs/node#47931)
Appeared	test-ibm-rhel8-s390x-4
First CI	https://ci.nodejs.org/job/node-test-pull-request/51680/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51732/

Example

not ok 1867 parallel/test-inspector-async-stack-traces-promise-then
  ---
  duration_ms: 15315.87700
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:34957/b46fe697-e072-463a-985c-335e8246e0d1
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [err] Debugger attached.
    [err] 
    Timed out waiting for matching notification (break on [eval]:0)
    1
  ...

Reason	`parallel/test-inspector-esm`
Type	JS_TEST_FAILURE
Failed PR	2 (nodejs/node#47886, nodejs/node#47885)
Appeared	test-ibm-rhel8-s390x-4, test-equinix-ubuntu2004_container-armv7l-1
First CI	https://ci.nodejs.org/job/node-test-pull-request/51671/
Last CI	https://ci.nodejs.org/job/node-test-pull-request/51704/

Example

not ok 1968 parallel/test-inspector-esm
  ---
  duration_ms: 15362.03800
  severity: fail
  exitcode: 1
  stack: |-
    [test] Connecting to a child Node process
    [test] Testing /json/list
    [err] Debugger listening on ws://127.0.0.1:41985/d429877b-310f-41b1-ad5f-8f85d715b3a9
    [err] For help, see: https://nodejs.org/en/docs/inspector
    [err] 
    [test] Verifying debugger stops on start (--inspect-brk option)
    [err] Debugger attached.
    [err] 
    Timed out waiting for matching notification (break on file:///home/iojs/build/workspace/node-test-commit-linuxone/test/fixtures/es-modules/message.mjs:0)
    1
  ...

Progress

The text was updated successfully, but these errors were encountered:

This test has been failing occasionally for weeks. Refs: nodejs#47836 Refs: nodejs/reliability#564

This test has been failing occasionally for weeks. Refs: #47836 Refs: nodejs/reliability#564 PR-URL: #47987 Reviewed-By: Filip Skokan <panva.ip@gmail.com> Reviewed-By: Antoine du Hamel <duhamelantoine1995@gmail.com>

This test has been failing occasionally for weeks. Refs: nodejs#47836 Refs: nodejs/reliability#564 PR-URL: nodejs#47987 Reviewed-By: Filip Skokan <panva.ip@gmail.com> Reviewed-By: Antoine du Hamel <duhamelantoine1995@gmail.com>

tniessen mentioned this issue May 13, 2023

test: mark test-esm-loader-http-imports as flaky nodejs/node#47987

Merged

tniessen added a commit to tniessen/node that referenced this issue May 13, 2023

test: mark test-esm-loader-http-imports as flaky

a5bfdd3

This test has been failing occasionally for weeks. Refs: nodejs#47836 Refs: nodejs/reliability#564

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

CI Reliability 2023-05-13 #564

CI Reliability 2023-05-13 #564

github-actions bot commented May 13, 2023

CI Reliability 2023-05-13 #564

CI Reliability 2023-05-13 #564

Comments

github-actions bot commented May 13, 2023

CCTest Failure

Jenkins Failure

Build Failure

JSTest Failure

Progress