nodejs / reliability

Make the CI green again
35 stars 11 forks source link

CI Reliability 2024-05-16 #866

Open github-actions[bot] opened 3 months ago

github-actions[bot] commented 3 months ago

Failures in node-test-pull-request/59133 to node-test-pull-request/59232 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-05-16 00:07 0 12 26 5 57 12.63%

Jenkins Failure

Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52881/, https://github.com/nodejs/node/pull/52951/, https://github.com/nodejs/node/pull/52997/)
Appeared test-rackspace-win2022_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59212/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59231/
Example ``` Build timed out (after 60 minutes). Marking the build as failed. ```

CCTest Failure

Reason C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected)
Type CC_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52993/, https://github.com/nodejs/node/pull/53000/)
Appeared test-azure_msft-win11_vs2022-x64-1, test-rackspace-win2022_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59220/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59226/
Example ``` C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected) Actual: true Expected: false [ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (5002 ms) ```

Build Failure

Reason error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
Type BUILD_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/52881/, https://github.com/nodejs/node/pull/52951/, https://github.com/nodejs/node/pull/51575/, https://github.com/nodejs/node/pull/52848/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/52829/, https://github.com/nodejs/node/pull/52990/)
Appeared test-rackspace-win2022_vs2022-x64-4, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2022_vs2022-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/59156/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59225/
Example ``` error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] convert-tq-csa.cc C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\tuple(43,1): fatal error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] data-view-tq-csa.cc C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\tuple(47,1): fatal error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] ```

Reason ERROR: No files found with the specified search criteria.
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/31137/, https://github.com/nodejs/node/pull/52531/, https://github.com/nodejs/node/pull/52990/)
Appeared test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59141/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59219/
Example ``` ERROR: No files found with the specified search criteria. 1 file(s) copied. > set DEBUG_HELPER=1 > call vcbuild.bat arm64 release msi ```

Reason FATAL: Channel "hudson.remoting.Channel@5f54ea6a:JNLP4-connect connection from ... Remote call on JNLP4-connect connection from 145.40.96.123/145.40.96.123:45764 failed. The channel is closing down or has closed down
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52827/, https://github.com/nodejs/node/pull/52946/, https://github.com/nodejs/node/pull/52283/)
Appeared undefined, test-equinix-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59137/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59139/
Example ``` FATAL: Channel "hudson.remoting.Channel@5f54ea6a:JNLP4-connect connection from 145.40.96.123/145.40.96.123:45764": Remote call on JNLP4-connect connection from 145.40.96.123/145.40.96.123:45764 failed. The channel is closing down or has closed down java.nio.channels.ClosedChannelException at org.jenkinsci.remoting.protocol.NetworkLayer.onRecvClosed(NetworkLayer.java:155) at org.jenkinsci.remoting.protocol.impl.NIONetworkLayer.ready(NIONetworkLayer.java:143) at org.jenkinsci.remoting.protocol.IOHub$OnReady.run(IOHub.java:789) at jenkins.util.ContextResettingExecutorService$1.run(ContextResettingExecutorService.java:28) ```

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/48847/, https://github.com/nodejs/node/pull/51805/, https://github.com/nodejs/node/pull/49292/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-alpine318_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59146/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59172/
Example ``` fatal: No rebase in progress? ```

Reason sh: line 4: node: command not found
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/51589/, https://github.com/nodejs/node/pull/52881/, https://github.com/nodejs/node/pull/52870/)
Appeared test-equinix-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59134/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59167/
Example ``` sh: line 4: node: command not found ```

Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52974/, https://github.com/nodejs/node/pull/52980/)
Appeared test-equinix-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59208/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59209/
Example ``` Failed to trigger node-test-commit ```

JSTest Failure

Reason parallel/test-pipe-file-to-http
Type JS_TEST_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/52946/, https://github.com/nodejs/node/pull/49292/, https://github.com/nodejs/node/pull/52954/, https://github.com/nodejs/node/pull/52531/, https://github.com/nodejs/node/pull/52905/, https://github.com/nodejs/node/pull/53000/, https://github.com/nodejs/node/pull/52996/, https://github.com/nodejs/node/pull/52998/)
Appeared test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-osuosl-ubuntu2004_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59168/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59230/
Example ``` not ok 3828 parallel/test-pipe-file-to-http --- duration_ms: 360112.14200 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/49790/, https://github.com/nodejs/node/pull/52443/, https://github.com/nodejs/node/pull/52948/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/51463/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/53014/)
Appeared test-digitalocean-ubuntu2204-x64-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win11_vs2022-x64-4, test-osuosl-debian11_container-armv7l-1, test-ibm-rhel8-s390x-4, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59149/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59232/
Example ``` not ok 4006 benchmark/test-benchmark-crypto --- duration_ms: 2724.86000 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at main (/home/iojs/build/workspace/node-test-commit-linux/benchmark/crypto/timingSafeEqual.js:21:10) at /home/iojs/build/workspace/node-test-commit-linux/benchmark/common.js:54:9 at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 1, expected: 0, operator: 'strictEqual' } Node.js v23.0.0-pre node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at ChildProcess. (/home/iojs/build/workspace/node-test-commit-linux/test/common/benchmark.js:28:12) a... ```

Reason parallel/test-buffer-tostring-rangeerror
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/51575/, https://github.com/nodejs/node/pull/51805/, https://github.com/nodejs/node/pull/52443/, https://github.com/nodejs/node/pull/52946/, https://github.com/nodejs/node/pull/52966/, https://github.com/nodejs/node/pull/52971/, https://github.com/nodejs/node/pull/52980/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-alpine319_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/59133/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59222/
Example ``` not ok 1049 parallel/test-buffer-tostring-rangeerror --- duration_ms: 120050.53000 severity: fail exitcode: -15 stack: |- timeout (node:2739389) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead. (Use `node --trace-deprecation ...` to show where the warning was created) ... ```

Reason parallel/test-cli-node-options
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/31137/, https://github.com/nodejs/node/pull/51805/, https://github.com/nodejs/node/pull/49292/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/47739/, https://github.com/nodejs/node/pull/52971/)
Appeared test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2019_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59175/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59221/
Example ``` not ok 131 parallel/test-cli-node-options --- duration_ms: 1314.00600 severity: crashed exitcode: 3221225477 stack: |- ... ```

Reason parallel/test-cli-permission-deny-fs
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/31137/, https://github.com/nodejs/node/pull/51805/, https://github.com/nodejs/node/pull/49292/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/47739/)
Appeared test-rackspace-win2019_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59175/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59195/
Example ``` not ok 120 parallel/test-cli-permission-deny-fs --- duration_ms: 1278.00700 severity: fail exitcode: 1 stack: |- C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-permission-deny-fs.js:62 const [fs, fsIn, fsOut] = stdout.toString().split('\n'); ^ TypeError: Cannot read properties of null (reading 'toString') at Object. (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-permission-deny-fs.js:62:36) at Module._compile (node:internal/modules/cjs/loader:1358:14) at Module._extensions..js (node:internal/modules/cjs/loader:1416:10) at Module.load (node:internal/modules/cjs/loader:1208:32) at Module._load (node:internal/modules/cjs/loader:1024:12) at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:174:12) at node:internal/main/run_main_module:28:49 Node.js v20.13.2-pre ... ```

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/51589/, https://github.com/nodejs/node/pull/52443/, https://github.com/nodejs/node/pull/52870/, https://github.com/nodejs/node/pull/52949/)
Appeared test-orka-macos11-x64-2, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59134/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59169/
Example ``` not ok 4098 sequential/test-http-server-request-timeouts-mixed --- duration_ms: 3304.70000 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(request2.completed) at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5) at listOnTimeout (node:internal/timers:573:17) at process.processTimers (node:internal/timers:514:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52870/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/52980/)
Appeared test-digitalocean-fedora39-x64-1, test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59167/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59222/
Example ``` not ok 345 parallel/test-blob-file-backed --- duration_ms: 171.49500 severity: fail exitcode: 1 stack: |- node:internal/blob:289 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:289:25) Node.js v23.0.0-pre ... ```

Reason wpt/test-compression
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52443/, https://github.com/nodejs/node/pull/52905/, https://github.com/nodejs/node/pull/52951/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-rackspace-win2022_vs2022-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/59162/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59227/
Example ``` not ok 4072 wpt/test-compression --- duration_ms: 1440056.24400 severity: fail exitcode: -15 stack: |- timeout [SKIPPED] compression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] decompression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] decompression-buffersource.tentative.any.js: ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] idlharness-shadowrealm.window.js: ShadowRealm support is not enabled [SKIPPED] third_party/pako/pako_inflate.min.js: This is not a test file. [PASS] "a" should cause the constructor to throw [PASS] no input should cause the constructor to throw [PASS] non-string input should cause the constructor to throw [PASS] "a" should cause the constructor to throw [PASS] no inpu... ```

Reason benchmark/test-benchmark-http2
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/52993/)
Appeared test-azure_msft-win2016_vs2017-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59169/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59220/
Example ``` not ok 184 benchmark/test-benchmark-http2 --- duration_ms: 2174.43300 severity: fail exitcode: 1 stack: |- Error: test-double-http2 failed with 3221226505. at ChildProcess. (C:\workspace\node-test-binary-windows-native-suites\node\benchmark\_http-benchmarkers.js:251:16) at Object.onceWrapper (node:events:632:26) at ChildProcess.emit (node:events:517:28) at maybeClose (node:internal/child_process:1098:16) at ChildProcess._handle.onexit (node:internal/child_process:303:5) node:assert:125 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 3221226505 !== 0 at ChildProcess. (C:\workspace\node-test-binary-windows-native-suites\node\test\common\benchmark.js:28:12) at ChildProcess.emit (node:events:517:28) at ChildProcess._handle.onexit (node:internal/child_process:292:12) { generatedMessage: true, code: 'ERR_ASSERTIO... ```

Reason es-module/test-esm-loader-chaining
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/51820/, https://github.com/nodejs/node/pull/49534/)
Appeared test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59159/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59207/
Example ``` not ok 93 es-module/test-esm-loader-chaining --- duration_ms: 7429.08900 severity: fail exitcode: 1 stack: |- TAP version 13 # Subtest: ESM: loader chaining # Subtest: should load unadulterated source when there are no loaders ok 1 - should load unadulterated source when there are no loaders --- duration_ms: 387.294 ... ```

Reason parallel/test-debugger-heap-profiler
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52283/, https://github.com/nodejs/node/pull/52948/)
Appeared test-rackspace-win2019_vs2019-x64-1, test-azure_msft-win11_vs2022-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59136/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59165/
Example ``` not ok 198 parallel/test-debugger-heap-profiler --- duration_ms: 2133.13900 severity: fail exitcode: 1 stack: |- Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.190 Files blocking: [ 'node.heapsnapshot' ] C:\workspace\node-test-binary-windows-js-suites\node\test\common\tmpdir.js:69 throw e; ^ Error: EBUSY: resource busy or locked, rmdir 'C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.190' at rmdirSync (node:fs:1218:11) at _rmdirSync (node:internal/fs/rimraf:235:5) at rimrafSync (node:internal/fs/rimraf:193:7) at Object.rmSync (node:fs:1267:10) at rmSync (C:\workspace\node-test-binary-windows-js-suites\node\test\common\tmpdir.js:20:8) at onexit (C:\workspace\node-test-binary-windows-js-suites\node\test\common\tmpdir.js:54:5) at process. (C:\workspace\node-test-binary-windows-js-suites\node\test\common\tmpdir.js:43:14) at process.emit (... ```

Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52727/, https://github.com/nodejs/node/pull/52870/)
Appeared test-digitalocean-rhel9-x64-1, test-equinix-rhel8_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59163/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59167/
Example ``` not ok 2721 parallel/test-net-write-fully-async-buffer --- duration_ms: 120073.24400 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-stream-readable-unpipe-resume
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52946/, https://github.com/nodejs/node/pull/52998/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59138/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59230/
Example ``` not ok 3781 parallel/test-stream-readable-unpipe-resume --- duration_ms: 120035.73500 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-timers-immediate-queue
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/48847/, https://github.com/nodejs/node/pull/52531/)
Appeared test-digitalocean-fedora38-x64-2, test-digitalocean-fedora38-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59146/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59216/
Example ``` not ok 3018 parallel/test-timers-immediate-queue --- duration_ms: 176.42000 severity: fail exitcode: 1 stack: |- hit 330 node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 330 !== 10 at process. (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-timers-immediate-queue.js:56:10) at process.emit (node:events:532:35) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 330, expected: 10, operator: 'strictEqual' } Node.js v23.0.0-pre ... ```

Progress