nodejs / reliability

Make the CI green again
35 stars 11 forks source link

CI Reliability 2024-05-18 #868

Open github-actions[bot] opened 3 months ago

github-actions[bot] commented 3 months ago

Failures in node-test-pull-request/59175 to node-test-pull-request/59272 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-05-18 00:07 1 15 23 3 58 15.63%

Jenkins Failure

Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/52881/, https://github.com/nodejs/node/pull/52951/, https://github.com/nodejs/node/pull/52997/, https://github.com/nodejs/node/pull/52974/)
Appeared test-rackspace-win2022_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59212/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59255/
Example ``` Build timed out (after 60 minutes). Marking the build as failed. ```

CCTest Failure

Reason C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected)
Type CC_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52993/, https://github.com/nodejs/node/pull/53000/)
Appeared test-azure_msft-win11_vs2022-x64-1, test-rackspace-win2022_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59220/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59226/
Example ``` C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected) Actual: true Expected: false [ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (5002 ms) ```

Build Failure

Reason error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
Type BUILD_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/51575/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/52829/, https://github.com/nodejs/node/pull/52990/, https://github.com/nodejs/node/pull/53020/, https://github.com/nodejs/node/pull/52905/, https://github.com/nodejs/node/pull/52848/, https://github.com/nodejs/node/pull/52951/, https://github.com/nodejs/node/pull/52658/, https://github.com/nodejs/node/pull/53002/)
Appeared test-rackspace-win2022_vs2022-x64-3, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2022_vs2022-x64-4, test-rackspace-win2022_vs2022-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59180/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59266/
Example ``` error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] builtins-wasm-gen.cc C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\tuple(359,1): fatal error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] Creating library ..\..\out\Release\mksnapshot_host.lib and object ..\..\out\Release\mksnapshot_host.exp interpreter-intrinsics-generator.cc ```

Reason ERROR: No files found with the specified search criteria.
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52531/, https://github.com/nodejs/node/pull/52990/)
Appeared test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59216/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59219/
Example ``` ERROR: No files found with the specified search criteria. 1 file(s) copied. > set DEBUG_HELPER=1 > call vcbuild.bat arm64 release msi ```

Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52974/, https://github.com/nodejs/node/pull/52980/)
Appeared test-equinix-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59208/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59209/
Example ``` Failed to trigger node-test-commit ```

JSTest Failure

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/51463/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/53014/, https://github.com/nodejs/node/pull/53020/, https://github.com/nodejs/node/pull/53019/, https://github.com/nodejs/node/pull/53002/, https://github.com/nodejs/node/pull/52905/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-ibm-rhel8-s390x-1, test-softlayer-debian12-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204-x64-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-azure_msft-win10_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59186/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59267/
Example ``` not ok 4006 benchmark/test-benchmark-crypto --- duration_ms: 2628.18600 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at main (/home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/crypto/timingSafeEqual.js:21:10) at /home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/common.js:54:9 at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 1, expected: 0, operator: 'strictEqual' } Node.js v23.0.0-pre node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at ChildProcess. (/home/iojs/build/workspace/node-test-commit-linux-containered/test/... ```

Reason parallel/test-cli-node-options
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/31137/, https://github.com/nodejs/node/pull/51805/, https://github.com/nodejs/node/pull/49292/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/47739/, https://github.com/nodejs/node/pull/52971/, https://github.com/nodejs/node/pull/52773/)
Appeared test-rackspace-win2019_vs2019-x64-2, test-rackspace-win2022_vs2022-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/59175/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59263/
Example ``` not ok 126 parallel/test-cli-node-options --- duration_ms: 1587.00500 severity: fail exitcode: 1 stack: |- Can't clean tmpdir: C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.124 Files blocking: [] node:internal/child_process:421 throw new ErrnoException(err, 'spawn'); ^ Error: spawn UNKNOWN at ChildProcess.spawn (node:internal/child_process:421:11) at spawn (node:child_process:761:9) at execFile (node:child_process:351:17) at expect (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-node-options.js:119:3) at Object. (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-node-options.js:70:1) at Module._compile (node:internal/modules/cjs/loader:1358:14) at Module._extensions..js (node:internal/modules/cjs/loader:1416:10) at Module.load (node:internal/modules/cjs/loader:1208:32) at Module._load (node:internal/module... ```

Reason parallel/test-buffer-tostring-rangeerror
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/52966/, https://github.com/nodejs/node/pull/52971/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/53019/, https://github.com/nodejs/node/pull/52973/, https://github.com/nodejs/node/pull/52951/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-ibm-rhel8-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59202/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59254/
Example ``` not ok 1430 parallel/test-buffer-tostring-rangeerror --- duration_ms: 120090.05600 severity: fail exitcode: -15 stack: |- timeout (node:2939220) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead. (Use `node --trace-deprecation ...` to show where the warning was created) ... ```

Reason parallel/test-pipe-file-to-http
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/52954/, https://github.com/nodejs/node/pull/52531/, https://github.com/nodejs/node/pull/52905/, https://github.com/nodejs/node/pull/53000/, https://github.com/nodejs/node/pull/52996/, https://github.com/nodejs/node/pull/52998/)
Appeared test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10
First CI https://ci.nodejs.org/job/node-test-pull-request/59200/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59230/
Example ``` not ok 3828 parallel/test-pipe-file-to-http --- duration_ms: 360112.14200 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-cli-permission-deny-fs
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/31137/, https://github.com/nodejs/node/pull/51805/, https://github.com/nodejs/node/pull/49292/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/47739/)
Appeared test-rackspace-win2019_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59175/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59195/
Example ``` not ok 120 parallel/test-cli-permission-deny-fs --- duration_ms: 1278.00700 severity: fail exitcode: 1 stack: |- C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-permission-deny-fs.js:62 const [fs, fsIn, fsOut] = stdout.toString().split('\n'); ^ TypeError: Cannot read properties of null (reading 'toString') at Object. (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-permission-deny-fs.js:62:36) at Module._compile (node:internal/modules/cjs/loader:1358:14) at Module._extensions..js (node:internal/modules/cjs/loader:1416:10) at Module.load (node:internal/modules/cjs/loader:1208:32) at Module._load (node:internal/modules/cjs/loader:1024:12) at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:174:12) at node:internal/main/run_main_module:28:49 Node.js v20.13.2-pre ... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/52993/, https://github.com/nodejs/node/pull/52905/)
Appeared test-digitalocean-ubi81_container-x64-1, test-digitalocean-fedora38-x64-1, test-digitalocean-fedora39-x64-1, test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59190/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59247/
Example ``` not ok 76 parallel/test-blob-file-backed --- duration_ms: 296.76100 severity: fail exitcode: 1 stack: |- node:internal/blob:289 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:289:25) Node.js v23.0.0-pre ... ```

Reason parallel/test-http-get-pipeline-problem
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52971/, https://github.com/nodejs/node/pull/53028/, https://github.com/nodejs/node/pull/52762/)
Appeared test-azure_msft-win2016_vs2017-x64-2, test-rackspace-win2016_vs2015-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59221/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59265/
Example ``` not ok 351 parallel/test-http-get-pipeline-problem --- duration_ms: 326.00000 severity: fail exitcode: 3221226505 stack: |- image.length = 45658 recv 0 done 0 recv 1 done 1 recv 2 done 2 recv 3 done 3 recv 4 done 4 recv 5 done 5 recv 6 done 6 recv 7 done 7 recv 8 ... ```

Reason benchmark/test-benchmark-http2
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52993/, https://github.com/nodejs/node/pull/53028/)
Appeared test-azure_msft-win2016_vs2017-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59220/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59252/
Example ``` not ok 184 benchmark/test-benchmark-http2 --- duration_ms: 2059.05700 severity: fail exitcode: 1 stack: |- Error: test-double-http2 failed with 3221226505. at ChildProcess. (C:\workspace\node-test-binary-windows-native-suites\node\benchmark\_http-benchmarkers.js:251:16) at Object.onceWrapper (node:events:632:26) at ChildProcess.emit (node:events:517:28) at maybeClose (node:internal/child_process:1098:16) at ChildProcess._handle.onexit (node:internal/child_process:303:5) node:assert:125 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 3221226505 !== 0 at ChildProcess. (C:\workspace\node-test-binary-windows-native-suites\node\test\common\benchmark.js:28:12) at ChildProcess.emit (node:events:517:28) at ChildProcess._handle.onexit (node:internal/child_process:292:12) { generatedMessage: true, code: 'ERR_ASSERTIO... ```

Reason parallel/test-fs-stat-bigint
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52993/, https://github.com/nodejs/node/pull/52974/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/59237/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59255/
Example ``` not ok 1302 parallel/test-fs-stat-bigint --- duration_ms: 262.84500 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ AssertionError [ERR_ASSERTION]: Number version atimeMs = 1715890307803.3796, BigInt version atimeMs = 1715890307803n, Allowable delta = 0 at verifyStats (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-fs-stat-bigint.js:70:7) at runSyncTest (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-fs-stat-bigint.js:102:3) at Object. (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-fs-stat-bigint.js:120:3) at Module._compile (node:internal/modules/cjs/loader:1434:14) at Object..js (node:internal/modules/cjs/loader:1518:10) at Module.load (node:internal/modules/cjs/loader:1249:32) at Function._load (node:... ```

Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53032/, https://github.com/nodejs/node/pull/53002/)
Appeared test-ibm-rhel8-x64-2, test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59262/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59266/
Example ``` not ok 2391 parallel/test-performance-function --- duration_ms: 178.16100 severity: fail exitcode: 1 stack: |- node:internal/histogram:291 validateInteger(val, 'val', 1); ^ RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0 at RecordableHistogram.record (node:internal/histogram:291:5) at processComplete (node:internal/perf/timerify:40:15) at timerified m (node:internal/perf/timerify:87:5) at /home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-function.js:103:5 { code: 'ERR_OUT_OF_RANGE' } Node.js v23.0.0-pre ... ```

Reason parallel/test-timers-immediate-queue
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52531/, https://github.com/nodejs/node/pull/52848/)
Appeared test-digitalocean-fedora38-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59216/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59253/
Example ``` not ok 3018 parallel/test-timers-immediate-queue --- duration_ms: 143.96000 severity: fail exitcode: 1 stack: |- hit 140 node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 140 !== 10 at process. (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-timers-immediate-queue.js:56:10) at process.emit (node:events:532:35) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 140, expected: 10, operator: 'strictEqual' } Node.js v23.0.0-pre ... ```

Reason parallel/test-tls-socket-close
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52971/, https://github.com/nodejs/node/pull/53019/)
Appeared test-azure_msft-win10_vs2019-x64-4, test-azure_msft-win11_vs2022-x64-3, test-rackspace-win2016_vs2015-x64-1, test-rackspace-win2019_vs2019-x64-3, test-rackspace-win2022_vs2022-x64-1, test-azure_msft-win11_vs2022-arm64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/59221/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59241/
Example ``` not ok 802 parallel/test-tls-socket-close --- duration_ms: 224.00300 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: false !== true at Immediate._onImmediate (c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-tls-socket-close.js:65:16) at process.processImmediate (node:internal/timers:478:21) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: 'strictEqual' } Node.js v23.0.0-pre ... ```

Reason wpt/test-compression
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52905/, https://github.com/nodejs/node/pull/52951/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59217/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59254/
Example ``` not ok 4072 wpt/test-compression --- duration_ms: 1440063.57000 severity: fail exitcode: -15 stack: |- timeout [SKIPPED] compression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] decompression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] decompression-buffersource.tentative.any.js: ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] idlharness-shadowrealm.window.js: ShadowRealm support is not enabled [SKIPPED] third_party/pako/pako_inflate.min.js: This is not a test file. [PASS] "a" should cause the constructor to throw [PASS] no input should cause the constructor to throw [PASS] non-string input should cause the constructor to throw [PASS] "a" should cause the constructor to throw [PASS] no inpu... ```

Progress