nodejs / reliability

Make the CI green again
35 stars 11 forks source link

CI Reliability 2024-05-17 #867

Open github-actions[bot] opened 3 months ago

github-actions[bot] commented 3 months ago

Failures in node-test-pull-request/59162 to node-test-pull-request/59255 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-05-17 00:08 2 14 23 3 58 14.74%

Jenkins Failure

Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/52881/, https://github.com/nodejs/node/pull/52951/, https://github.com/nodejs/node/pull/52997/, https://github.com/nodejs/node/pull/52974/)
Appeared test-rackspace-win2022_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59212/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59255/
Example ``` Build timed out (after 60 minutes). Marking the build as failed. ```

CCTest Failure

Reason C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected)
Type CC_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52993/, https://github.com/nodejs/node/pull/53000/)
Appeared test-azure_msft-win11_vs2022-x64-1, test-rackspace-win2022_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59220/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59226/
Example ``` C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected) Actual: true Expected: false [ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (5002 ms) ```

Build Failure

Reason error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
Type BUILD_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/51575/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/52829/, https://github.com/nodejs/node/pull/52990/, https://github.com/nodejs/node/pull/53020/, https://github.com/nodejs/node/pull/52905/, https://github.com/nodejs/node/pull/52848/, https://github.com/nodejs/node/pull/52951/)
Appeared test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2022_vs2022-x64-4, test-rackspace-win2022_vs2022-x64-3, test-rackspace-win2022_vs2022-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59180/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59254/
Example ``` error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] string-startswith-tq-csa.cc string-slice-tq-csa.cc string-repeat-tq-csa.cc string-pad-tq-csa.cc ```

Reason ERROR: No files found with the specified search criteria.
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52531/, https://github.com/nodejs/node/pull/52990/)
Appeared test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59216/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59219/
Example ``` ERROR: No files found with the specified search criteria. 1 file(s) copied. > set DEBUG_HELPER=1 > call vcbuild.bat arm64 release msi ```

Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52974/, https://github.com/nodejs/node/pull/52980/)
Appeared test-equinix-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59208/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59209/
Example ``` Failed to trigger node-test-commit ```

JSTest Failure

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/52443/, https://github.com/nodejs/node/pull/52948/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/51463/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/53014/, https://github.com/nodejs/node/pull/53020/, https://github.com/nodejs/node/pull/53019/, https://github.com/nodejs/node/pull/52905/)
Appeared test-softlayer-debian12-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204-x64-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win11_vs2022-x64-4, test-osuosl-debian11_container-armv7l-1, test-ibm-rhel8-s390x-4, test-ibm-ubuntu2204_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59162/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59247/
Example ``` not ok 4006 benchmark/test-benchmark-crypto --- duration_ms: 4017.29800 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at main (/home/iojs/build/workspace/node-test-commit-linux/benchmark/crypto/timingSafeEqual.js:21:10) at /home/iojs/build/workspace/node-test-commit-linux/benchmark/common.js:54:9 at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 1, expected: 0, operator: 'strictEqual' } Node.js v23.0.0-pre node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at ChildProcess. (/home/iojs/build/workspace/node-test-commit-linux/test/common/benchmark.js:28:12) a... ```

Reason parallel/test-buffer-tostring-rangeerror
Type JS_TEST_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/52443/, https://github.com/nodejs/node/pull/52946/, https://github.com/nodejs/node/pull/52966/, https://github.com/nodejs/node/pull/52971/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/53019/, https://github.com/nodejs/node/pull/52973/, https://github.com/nodejs/node/pull/52951/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-ibm-rhel8-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59162/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59254/
Example ``` not ok 1430 parallel/test-buffer-tostring-rangeerror --- duration_ms: 120090.05600 severity: fail exitcode: -15 stack: |- timeout (node:2939220) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead. (Use `node --trace-deprecation ...` to show where the warning was created) ... ```

Reason parallel/test-pipe-file-to-http
Type JS_TEST_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/52946/, https://github.com/nodejs/node/pull/49292/, https://github.com/nodejs/node/pull/52954/, https://github.com/nodejs/node/pull/52531/, https://github.com/nodejs/node/pull/52905/, https://github.com/nodejs/node/pull/53000/, https://github.com/nodejs/node/pull/52996/, https://github.com/nodejs/node/pull/52998/)
Appeared test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-osuosl-ubuntu2004_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59168/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59230/
Example ``` not ok 3828 parallel/test-pipe-file-to-http --- duration_ms: 360112.14200 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-cli-node-options
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/31137/, https://github.com/nodejs/node/pull/51805/, https://github.com/nodejs/node/pull/49292/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/47739/, https://github.com/nodejs/node/pull/52971/)
Appeared test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2019_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59175/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59221/
Example ``` not ok 131 parallel/test-cli-node-options --- duration_ms: 1314.00600 severity: crashed exitcode: 3221225477 stack: |- ... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/52870/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/52980/, https://github.com/nodejs/node/pull/52993/, https://github.com/nodejs/node/pull/52905/)
Appeared test-digitalocean-ubi81_container-x64-1, test-digitalocean-fedora38-x64-1, test-digitalocean-fedora39-x64-1, test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59167/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59247/
Example ``` not ok 76 parallel/test-blob-file-backed --- duration_ms: 296.76100 severity: fail exitcode: 1 stack: |- node:internal/blob:289 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:289:25) Node.js v23.0.0-pre ... ```

Reason parallel/test-cli-permission-deny-fs
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/31137/, https://github.com/nodejs/node/pull/51805/, https://github.com/nodejs/node/pull/49292/, https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/47739/)
Appeared test-rackspace-win2019_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59175/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59195/
Example ``` not ok 120 parallel/test-cli-permission-deny-fs --- duration_ms: 1278.00700 severity: fail exitcode: 1 stack: |- C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-permission-deny-fs.js:62 const [fs, fsIn, fsOut] = stdout.toString().split('\n'); ^ TypeError: Cannot read properties of null (reading 'toString') at Object. (C:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-cli-permission-deny-fs.js:62:36) at Module._compile (node:internal/modules/cjs/loader:1358:14) at Module._extensions..js (node:internal/modules/cjs/loader:1416:10) at Module.load (node:internal/modules/cjs/loader:1208:32) at Module._load (node:internal/modules/cjs/loader:1024:12) at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:174:12) at node:internal/main/run_main_module:28:49 Node.js v20.13.2-pre ... ```

Reason benchmark/test-benchmark-http2
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52949/, https://github.com/nodejs/node/pull/52993/, https://github.com/nodejs/node/pull/53028/)
Appeared test-azure_msft-win2016_vs2017-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59169/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59252/
Example ``` not ok 184 benchmark/test-benchmark-http2 --- duration_ms: 2059.05700 severity: fail exitcode: 1 stack: |- Error: test-double-http2 failed with 3221226505. at ChildProcess. (C:\workspace\node-test-binary-windows-native-suites\node\benchmark\_http-benchmarkers.js:251:16) at Object.onceWrapper (node:events:632:26) at ChildProcess.emit (node:events:517:28) at maybeClose (node:internal/child_process:1098:16) at ChildProcess._handle.onexit (node:internal/child_process:303:5) node:assert:125 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 3221226505 !== 0 at ChildProcess. (C:\workspace\node-test-binary-windows-native-suites\node\test\common\benchmark.js:28:12) at ChildProcess.emit (node:events:517:28) at ChildProcess._handle.onexit (node:internal/child_process:292:12) { generatedMessage: true, code: 'ERR_ASSERTIO... ```

Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52727/, https://github.com/nodejs/node/pull/52870/, https://github.com/nodejs/node/pull/52993/)
Appeared test-digitalocean-debian12-x64-1, test-digitalocean-rhel9-x64-1, test-equinix-rhel8_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59163/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59237/
Example ``` not ok 2589 parallel/test-net-write-fully-async-buffer --- duration_ms: 120024.76100 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52443/, https://github.com/nodejs/node/pull/52870/, https://github.com/nodejs/node/pull/52949/)
Appeared test-orka-macos11-x64-2, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59162/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59169/
Example ``` not ok 4098 sequential/test-http-server-request-timeouts-mixed --- duration_ms: 3304.70000 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(request2.completed) at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5) at listOnTimeout (node:internal/timers:573:17) at process.processTimers (node:internal/timers:514:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason wpt/test-compression
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52443/, https://github.com/nodejs/node/pull/52905/, https://github.com/nodejs/node/pull/52951/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-rackspace-win2022_vs2022-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/59162/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59254/
Example ``` not ok 4072 wpt/test-compression --- duration_ms: 1440063.57000 severity: fail exitcode: -15 stack: |- timeout [SKIPPED] compression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] decompression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] decompression-buffersource.tentative.any.js: ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] idlharness-shadowrealm.window.js: ShadowRealm support is not enabled [SKIPPED] third_party/pako/pako_inflate.min.js: This is not a test file. [PASS] "a" should cause the constructor to throw [PASS] no input should cause the constructor to throw [PASS] non-string input should cause the constructor to throw [PASS] "a" should cause the constructor to throw [PASS] no inpu... ```

Reason parallel/test-fs-stat-bigint
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52993/, https://github.com/nodejs/node/pull/52974/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/59237/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59255/
Example ``` not ok 1302 parallel/test-fs-stat-bigint --- duration_ms: 262.84500 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ AssertionError [ERR_ASSERTION]: Number version atimeMs = 1715890307803.3796, BigInt version atimeMs = 1715890307803n, Allowable delta = 0 at verifyStats (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-fs-stat-bigint.js:70:7) at runSyncTest (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-fs-stat-bigint.js:102:3) at Object. (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-fs-stat-bigint.js:120:3) at Module._compile (node:internal/modules/cjs/loader:1434:14) at Object..js (node:internal/modules/cjs/loader:1518:10) at Module.load (node:internal/modules/cjs/loader:1249:32) at Function._load (node:... ```

Reason parallel/test-timers-immediate-queue
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52531/, https://github.com/nodejs/node/pull/52848/)
Appeared test-digitalocean-fedora38-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59216/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59253/
Example ``` not ok 3018 parallel/test-timers-immediate-queue --- duration_ms: 143.96000 severity: fail exitcode: 1 stack: |- hit 140 node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 140 !== 10 at process. (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-timers-immediate-queue.js:56:10) at process.emit (node:events:532:35) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 140, expected: 10, operator: 'strictEqual' } Node.js v23.0.0-pre ... ```

Reason parallel/test-tls-socket-close
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52971/, https://github.com/nodejs/node/pull/53019/)
Appeared test-azure_msft-win10_vs2019-x64-4, test-azure_msft-win11_vs2022-x64-3, test-rackspace-win2016_vs2015-x64-1, test-rackspace-win2019_vs2019-x64-3, test-rackspace-win2022_vs2022-x64-1, test-azure_msft-win11_vs2022-arm64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/59221/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59241/
Example ``` not ok 802 parallel/test-tls-socket-close --- duration_ms: 224.00300 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: false !== true at Immediate._onImmediate (c:\workspace\node-test-binary-windows-js-suites\node\test\parallel\test-tls-socket-close.js:65:16) at process.processImmediate (node:internal/timers:478:21) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: 'strictEqual' } Node.js v23.0.0-pre ... ```

Progress