nodejs / reliability

Make the CI green again
34 stars 10 forks source link

CI Reliability 2024-06-28 #909

Open github-actions[bot] opened 1 month ago

github-actions[bot] commented 1 month ago

Failures in node-test-pull-request/59908 to node-test-pull-request/59999 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-06-28 00:08 1 5 30 5 59 5.32%

JSTest Failure

Reason parallel/test-snapshot-reproducible
Type JS_TEST_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/53488/, https://github.com/nodejs/node/pull/52206/, https://github.com/nodejs/node/pull/52908/, https://github.com/nodejs/node/pull/53563/, https://github.com/nodejs/node/pull/53044/, https://github.com/nodejs/node/pull/53580/, https://github.com/nodejs/node/pull/53583/, https://github.com/nodejs/node/pull/53537/)
Appeared test-rackspace-win2016_vs2015-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59946/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59969/
Example ``` not ok 698 parallel/test-snapshot-reproducible --- duration_ms: 1811.99400 severity: fail exitcode: 1 stack: |- 0x0: Write magic 143da19 0x4: Write metadata 0x2c: Write snapshot blob 0x13662b: Write IsolateDataSerializeInfo 0x1372c7: Write EnvSerializeInfo 0x137ef0: Write CodeCacheInfo 0x0: Write magic 143da19 0x4: Write metadata 0x2c: Write snapshot blob 0x13662b: Write IsolateDataSerializeInfo 0x1372c7: Write EnvSerializeInfo 0x137ef0: Write CodeCacheInfo node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal: + actual - expected ... Lines skipped + [ + { + offset: '0x30', + slice1: '040000000100000045d4e69b6f98b720', + slice2: '040000000100000035d555776f98b720' + }, + { + offset: '0xd1510', + slice1: '00200c01000000020000000000000000', + slice2: '00300c01000000020000000000000000' ... ```

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/53517/, https://github.com/nodejs/node/pull/53554/, https://github.com/nodejs/node/pull/53555/, https://github.com/nodejs/node/pull/53585/, https://github.com/nodejs/node/pull/53583/, https://github.com/nodejs/node/pull/53553/, https://github.com/nodejs/node/pull/53601/)
Appeared test-orka-macos11-x64-2, test-orka-macos10.15-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59910/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59993/
Example ``` not ok 4123 sequential/test-http-server-request-timeouts-mixed --- duration_ms: 3295.17900 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(request2.completed) at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5) at listOnTimeout (node:internal/timers:581:17) at process.processTimers (node:internal/timers:519:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53540/, https://github.com/nodejs/node/pull/53555/, https://github.com/nodejs/node/pull/53592/, https://github.com/nodejs/node/pull/53590/)
Appeared test-digitalocean-fedora38-x64-2, test-digitalocean-debian12-x64-1, test-ibm-alpine319_container-x64-1, test-osuosl-rhel8-ppc64_le-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59918/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59986/
Example ``` not ok 4025 benchmark/test-benchmark-crypto --- duration_ms: 2326.26500 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at main (/home/iojs/build/workspace/node-test-commit-linux/benchmark/crypto/timingSafeEqual.js:21:10) at /home/iojs/build/workspace/node-test-commit-linux/benchmark/common.js:54:9 at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 1, expected: 0, operator: 'strictEqual' } Node.js v23.0.0-pre node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at ChildProcess. (/home/iojs/build/workspace/node-test-commit-linux/test/common/benchmark.js:28:12) a... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53550/, https://github.com/nodejs/node/pull/53495/, https://github.com/nodejs/node/pull/53044/, https://github.com/nodejs/node/pull/53580/)
Appeared test-digitalocean-fedora38-x64-2, test-azure_msft-win11_vs2022-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59928/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59967/
Example ``` not ok 343 parallel/test-blob-file-backed --- duration_ms: 138.91400 severity: fail exitcode: 1 stack: |- node:internal/blob:290 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:290:25) Node.js v23.0.0-pre ... ```

Reason parallel/test-module-loading-globalpaths
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/52908/, https://github.com/nodejs/node/pull/53555/, https://github.com/nodejs/node/pull/53583/, https://github.com/nodejs/node/pull/53553/)
Appeared test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59955/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59978/
Example ``` not ok 1913 parallel/test-module-loading-globalpaths --- duration_ms: 4192.72700 severity: fail exitcode: 1 stack: |- node:fs:2987 binding.copyFile( ^ Error: ENOSPC: no space left on device, copyfile '/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/out/Release/node' -> '/Users/iojs/node-tmp/.tmp.1899/install/bin/node' at Object.copyFileSync (node:fs:2987:11) at Object. (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-module-loading-globalpaths.js:32:6) at Module._compile (node:internal/modules/cjs/loader:1467:14) at Module._extensions..js (node:internal/modules/cjs/loader:1551:10) at Module.load (node:internal/modules/cjs/loader:1282:32) at Module._load (node:internal/modules/cjs/loader:1098:12) at TracingChannel.traceSync (node:diagnostics_channel:315:14) at wrapModuleLoad (node:internal/modules/cjs/loader:215:24) at Function.execut... ```

Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53539/, https://github.com/nodejs/node/pull/53558/, https://github.com/nodejs/node/pull/53580/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-alpine319_container-x64-1, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59917/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59967/
Example ``` not ok 2909 parallel/test-http2-large-write-multiple-requests --- duration_ms: 120078.37600 severity: fail exitcode: -15 stack: |- timeout server sends content 1 server sends content 2 server sends content 3 server sends content 4 server sends content 5 server sends content 6 server sends content 7 server sends content 8 server sends content 9 server sends content 10 server sends content 11 server sends content 12 server sends content 13 server sends content 14 server sends content 15 server sends content 16 server sends content 17 server sends content 18 server sends content 19 server sends content 20 server sends content 21 server sends content 22 server sends content 23 server sends content 24 server sends content 25 server sends content 26 server sends content 27 server sends content 28 server sends content 29 server sends content 30 server sends content 31 server s... ```

Reason parallel/test-macos-app-sandbox
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53563/, https://github.com/nodejs/node/pull/53583/, https://github.com/nodejs/node/pull/53553/)
Appeared test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59957/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59979/
Example ``` not ok 1921 parallel/test-macos-app-sandbox --- duration_ms: 7256.83800 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at Object. (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-macos-app-sandbox.js:47:8) at Module._compile (node:internal/modules/cjs/loader:1467:14) at Module._extensions..js (node:internal/modules/cjs/loader:1551:10) at Module.load (node:internal/modules/cjs/loader:1282:32) at Module._load (node:internal/modules/cjs/loader:1098:12) at TracingChannel.traceSync (node:diagnostics_channel:315:14) at wrapModuleLoad (node:internal/modules/cjs/loader:215:24) at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:158:5) at node:internal/main/run_main_module:30:49 { generatedMessage: true, ... ```

Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53517/, https://github.com/nodejs/node/pull/52881/, https://github.com/nodejs/node/pull/53457/)
Appeared undefined, test-ibm-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59910/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59954/
Example ``` not ok 2452 parallel/test-performance-function --- duration_ms: 411.06100 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0 at RecordableHistogram.record (node:internal/histogram:291:5) at processComplete (node:internal/perf/timerify:40:15) at timerified m (node:internal/perf/timerify:87:5) at /home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-function.js:103:5 { code: 'ERR_OUT_OF_RANGE' } Node.js v23.0.0-pre ... ```

Reason parallel/test-assert-esm-cjs-message-verify
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53583/, https://github.com/nodejs/node/pull/53537/)
Appeared test-azure_msft-win11_vs2022-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59963/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59969/
Example ``` not ok 76 parallel/test-assert-esm-cjs-message-verify --- duration_ms: 841.00800 severity: fail exitcode: 1 stack: |- TAP version 13 # Subtest: ensure the assert.ok throwing similar error messages for esm and cjs files # Subtest: should return code 1 for each command ok 1 - should return code 1 for each command --- duration_ms: 438.632 ... ```

Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53488/, https://github.com/nodejs/node/pull/53592/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59925/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59971/
Example ``` not ok 3812 parallel/test-net-write-fully-async-buffer --- duration_ms: 300105.00800 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-performance-eventlooputil
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52908/, https://github.com/nodejs/node/pull/53585/)
Appeared test-ibm-rhel8-x64-1, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/59913/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59965/
Example ``` not ok 2398 parallel/test-performance-eventlooputil --- duration_ms: 420.92100 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ AssertionError [ERR_ASSERTION]: 92.5383071899414 < 92.53830734783935 at Timeout.runCalcTest (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-eventlooputil.js:85:10) at Timeout.runCalcTest [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:487:15) at listOnTimeout (node:internal/timers:583:11) at process.processTimers (node:internal/timers:519:7) { generatedMessage: false, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason sequential/test-performance-eventloopdelay
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53540/, https://github.com/nodejs/node/pull/53545/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/59918/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59923/
Example ``` not ok 4139 sequential/test-performance-eventloopdelay --- duration_ms: 7225.76200 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(histogram.min > 0) at Timeout.spinAWhile [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linux-containered/test/sequential/test-performance-eventloopdelay.js:65:7) at listOnTimeout (node:internal/timers:581:17) at process.processTimers (node:internal/timers:519:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason sequential/test-single-executable-application-empty
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53583/, https://github.com/nodejs/node/pull/53553/)
Appeared test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59975/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59979/
Example ``` not ok 4161 sequential/test-single-executable-application-empty --- duration_ms: 17380.50400 severity: fail exitcode: 1 stack: |- Copied /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/out/Release/node to /Users/iojs/node-tmp/.tmp.4160/sea Injected /Users/iojs/node-tmp/.tmp.4160/sea-prep.blob into /Users/iojs/node-tmp/.tmp.4160/sea [process 77902]: --- stderr --- error: /Library/Developer/CommandLineTools/usr/bin/codesign_allocate: can't write output file: /Users/iojs/node-tmp/.tmp.4160/sea.cstemp (No space left on device) /Users/iojs/node-tmp/.tmp.4160/sea: the codesign_allocate helper tool cannot be found or used [process 77902]: --- stdout --- [process 77902]: status = 1, signal = null /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-single-executable-application-empty.js:53 throw e; ^ Error: Cannot sign /Users/iojs/node-tmp/.tmp.4160/sea: Error: - process terminated with status 1,... ```

Jenkins Failure

Reason Build timed out (after 30 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52908/, https://github.com/nodejs/node/pull/53537/, https://github.com/nodejs/node/pull/53488/)
Appeared test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2019_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59912/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59926/
Example ``` Build timed out (after 30 minutes). Marking the build as failed. ```

Build Failure

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53488/, https://github.com/nodejs/node/pull/53550/, https://github.com/nodejs/node/pull/53592/, https://github.com/nodejs/node/pull/53596/)
Appeared test-mnx-smartos21-x64-2, test-mnx-smartos23-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59925/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59997/
Example ``` ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Collecting metadata... Metadata collection done. Notifying upstream projects of job completion Finished: FAILURE ```

Reason fatal error: Killed signal terminated program cc1plus
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53522/, https://github.com/nodejs/node/pull/52206/, https://github.com/nodejs/node/pull/53044/)
Appeared test-rackspace-fedora32-x64-1, test-digitalocean-alpine319_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-digitalocean-rhel8_arm_cross_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59908/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59959/
Example ``` fatal error: Killed signal terminated program cc1plus ```

Reason ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53457/, https://github.com/nodejs/node/pull/53495/)
Appeared test-rackspace-fedora32-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59954/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59964/
Example ``` ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for node-test-commit-linux/nodes=fedora-last-latest-x64 #58578 Collecting metadata... Metadata collection done. Notifying upstream projects of job completion Finished: FAILURE ```

Reason Failed to trigger node-test-commit
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/59856/, https://github.com/nodejs/node/pull/53614/)
Appeared test-ibm-ubuntu2204-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59973/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59999/
Example ``` Failed to trigger node-test-commit ```

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52955/, https://github.com/nodejs/node/pull/53611/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59988/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59991/
Example ``` fatal: No rebase in progress? ```

Progress