nodejs / reliability

Make the CI green again
34 stars 10 forks source link

CI Reliability 2024-06-26 #907

Open github-actions[bot] opened 1 month ago

github-actions[bot] commented 1 month ago

Failures in node-test-pull-request/59870 to node-test-pull-request/59967 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-06-26 00:08 2 8 26 6 58 8.70%

JSTest Failure

Reason parallel/test-snapshot-reproducible
Type JS_TEST_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/53239/, https://github.com/nodejs/node/pull/53488/, https://github.com/nodejs/node/pull/52206/, https://github.com/nodejs/node/pull/53537/, https://github.com/nodejs/node/pull/52908/, https://github.com/nodejs/node/pull/53563/, https://github.com/nodejs/node/pull/53044/, https://github.com/nodejs/node/pull/53580/, https://github.com/nodejs/node/pull/53583/)
Appeared test-rackspace-win2016_vs2015-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-ibm-rhel8-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59898/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59963/
Example ``` not ok 699 parallel/test-snapshot-reproducible --- duration_ms: 1826.99600 severity: fail exitcode: 1 stack: |- 0x0: Write magic 143da19 0x4: Write metadata 0x28: Write snapshot blob 0x136807: Write IsolateDataSerializeInfo 0x1374a3: Write EnvSerializeInfo 0x1380fc: Write CodeCacheInfo 0x0: Write magic 143da19 0x4: Write metadata 0x28: Write snapshot blob 0x136807: Write IsolateDataSerializeInfo 0x1374a3: Write EnvSerializeInfo 0x1380fc: Write CodeCacheInfo node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal: + actual - expected ... Lines skipped + [ + { + offset: '0x30', + slice1: '01000000c884e0bf6f98b72031322e34', + slice2: '01000000c18bb4066f98b72031322e34' + }, + { + offset: '0xd1620', + slice1: '016700000000080000003800380c0100', + slice2: '016700000000080000003800b00b0100' ... ```

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/53107/, https://github.com/nodejs/node/pull/53413/, https://github.com/nodejs/node/pull/53411/, https://github.com/nodejs/node/pull/53517/, https://github.com/nodejs/node/pull/53554/, https://github.com/nodejs/node/pull/53555/, https://github.com/nodejs/node/pull/53585/)
Appeared test-orka-macos10.15-x64-1, test-orka-macos11-x64-2, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59880/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59965/
Example ``` not ok 4084 sequential/test-http-server-request-timeouts-mixed --- duration_ms: 3239.87500 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(request2.completed) at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/sequential/test-http-server-request-timeouts-mixed.js:108:5) at listOnTimeout (node:internal/timers:573:17) at process.processTimers (node:internal/timers:514:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v20.15.1-pre ... ```

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53475/, https://github.com/nodejs/node/pull/44340/, https://github.com/nodejs/node/pull/53540/, https://github.com/nodejs/node/pull/53555/)
Appeared test-ibm-alpine319_container-x64-1, test-osuosl-rhel8-ppc64_le-4, test-osuosl-aix72-ppc64_be-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59871/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59936/
Example ``` not ok 4025 benchmark/test-benchmark-crypto --- duration_ms: 3419.23600 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at main (/home/iojs/build/workspace/node-test-commit-linux/benchmark/crypto/timingSafeEqual.js:21:10) at /home/iojs/build/workspace/node-test-commit-linux/benchmark/common.js:54:9 at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 1, expected: 0, operator: 'strictEqual' } Node.js v23.0.0-pre node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at ChildProcess. (/home/iojs/build/workspace/node-test-commit-linux/test/common/benchmark.js:28:12) a... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53550/, https://github.com/nodejs/node/pull/53495/, https://github.com/nodejs/node/pull/53044/, https://github.com/nodejs/node/pull/53580/)
Appeared test-digitalocean-fedora38-x64-2, test-azure_msft-win11_vs2022-x64-2, test-digitalocean-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59870/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59967/
Example ``` not ok 343 parallel/test-blob-file-backed --- duration_ms: 138.91400 severity: fail exitcode: 1 stack: |- node:internal/blob:290 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:290:25) Node.js v23.0.0-pre ... ```

Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/44340/, https://github.com/nodejs/node/pull/53517/, https://github.com/nodejs/node/pull/52881/, https://github.com/nodejs/node/pull/53457/)
Appeared undefined, test-ibm-ubuntu2204-x64-2, test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59887/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59954/
Example ``` not ok 2452 parallel/test-performance-function --- duration_ms: 411.06100 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0 at RecordableHistogram.record (node:internal/histogram:291:5) at processComplete (node:internal/perf/timerify:40:15) at timerified m (node:internal/perf/timerify:87:5) at /home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-function.js:103:5 { code: 'ERR_OUT_OF_RANGE' } Node.js v23.0.0-pre ... ```

Reason sequential/test-module-loading
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/44340/, https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53413/, https://github.com/nodejs/node/pull/53107/)
Appeared test-rackspace-win2016_vs2015-x64-1, test-azure_msft-win11_vs2022-arm64-2, test-orka-macos10.15-x64-1, test-azure_msft-win10_vs2019-x64-1, test-azure_msft-win11_vs2022-x64-1, test-azure_msft-win2016_vs2017-x64-2, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2022_vs2022-x64-3, test-digitalocean-alpine318_container-x64-1, test-rackspace-debian10-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59872/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59881/
Example ``` not ok 969 sequential/test-module-loading --- duration_ms: 226.99900 severity: fail exitcode: 1 stack: |- b/c.js exit load test-module-loading.js load fixtures/b/d.js load package/index.js load fixtures/b/c.js load fixtures/a.js test index.js modules ids and relative loading test index.js in a folder with a trailing slash node:assert:758 throw err; ^ AssertionError [ERR_ASSERTION]: The input did not match the regular expression /^SyntaxError: Error parsing/. Input: 'Error: Invalid package config C:\\workspace\\node-test-binary-windows-js-suites\\node\\test\\fixtures\\packages\\unparseable\\package.json.' at Object. (C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-module-loading.js:129:8) at Module._compile (node:internal/modules/cjs/loader:1357:14) at Module._extensions..js (node:internal/modules/cjs/loader:1415:10) at Module.load (node:internal/modules/cjs/... ```

Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53539/, https://github.com/nodejs/node/pull/53558/, https://github.com/nodejs/node/pull/53580/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-alpine319_container-x64-1, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59917/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59967/
Example ``` not ok 2909 parallel/test-http2-large-write-multiple-requests --- duration_ms: 120078.37600 severity: fail exitcode: -15 stack: |- timeout server sends content 1 server sends content 2 server sends content 3 server sends content 4 server sends content 5 server sends content 6 server sends content 7 server sends content 8 server sends content 9 server sends content 10 server sends content 11 server sends content 12 server sends content 13 server sends content 14 server sends content 15 server sends content 16 server sends content 17 server sends content 18 server sends content 19 server sends content 20 server sends content 21 server sends content 22 server sends content 23 server sends content 24 server sends content 25 server sends content 26 server sends content 27 server sends content 28 server sends content 29 server sends content 30 server sends content 31 server s... ```

Reason parallel/test-module-loading-globalpaths
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52908/, https://github.com/nodejs/node/pull/53555/)
Appeared test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59955/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59961/
Example ``` not ok 1922 parallel/test-module-loading-globalpaths --- duration_ms: 6636.14200 severity: fail exitcode: 1 stack: |- node:fs:2987 binding.copyFile( ^ Error: ENOSPC: no space left on device, copyfile '/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/out/Release/node' -> '/Users/iojs/node-tmp/.tmp.1899/install/bin/node' at Object.copyFileSync (node:fs:2987:11) at Object. (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/parallel/test-module-loading-globalpaths.js:32:6) at Module._compile (node:internal/modules/cjs/loader:1467:14) at Module._extensions..js (node:internal/modules/cjs/loader:1551:10) at Module.load (node:internal/modules/cjs/loader:1282:32) at Module._load (node:internal/modules/cjs/loader:1098:12) at TracingChannel.traceSync (node:diagnostics_channel:315:14) at wrapModuleLoad (node:internal/modules/cjs/loader:215:24) at Function.execut... ```

Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53488/)
Appeared test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59870/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59925/
Example ``` not ok 3816 parallel/test-net-write-fully-async-buffer --- duration_ms: 300143.44400 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-performance-eventlooputil
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52908/, https://github.com/nodejs/node/pull/53585/)
Appeared test-ibm-rhel8-x64-1, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/59913/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59965/
Example ``` not ok 2398 parallel/test-performance-eventlooputil --- duration_ms: 420.92100 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ AssertionError [ERR_ASSERTION]: 92.5383071899414 < 92.53830734783935 at Timeout.runCalcTest (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-eventlooputil.js:85:10) at Timeout.runCalcTest [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:487:15) at listOnTimeout (node:internal/timers:583:11) at process.processTimers (node:internal/timers:519:7) { generatedMessage: false, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason sequential/test-performance-eventloopdelay
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53540/, https://github.com/nodejs/node/pull/53545/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/59918/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59923/
Example ``` not ok 4139 sequential/test-performance-eventloopdelay --- duration_ms: 7225.76200 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(histogram.min > 0) at Timeout.spinAWhile [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linux-containered/test/sequential/test-performance-eventloopdelay.js:65:7) at listOnTimeout (node:internal/timers:581:17) at process.processTimers (node:internal/timers:519:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Jenkins Failure

Reason Build timed out (after 30 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/53107/, https://github.com/nodejs/node/pull/53511/, https://github.com/nodejs/node/pull/53239/, https://github.com/nodejs/node/pull/52908/, https://github.com/nodejs/node/pull/53537/, https://github.com/nodejs/node/pull/53488/)
Appeared test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2019_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59881/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59926/
Example ``` Build timed out (after 30 minutes). Marking the build as failed. ```

Build Failure

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53488/, https://github.com/nodejs/node/pull/53550/)
Appeared test-mnx-smartos21-x64-2, test-mnx-smartos23-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59870/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59928/
Example ``` ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Collecting metadata... Metadata collection done. Notifying upstream projects of job completion Finished: FAILURE ```

Reason fatal error: /Library/Developer/CommandLineTools/usr/bin/libtool: can't write to output file (No space left on device)
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53413/, https://github.com/nodejs/node/pull/53107/)
Appeared test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59875/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59881/
Example ``` fatal error: /Library/Developer/CommandLineTools/usr/bin/libtool: can't write to output file (No space left on device) ```

Reason fatal error: Killed signal terminated program cc1plus
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53522/, https://github.com/nodejs/node/pull/52206/, https://github.com/nodejs/node/pull/53044/)
Appeared test-rackspace-fedora32-x64-1, test-digitalocean-alpine319_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-digitalocean-rhel8_arm_cross_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59908/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59959/
Example ``` fatal error: Killed signal terminated program cc1plus ```

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53475/, https://github.com/nodejs/node/pull/53495/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59870/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59878/
Example ``` fatal: No rebase in progress? ```

Reason ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53457/, https://github.com/nodejs/node/pull/53495/)
Appeared test-rackspace-fedora32-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59954/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59964/
Example ``` ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for node-test-commit-linux/nodes=fedora-last-latest-x64 #58578 Collecting metadata... Metadata collection done. Notifying upstream projects of job completion Finished: FAILURE ```

Progress