nodejs / reliability

Make the CI green again
34 stars 10 forks source link

CI Reliability 2024-06-24 #905

Open github-actions[bot] opened 1 month ago

github-actions[bot] commented 1 month ago

Failures in node-test-pull-request/59845 to node-test-pull-request/59940 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-06-24 00:09 1 8 24 4 63 8.42%

JSTest Failure

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/53486/, https://github.com/nodejs/node/pull/53107/, https://github.com/nodejs/node/pull/53413/, https://github.com/nodejs/node/pull/53411/, https://github.com/nodejs/node/pull/53517/, https://github.com/nodejs/node/pull/53554/)
Appeared test-orka-macos11-x64-2, test-orka-macos11-x64-1, test-orka-macos10.15-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59867/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59937/
Example ``` not ok 4124 sequential/test-http-server-request-timeouts-mixed --- duration_ms: 3290.75300 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(request2.completed) at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5) at listOnTimeout (node:internal/timers:581:17) at process.processTimers (node:internal/timers:519:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53475/, https://github.com/nodejs/node/pull/44340/, https://github.com/nodejs/node/pull/53540/, https://github.com/nodejs/node/pull/53555/)
Appeared test-ibm-alpine319_container-x64-1, test-osuosl-rhel8-ppc64_le-4, test-osuosl-aix72-ppc64_be-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59871/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59936/
Example ``` not ok 4025 benchmark/test-benchmark-crypto --- duration_ms: 3419.23600 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at main (/home/iojs/build/workspace/node-test-commit-linux/benchmark/crypto/timingSafeEqual.js:21:10) at /home/iojs/build/workspace/node-test-commit-linux/benchmark/common.js:54:9 at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 1, expected: 0, operator: 'strictEqual' } Node.js v23.0.0-pre node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at ChildProcess. (/home/iojs/build/workspace/node-test-commit-linux/test/common/benchmark.js:28:12) a... ```

Reason sequential/test-module-loading
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/44340/, https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53413/, https://github.com/nodejs/node/pull/53107/)
Appeared test-rackspace-win2016_vs2015-x64-1, test-azure_msft-win11_vs2022-arm64-2, test-orka-macos10.15-x64-1, test-azure_msft-win10_vs2019-x64-1, test-azure_msft-win11_vs2022-x64-1, test-azure_msft-win2016_vs2017-x64-2, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2022_vs2022-x64-3, test-digitalocean-alpine318_container-x64-1, test-rackspace-debian10-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59872/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59881/
Example ``` not ok 969 sequential/test-module-loading --- duration_ms: 226.99900 severity: fail exitcode: 1 stack: |- b/c.js exit load test-module-loading.js load fixtures/b/d.js load package/index.js load fixtures/b/c.js load fixtures/a.js test index.js modules ids and relative loading test index.js in a folder with a trailing slash node:assert:758 throw err; ^ AssertionError [ERR_ASSERTION]: The input did not match the regular expression /^SyntaxError: Error parsing/. Input: 'Error: Invalid package config C:\\workspace\\node-test-binary-windows-js-suites\\node\\test\\fixtures\\packages\\unparseable\\package.json.' at Object. (C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-module-loading.js:129:8) at Module._compile (node:internal/modules/cjs/loader:1357:14) at Module._extensions..js (node:internal/modules/cjs/loader:1415:10) at Module.load (node:internal/modules/cjs/... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53550/, https://github.com/nodejs/node/pull/53495/)
Appeared test-digitalocean-fedora38-x64-2, test-digitalocean-ubuntu2204-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59870/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59934/
Example ``` not ok 344 parallel/test-blob-file-backed --- duration_ms: 139.28000 severity: fail exitcode: 1 stack: |- node:internal/blob:290 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:290:25) Node.js v23.0.0-pre ... ```

Reason parallel/test-file-write-stream4
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53468/, https://github.com/nodejs/node/pull/53495/, https://github.com/nodejs/node/pull/44340/)
Appeared test-ibm-alpine319_container-x64-1, test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu2004_container-arm64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59849/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59887/
Example ``` not ok 1712 parallel/test-file-write-stream4 --- duration_ms: 120037.00100 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/44340/, https://github.com/nodejs/node/pull/53517/, https://github.com/nodejs/node/pull/52881/)
Appeared undefined, test-ibm-ubuntu2204-x64-2, test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59887/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59930/
Example ``` not ok 2452 parallel/test-performance-function --- duration_ms: 328.93000 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0 at RecordableHistogram.record (node:internal/histogram:291:5) at processComplete (node:internal/perf/timerify:40:15) at timerified m (node:internal/perf/timerify:87:5) at /home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-function.js:103:5 at runNextTicks (node:internal/process/task_queues:60:5) at listOnTimeout (node:internal/timers:545:9) at process.processTimers (node:internal/timers:519:7) { code: 'ERR_OUT_OF_RANGE' } Node.js v23.0.0-pre ... ```

Reason parallel/test-domain-error-types
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53486/, https://github.com/nodejs/node/pull/53109/)
Appeared test-equinix-ubuntu2004_sharedlibs_container-arm64-3, test-equinix-ubuntu2004_sharedlibs_container-arm64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/59848/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59856/
Example ``` not ok 717 parallel/test-domain-error-types --- duration_ms: 2230.05900 severity: crashed exitcode: -11 stack: |- ... ```

Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53539/, https://github.com/nodejs/node/pull/53558/)
Appeared test-ibm-alpine319_container-x64-1, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59917/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59940/
Example ``` not ok 2786 parallel/test-http2-large-write-multiple-requests --- duration_ms: 120038.96600 severity: fail exitcode: -15 stack: |- timeout server sends content 1 server sends content 2 server sends content 3 server sends content 4 server sends content 5 server sends content 6 server sends content 7 server sends content 8 server sends content 9 server sends content 10 server sends content 11 server sends content 12 server sends content 13 server sends content 14 server sends content 15 server sends content 16 server sends content 17 server sends content 18 server sends content 19 server sends content 20 server sends content 21 server sends content 22 server sends content 23 server sends content 24 server sends content 25 server sends content 26 server sends content 27 server sends content 28 server sends content 29 server sends content 30 server sends content 31 server s... ```

Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53488/)
Appeared test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59870/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59925/
Example ``` not ok 3816 parallel/test-net-write-fully-async-buffer --- duration_ms: 300143.44400 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-runner-output
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53500/, https://github.com/nodejs/node/pull/53511/)
Appeared test-osuosl-aix72-ppc64_be-2, test-digitalocean-freebsd12-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59866/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59892/
Example ``` not ok 2706 parallel/test-runner-output --- duration_ms: 4372.16000 severity: fail exitcode: 1 stack: |- TAP version 13 # Subtest: test runner output # Subtest: test-runner/output/abort.js ok 1 - test-runner/output/abort.js --- duration_ms: 2891.149953 ... ```

Reason parallel/test-snapshot-reproducible
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53239/, https://github.com/nodejs/node/pull/53488/)
Appeared test-ibm-rhel8-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59898/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59939/
Example ``` not ok 2776 parallel/test-snapshot-reproducible --- duration_ms: 1527.56100 severity: fail exitcode: 1 stack: |- 0x0: Write magic 143da19 0x4: Write metadata 0x37: Write snapshot blob 0x173147: Write IsolateDataSerializeInfo 0x174623: Write EnvSerializeInfo 0x1754bc: Write CodeCacheInfo 0x0: Write magic 143da19 0x4: Write metadata 0x37: Write snapshot blob 0x173147: Write IsolateDataSerializeInfo 0x174623: Write EnvSerializeInfo 0x1754bc: Write CodeCacheInfo node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal: + actual - expected + [ + { + offset: '0x40', + slice1: '000000ec648ced821f137731322e342e', + slice2: '0000001a657d2a821f137731322e342e' + }, + { + offset: '0x100ef0', + slice1: '5d44660000000000000000b90331471d', + slice2: '5d44660000000000000000e90131471d' + } + ... ```

Reason sequential/test-performance-eventloopdelay
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53540/, https://github.com/nodejs/node/pull/53545/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/59918/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59923/
Example ``` not ok 4139 sequential/test-performance-eventloopdelay --- duration_ms: 7225.76200 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(histogram.min > 0) at Timeout.spinAWhile [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linux-containered/test/sequential/test-performance-eventloopdelay.js:65:7) at listOnTimeout (node:internal/timers:581:17) at process.processTimers (node:internal/timers:519:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Jenkins Failure

Reason Cannot run program "/bin/sh" (in directory "/home/iojs/build/workspace/node-test-commit-linux"): error=2, No such file or directory
Type JENKINS_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/53465/, https://github.com/nodejs/node/pull/53468/, https://github.com/nodejs/node/pull/53109/, https://github.com/nodejs/node/pull/53486/, https://github.com/nodejs/node/pull/52135/, https://github.com/nodejs/node/pull/53063/, https://github.com/nodejs/node/pull/53475/, https://github.com/nodejs/node/pull/53495/)
Appeared test-ibm-rhel9-x64-1, test-digitalocean-fedora39-x64-1, test-digitalocean-fedora38-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59847/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59862/
Example ``` java.io.IOException: Cannot run program "/bin/sh" (in directory "/home/iojs/build/workspace/node-test-commit-linux"): error=2, No such file or directory at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1143) at java.base/java.lang.ProcessBuilder.start(ProcessBuilder.java:1073) at hudson.Proc$LocalProc.(Proc.java:252) at hudson.Proc$LocalProc.(Proc.java:221) at hudson.Launcher$LocalLauncher.launch(Launcher.java:994) ```

Reason Build timed out (after 30 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/53107/, https://github.com/nodejs/node/pull/53511/, https://github.com/nodejs/node/pull/53239/, https://github.com/nodejs/node/pull/52908/, https://github.com/nodejs/node/pull/53537/, https://github.com/nodejs/node/pull/53488/)
Appeared test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2019_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59881/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59926/
Example ``` Build timed out (after 30 minutes). Marking the build as failed. ```

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53475/, https://github.com/nodejs/node/pull/53522/)
Appeared test-rackspace-fedora32-x64-1, test-digitalocean-fedora38-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59864/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59908/
Example ``` java.io.IOException: Backing channel 'JNLP4-connect connection from 119.9.51.79/119.9.51.79:48336' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285) at jdk.proxy2/jdk.proxy2.$Proxy195.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1212) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1204) ```

Build Failure

Reason fatal error: /Library/Developer/CommandLineTools/usr/bin/libtool: can't write to output file (No space left on device)
Type BUILD_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/53468/, https://github.com/nodejs/node/pull/53475/, https://github.com/nodejs/node/pull/52135/, https://github.com/nodejs/node/pull/53063/, https://github.com/nodejs/node/pull/53495/, https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53413/, https://github.com/nodejs/node/pull/53107/)
Appeared test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59849/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59881/
Example ``` fatal error: /Library/Developer/CommandLineTools/usr/bin/libtool: can't write to output file (No space left on device) ```

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53488/, https://github.com/nodejs/node/pull/53550/)
Appeared test-mnx-smartos21-x64-2, test-mnx-smartos23-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59870/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59928/
Example ``` ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Collecting metadata... Metadata collection done. Notifying upstream projects of job completion Finished: FAILURE ```

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53503/, https://github.com/nodejs/node/pull/53475/, https://github.com/nodejs/node/pull/53495/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59870/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59878/
Example ``` fatal: No rebase in progress? ```

Progress