nodejs / reliability

Make the CI green again
35 stars 11 forks source link

CI Reliability 2024-04-26 #845

Open github-actions[bot] opened 4 months ago

github-actions[bot] commented 4 months ago

Failures in node-test-pull-request/58609 to node-test-pull-request/58708 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-04-26 00:08 0 3 8 3 86 3.09%

JSTest Failure

Reason parallel/test-error-serdes
Type JS_TEST_FAILURE
Failed PR 24 (https://github.com/nodejs/node/pull/52645/, https://github.com/nodejs/node/pull/52545/, https://github.com/nodejs/node/pull/52587/, https://github.com/nodejs/node/pull/52595/, https://github.com/nodejs/node/pull/52584/, https://github.com/nodejs/node/pull/52108/, https://github.com/nodejs/node/pull/52657/, https://github.com/nodejs/node/pull/52509/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52638/, https://github.com/nodejs/node/pull/52643/, https://github.com/nodejs/node/pull/52588/, https://github.com/nodejs/node/pull/52632/, https://github.com/nodejs/node/pull/52676/, https://github.com/nodejs/node/pull/52577/, https://github.com/nodejs/node/pull/52372/, https://github.com/nodejs/node/pull/52646/, https://github.com/nodejs/node/pull/52215/, https://github.com/nodejs/node/pull/52651/, https://github.com/nodejs/node/pull/51629/, https://github.com/nodejs/node/pull/52671/, https://github.com/nodejs/node/pull/52647/, https://github.com/nodejs/node/pull/52674/, https://github.com/nodejs/node/pull/52609/)
Appeared test-ibm-rhel9-x64-1, test-equinix-ubuntu2004_container-arm64-2, test-rackspace-win2022_vs2022-x64-4, test-equinix-debian11_container-armv7l-2, test-digitalocean-alpine318_container-x64-1, test-equinix-debian11_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-1, test-orka-macos11-x64-2, test-rackspace-win2022_vs2022-x64-3, test-equinix-rhel8_container-arm64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3, test-rackspace-win2019_vs2019-x64-1, test-digitalocean-fedora37-x64-1, test-equinix-ubuntu2004_sharedlibs_container-arm64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-ubi81_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-rackspace-debian11-x64-1, test-digitalocean-fedora38-x64-2, test-ibm-ubuntu2204-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-digitalocean-ubuntu2204-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-orka-macos11-x64-1, test-rackspace-win2022_vs2022-x64-6, test-digitalocean-alpine318_container-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-equinix_mnx-smartos20-x64-3, test-softlayer-debian12-x64-1, test-ibm-rhel8-x64-1, test-ibm-alpine319_container-x64-1, test-digitalocean-debian11-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-ibm-ubuntu2204_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/58622/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58708/
Example ``` not ok 1476 parallel/test-error-serdes --- duration_ms: 120100.38900 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason pummel/test-crypto-timing-safe-equal-benchmarks
Type JS_TEST_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/52545/, https://github.com/nodejs/node/pull/52108/, https://github.com/nodejs/node/pull/52587/, https://github.com/nodejs/node/pull/52643/, https://github.com/nodejs/node/pull/52657/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52676/, https://github.com/nodejs/node/pull/52646/, https://github.com/nodejs/node/pull/52651/)
Appeared test-macstadium-macos11.0-arm64-4, test-azure_msft-win2016_vs2017-x64-1, test-azure_msft-win10_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58626/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58690/
Example ``` not ok 3777 pummel/test-crypto-timing-safe-equal-benchmarks --- duration_ms: 1660.33000 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: timingSafeEqual should not leak information from its execution time (t=-16.52802173798739) at Object. (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/test/pummel/test-crypto-timing-safe-equal-benchmarks.js:109:1) at Module._compile (node:internal/modules/cjs/loader:1476:14) at Module._extensions..js (node:internal/modules/cjs/loader:1555:10) at Module.load (node:internal/modules/cjs/loader:1288:32) at Module._load (node:internal/modules/cjs/loader:1104:12) at Function.executeUserEntryPoint [as runMain] (node:internal/modules/run_main:191:14) at node:internal/main/run_main_module:30:49 { generatedMessage: false, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '... ```

Reason parallel/test-fs-read-stream-concurrent-reads
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/52584/, https://github.com/nodejs/node/pull/52645/, https://github.com/nodejs/node/pull/51629/, https://github.com/nodejs/node/pull/52215/, https://github.com/nodejs/node/pull/52372/, https://github.com/nodejs/node/pull/52647/, https://github.com/nodejs/node/pull/52609/)
Appeared test-equinix-debian11_container-armv7l-1, test-macstadium-macos11.0-arm64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-equinix-ubuntu2004_container-armv7l-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-rhel8-x64-2, test-digitalocean-fedora38-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/58614/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58708/
Example ``` not ok 3798 parallel/test-fs-read-stream-concurrent-reads --- duration_ms: 360102.68100 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/52595/, https://github.com/nodejs/node/pull/52638/, https://github.com/nodejs/node/pull/52632/, https://github.com/nodejs/node/pull/52676/, https://github.com/nodejs/node/pull/52577/, https://github.com/nodejs/node/pull/52215/)
Appeared test-digitalocean-fedora38-x64-2, test-digitalocean-fedora38-x64-1, test-ibm-rhel8-s390x-4, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7
First CI https://ci.nodejs.org/job/node-test-pull-request/58632/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58689/
Example ``` not ok 338 parallel/test-blob-file-backed --- duration_ms: 170.48600 severity: fail exitcode: 1 stack: |- node:internal/blob:291 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:291:25) Node.js v23.0.0-pre ... ```

Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/52638/, https://github.com/nodejs/node/pull/52632/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52657/, https://github.com/nodejs/node/pull/50992/, https://github.com/nodejs/node/pull/52609/)
Appeared test-equinix-ubuntu2004_container-arm64-2, test-equinix-rhel8_container-arm64-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-6, test-equinix-rhel8_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58643/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58708/
Example ``` not ok 3775 parallel/test-net-write-fully-async-buffer --- duration_ms: 360080.08300 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52643/, https://github.com/nodejs/node/pull/52584/, https://github.com/nodejs/node/pull/52651/)
Appeared test-macstadium-macos11.0-arm64-4, test-digitalocean-fedora38-x64-1, test-osuosl-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58634/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58690/
Example ``` not ok 4006 benchmark/test-benchmark-crypto --- duration_ms: 1460.80200 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at main (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/benchmark/crypto/timingSafeEqual.js:21:10) at /Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/osx11/benchmark/common.js:54:9 at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 1, expected: 0, operator: 'strictEqual' } Node.js v23.0.0-pre node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at ChildProcess. (/Users/iojs/build/workspace/node-test-commit-osx-arm/nodes/os... ```

Reason parallel/test-buffer-tostring-rangeerror
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52595/, https://github.com/nodejs/node/pull/52638/, https://github.com/nodejs/node/pull/52676/)
Appeared test-ibm-rhel8-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7
First CI https://ci.nodejs.org/job/node-test-pull-request/58632/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58680/
Example ``` not ok 778 parallel/test-buffer-tostring-rangeerror --- duration_ms: 120046.15900 severity: fail exitcode: -15 stack: |- timeout (node:3676871) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead. (Use `node --trace-deprecation ...` to show where the warning was created) ... ```

Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52671/, https://github.com/nodejs/node/pull/51629/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58636/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58692/
Example ``` not ok 2749 parallel/test-http2-large-write-multiple-requests --- duration_ms: 120071.83400 severity: fail exitcode: -15 stack: |- timeout server sends content 1 server sends content 2 server sends content 3 server sends content 4 server sends content 5 server sends content 6 server sends content 7 server sends content 8 server sends content 9 server sends content 10 server sends content 11 server sends content 12 server sends content 13 server sends content 14 server sends content 15 server sends content 16 server sends content 17 server sends content 18 server sends content 19 server sends content 20 server sends content 21 server sends content 22 server sends content 23 server sends content 24 server sends content 25 server sends content 26 server sends content 27 server sends content 28 server sends content 29 server sends content 30 server sends content 31 server s... ```

Reason parallel/test-file-write-stream4
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52545/, https://github.com/nodejs/node/pull/52638/)
Appeared test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58626/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58685/
Example ``` not ok 3847 parallel/test-file-write-stream4 --- duration_ms: 360021.05000 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-stream-readable-unpipe-resume
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52595/, https://github.com/nodejs/node/pull/52676/)
Appeared test-equinix-rhel8_container-arm64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-8
First CI https://ci.nodejs.org/job/node-test-pull-request/58610/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58678/
Example ``` not ok 3973 parallel/test-stream-readable-unpipe-resume --- duration_ms: 360059.29900 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-worker-memory
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52164/, https://github.com/nodejs/node/pull/52505/)
Appeared test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2019_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58612/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58624/
Example ``` not ok 881 parallel/test-worker-memory --- duration_ms: 2066.05700 severity: crashed exitcode: 3221225477 stack: |- run() called with n=7.5 (numWorkers=8) run() called with n=7.5 (numWorkers=8) run() called with n=7.5 (numWorkers=8) run() called with n=7.5 (numWorkers=8) run() called with n=7.5 (numWorkers=8) run() called with n=7.5 (numWorkers=8) run() called with n=7.5 (numWorkers=8) run() called with n=7.5 (numWorkers=8) run() called with n=6.5 (numWorkers=8) run() called with n=6.5 (numWorkers=8) run() called with n=6.5 (numWorkers=8) run() called with n=6.5 (numWorkers=8) run() called with n=6.5 (numWorkers=8) run() called with n=6.5 (numWorkers=8) run() called with n=6.5 (numWorkers=8) run() called with n=5.5 (numWorkers=8) run() called with n=6.5 (numWorkers=8) run() called with n=5.5 (numWorkers=8) run() called with n=5.5 (numWorkers=8) run() called with n=5.5 (numWorkers=8) run() called with n=5.5 (numWorker... ```

Jenkins Failure

Reason Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/52646/, https://github.com/nodejs/node/pull/52643/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52676/)
Appeared test-digitalocean-ubuntu2204-x64-1, test-macstadium-macos11.0-arm64-4, test-digitalocean-debian12-x64-1, test-softlayer-debian12-x64-1, test-rackspace-fedora32-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58625/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58693/
Example ``` java.io.IOException: Backing channel 'JNLP4-connect connection from 138.197.4.1/138.197.4.1:33238' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:215) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:285) at jdk.proxy2/jdk.proxy2.$Proxy164.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1212) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1204) ```

Git Failure

Reason Command "git clean -fdx" returned status code 143:
Type GIT_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52643/)
Appeared test-macstadium-macos11.0-arm64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58646/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58647/
Example ``` hudson.plugins.git.GitException: Command "git clean -fdx" returned status code 143: stdout: stderr: at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2846) at org.jenkinsci.plugins.gitclient.CliGitAPIImpl.launchCommandIn(CliGitAPIImpl.java:2766) ```

Build Failure

Reason error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
Type BUILD_FAILURE
Failed PR 9 (https://github.com/nodejs/node/pull/52577/, https://github.com/nodejs/node/pull/52545/, https://github.com/nodejs/node/pull/52643/, https://github.com/nodejs/node/pull/52632/, https://github.com/nodejs/node/pull/52609/, https://github.com/nodejs/node/pull/52509/, https://github.com/nodejs/node/pull/51629/, https://github.com/nodejs/node/pull/52676/, https://github.com/nodejs/node/pull/52646/)
Appeared test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-3, test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58611/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58687/
Example ``` error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] builtins-intl-gen.cc C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\tuple(469,1): fatal error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] builtins-microtask-queue-gen.cc C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\tuple(478,5): fatal error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] ```

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/52646/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52329/, https://github.com/nodejs/node/pull/52651/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix-debian11_container-armv7l-2, test-equinix-ubuntu2004_container-armv7l-2, test-osuosl-debian11_container-armv7l-1, test-osuosl-ubuntu2004_container-armv7l-1, test-equinix-rhel8_container-arm64-1, test-equinix-ubuntu2004_container-arm64-2, test-equinix-ubuntu2004_sharedlibs_container-arm64-5, test-osuosl-aix72-ppc64_be-3
First CI https://ci.nodejs.org/job/node-test-pull-request/58625/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58690/
Example ``` ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Collecting metadata... Metadata collection done. Notifying upstream projects of job completion Finished: FAILURE ```

Reason fatal error: Killed signal terminated program cc1plus
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52645/, https://github.com/nodejs/node/pull/52676/, https://github.com/nodejs/node/pull/52651/)
Appeared test-digitalocean-rhel8_arm_cross_container-x64-1, test-rackspace-fedora32-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7, test-softlayer-debian12-x64-1, test-digitalocean-alpine318_container-x64-1, test-digitalocean-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58618/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58690/
Example ``` fatal error: Killed signal terminated program cc1plus ```

Reason ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52647/, https://github.com/nodejs/node/pull/52108/)
Appeared test-macstadium-macos11.0-arm64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/58636/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58645/
Example ``` ERROR: Step ‘Publish JUnit test result report’ failed: no workspace for node-test-commit-osx-arm/nodes=osx11 #16871 Collecting metadata... Metadata collection done. Notifying upstream projects of job completion Finished: FAILURE ```

Reason ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52545/, https://github.com/nodejs/node/pull/52505/, https://github.com/nodejs/node/pull/52676/)
Appeared test-rackspace-fedora32-x64-1, test-digitalocean-ubuntu2204-x64-2, test-softlayer-debian12-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58619/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58693/
Example ``` ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for node-test-commit-linux/nodes=fedora-last-latest-x64 #57465 Collecting metadata... Metadata collection done. Notifying upstream projects of job completion Finished: FAILURE ```

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52646/, https://github.com/nodejs/node/pull/51629/, https://github.com/nodejs/node/pull/52651/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-rackspace-debian11-x64-1, test-ibm-rhel8-x64-1, test-osuosl-rhel8-ppc64_le-2, test-digitalocean-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/58625/
Last CI https://ci.nodejs.org/job/node-test-pull-request/58690/
Example ``` fatal: No rebase in progress? ```

Progress