nodejs / reliability

Make the CI green again
40 stars 11 forks source link

CI Reliability 2024-03-20 #817

Open github-actions[bot] opened 7 months ago

github-actions[bot] commented 7 months ago

Failures in node-test-pull-request/57750 to node-test-pull-request/57846 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-03-20 00:07 0 1 40 1 58 1.01%

JSTest Failure

Reason parallel/test-runner-output
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/51091/, https://github.com/nodejs/node/pull/51021/, https://github.com/nodejs/node/pull/52123/, https://github.com/nodejs/node/pull/52009/, https://github.com/nodejs/node/pull/52077/, https://github.com/nodejs/node/pull/52137/)
Appeared test-osuosl-aix72-ppc64_be-4, test-osuosl-rhel8-ppc64_le-4, test-osuosl-aix72-ppc64_be-3, test-azure_msft-win11_vs2022-x64-2, test-orka-macos11-x64-2, test-digitalocean-freebsd12-x64-2, test-azure_msft-win11_vs2022-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/57757/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57814/
Example ``` not ok 2667 parallel/test-runner-output --- duration_ms: 5269.80800 severity: fail exitcode: 1 stack: |- TAP version 13 # Subtest: test runner output # Subtest: test-runner/output/abort.js ok 1 - test-runner/output/abort.js --- duration_ms: 3569.896695 ... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/51972/, https://github.com/nodejs/node/pull/51657/, https://github.com/nodejs/node/pull/52148/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-alpine318_container-x64-1, test-digitalocean-fedora38-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/57771/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57846/
Example ``` not ok 75 parallel/test-blob-file-backed --- duration_ms: 183.30100 severity: fail exitcode: 1 stack: |- node:internal/blob:291 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:291:25) Node.js v22.0.0-pre ... ```

Reason parallel/test-cluster-fork-stdio
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/51977/, https://github.com/nodejs/node/pull/52092/, https://github.com/nodejs/node/pull/52110/)
Appeared test-azure_msft-win11_vs2022-arm64-3, test-azure_msft-win10_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/57756/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57781/
Example ``` not ok 915 parallel/test-cluster-fork-stdio --- duration_ms: 120313.66400 severity: fail exitcode: 1 stack: |- timeout ... ```

Reason parallel/test-worker-memory
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52071/, https://github.com/nodejs/node/pull/52101/, https://github.com/nodejs/node/pull/52148/)
Appeared test-azure_msft-win2016_vs2017-x64-1, test-azure_msft-win10_vs2019-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/57752/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57838/
Example ``` not ok 886 parallel/test-worker-memory --- duration_ms: 2966.62100 severity: crashed exitcode: 3221225477 stack: |- run() called with n=15 (numWorkers=4) run() called with n=15 (numWorkers=4) run() called with n=15 (numWorkers=4) run() called with n=15 (numWorkers=4) run() called with n=14 (numWorkers=4) run() called with n=14 (numWorkers=4) run() called with n=14 (numWorkers=4) run() called with n=14 (numWorkers=4) run() called with n=13 (numWorkers=4) run() called with n=13 (numWorkers=4) run() called with n=13 (numWorkers=4) run() called with n=13 (numWorkers=4) run() called with n=12 (numWorkers=4) run() called with n=12 (numWorkers=4) run() called with n=12 (numWorkers=4) run() called with n=12 (numWorkers=4) run() called with n=11 (numWorkers=4) run() called with n=11 (numWorkers=4) run() called with n=11 (numWorkers=4) run() called with n=11 (numWorkers=4) run() called with n=10 (numWorkers=4) run() called... ```

Reason sequential/test-single-executable-application-snapshot-and-code-cache
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/52093/, https://github.com/nodejs/node/pull/52108/, https://github.com/nodejs/node/pull/52061/)
Appeared test-nearform-macos10.15-x64-1, test-digitalocean-debian11-x64-1, test-digitalocean-debian12-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/57795/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57813/
Example ``` not ok 4039 sequential/test-single-executable-application-snapshot-and-code-cache --- duration_ms: 6913.92000 severity: fail exitcode: 1 stack: |- [process 4662]: --- stderr --- error: /Library/Developer/CommandLineTools/usr/bin/codesign_allocate: can't write output file: /Users/iojs/node-tmp/.tmp.4038/sea.cstemp (No space left on device) /Users/iojs/node-tmp/.tmp.4038/sea: the codesign_allocate helper tool cannot be found or used [process 4662]: --- stdout --- [process 4662]: status = 1, signal = null /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/common/child_process.js:86 throw new Error(`${failures.join('\n')}`); ^ Error: - process terminated with status 1, expected 0 at logAndThrow (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/common/child_process.js:86:11) at expectSyncExit (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx1015/test/common/child_process.js:91:5) ... ```

Reason parallel/test-crypto-dh-generate-keys
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/51972/, https://github.com/nodejs/node/pull/52093/)
Appeared test-rackspace-win2016_vs2015-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/57771/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57843/
Example ``` not ok 946 parallel/test-crypto-dh-generate-keys --- duration_ms: 120221.95800 severity: fail exitcode: 1 stack: |- timeout ... ```

Reason parallel/test-http-chunk-problem
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/51657/, https://github.com/nodejs/node/pull/52093/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-ibm-ubuntu2204_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/57789/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57796/
Example ``` not ok 1382 parallel/test-http-chunk-problem --- duration_ms: 120067.39000 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52092/, https://github.com/nodejs/node/pull/52130/)
Appeared test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/57780/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57832/
Example ``` not ok 2173 parallel/test-http2-large-write-multiple-requests --- duration_ms: 120071.67300 severity: fail exitcode: -15 stack: |- timeout server sends content 1 server sends content 2 server sends content 3 server sends content 4 server sends content 5 server sends content 6 server sends content 7 server sends content 8 server sends content 9 server sends content 10 server sends content 11 server sends content 12 server sends content 13 server sends content 14 server sends content 15 server sends content 16 server sends content 17 server sends content 18 server sends content 19 server sends content 20 server sends content 21 server sends content 22 server sends content 23 server sends content 24 server sends content 25 server sends content 26 server sends content 27 server sends content 28 server sends content 29 server sends content 30 server sends content 31 server s... ```

Reason parallel/test-tls-ticket-cluster
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/51136/, https://github.com/nodejs/node/pull/52146/)
Appeared test-rackspace-win2019_vs2019-x64-2, test-nearform-macos10.15-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/57766/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57822/
Example ``` not ok 800 parallel/test-tls-ticket-cluster --- duration_ms: 949.01100 severity: fail exitcode: 1 stack: |- [primary] got "listening" [primary] connecting 62043 session? false [primary] got "listening" [primary] got "listening" [worker] connection reused? false [primary] got "not-reused" [primary] connecting 62043 session? true [worker] connection reused? true [primary] got "reused" [primary] connecting 62043 session? true [worker] connection reused? true [primary] got "reused" [primary] connecting 62043 session? true [primary] got "listening" [worker] connection reused? true [primary] got "reused" [primary] connecting 62043 session? true [worker] connection reused? true [primary] got "reused" [primary] connecting 62043 session? true [worker] connection reused? true [primary] got "reused" [primary] connecting 62043 session? true [worker] connection reused? true [primary] got "reused" [primary] con... ```

Jenkins Failure

CCTest Failure

Build Failure

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 11 (https://github.com/nodejs/node/pull/51362/, https://github.com/nodejs/node/pull/52101/, https://github.com/nodejs/node/pull/45427/, https://github.com/nodejs/node/pull/52092/, https://github.com/nodejs/node/pull/52110/, https://github.com/nodejs/node/pull/52124/, https://github.com/nodejs/node/pull/52009/, https://github.com/nodejs/node/pull/52077/, https://github.com/nodejs/node/pull/52119/, https://github.com/nodejs/node/pull/52093/, https://github.com/nodejs/node/pull/52148/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-alpine318_container-x64-2, test-softlayer-debian12-x64-1, test-digitalocean-alpine318_container-x64-1, test-digitalocean-debian12-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/57759/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57844/
Example ``` fatal: No rebase in progress? ```

Reason ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for ...
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/51362/, https://github.com/nodejs/node/pull/45427/)
Appeared test-digitalocean-fedora38-x64-2, test-digitalocean-fedora37-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/57759/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57778/
Example ``` ERROR: Step ‘Record fingerprints of files to track usage’ failed: no workspace for node-test-commit-linux/nodes=fedora-latest-x64 #56666 Collecting metadata... Metadata collection done. Notifying upstream projects of job completion Finished: FAILURE ```

Reason error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/45427/, https://github.com/nodejs/node/pull/51977/)
Appeared test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2022_vs2022-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/57750/
Last CI https://ci.nodejs.org/job/node-test-pull-request/57779/
Example ``` error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] iterator-from-tq-csa.cc C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\tuple(315,1): fatal error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] math-tq-csa.cc C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\tuple(47,90): fatal error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] ```

Progress