nodejs / reliability

Make the CI green again
34 stars 10 forks source link

CI Reliability 2024-07-08 #914

Open github-actions[bot] opened 3 weeks ago

github-actions[bot] commented 3 weeks ago

Failures in node-test-pull-request/60052 to node-test-pull-request/60150 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-07-08 00:09 0 2 31 4 63 2.08%

Jenkins Failure

Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53720/, https://github.com/nodejs/node/pull/53724/, https://github.com/nodejs-private/node-private/pull/617/)
Appeared test-digitalocean-ubi81_container-x64-2, test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60072/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60117/
Example ``` Build timed out (after 60 minutes). Marking the build as failed. ```

Build Failure

Reason fatal: No rebase in progress?
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/34111/, https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs-private/node-private/pull/617/, https://github.com/nodejs/node/pull/53465/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-equinix-rhel8_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60110/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60145/
Example ``` fatal: No rebase in progress? ```

JSTest Failure

Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 10 (https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs/node/pull/53573/, https://github.com/nodejs/node/pull/53517/, https://github.com/nodejs/node/pull/53563/, https://github.com/nodejs/node/pull/53678/, https://github.com/nodejs/node/pull/53728/, https://github.com/nodejs/node/pull/53657/, https://github.com/nodejs/node/pull/53593/, https://github.com/nodejs/node/pull/52166/, https://github.com/nodejs/node/pull/53748/)
Appeared test-equinix_mnx-smartos20-x64-3, test-equinix_mnx-smartos20-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60092/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60141/
Example ``` not ok 3818 parallel/test-net-write-fully-async-buffer --- duration_ms: 300125.68300 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/53705/, https://github.com/nodejs/node/pull/53699/, https://github.com/nodejs/node/pull/53619/, https://github.com/nodejs/node/pull/53669/, https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs/node/pull/53685/, https://github.com/nodejs/node/pull/52166/)
Appeared test-orka-macos11-x64-1, test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60062/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60139/
Example ``` not ok 4132 sequential/test-http-server-request-timeouts-mixed --- duration_ms: 3367.04500 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(request2.completed) at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5) at listOnTimeout (node:internal/timers:601:17) at process.processTimers (node:internal/timers:539:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason parallel/test-permission-fs-read
Type JS_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs-private/node-private/pull/617/, https://github.com/nodejs/node/pull/53724/, https://github.com/nodejs/node/pull/53685/, https://github.com/nodejs/node/pull/53698/, https://github.com/nodejs/node/pull/53657/)
Appeared test-azure_msft-win11_vs2022-arm64-3, test-azure_msft-win10_vs2019-x64-4, test-azure_msft-win11_vs2022-x64-2, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2022_vs2022-x64-3, test-azure_msft-win2016_vs2017-x64-2, test-azure_msft-win11_vs2022-arm64-5, test-azure_msft-win10_vs2019-x64-1, test-rackspace-win2019_vs2019-x64-4, test-rackspace-win2022_vs2022-x64-6
First CI https://ci.nodejs.org/job/node-test-pull-request/60082/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60129/
Example ``` not ok 603 parallel/test-permission-fs-read --- duration_ms: 664.99800 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: node:assert:644 throw err; ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal: + actual - expected Comparison { code: 'ERR_ACCESS_DENIED', permission: 'FileSystemRead', + resource: 'd:\\workspace\\node-test-binary-windows-js-suites\\node\\test\\fixtures\\permission\\deny\\protected-file.md' - resource: '\\\\?\\d:\\workspace\\node-test-binary-windows-js-suites\\node\\test\\fixtures\\permission\\deny\\protected-file.md' } at Object. (d:\workspace\node-test-binary-windows-js-suites\node\test\common\index.js:740:12) at Object. (d:\workspace\node-test-binary-windows-js-suites\node\test\c... ```

Reason async-hooks/test-writewrap
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53602/, https://github.com/nodejs/node/pull/53696/, https://github.com/nodejs-private/node-private/pull/617/, https://github.com/nodejs/node/pull/53517/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-digitalocean-ubuntu2204_sharedlibs_container-x64-7
First CI https://ci.nodejs.org/job/node-test-pull-request/60067/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60105/
Example ``` not ok 578 async-hooks/test-writewrap --- duration_ms: 120018.84000 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-dns
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs-private/node-private/pull/617/, https://github.com/nodejs/node/pull/53685/, https://github.com/nodejs/node/pull/53678/, https://github.com/nodejs/node/pull/53728/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-10, test-digitalocean-fedora39-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-equinix_mnx-smartos20-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60082/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60123/
Example ``` not ok 631 parallel/test-dns --- duration_ms: 535.94100 severity: fail exitcode: 1 stack: |- (node:1167898) [DEP0118] DeprecationWarning: The provided hostname "" is not a valid hostname, and is supported in the dns module solely for compatibility. (Use `node --trace-deprecation ...` to show where the warning was created) node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly deep-equal: + actual - expected ... Lines skipped [ { address: '1.2.3.4', + ttl: 3333333332, - ttl: 3333333333, type: 'A' }, { address: '::42', + ttl: 3333333332, - ttl: 3333333333, type: 'AAAA' ... ```

Reason parallel/test-http2-large-write-multiple-requests
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53704/, https://github.com/nodejs/node/pull/53602/, https://github.com/nodejs/node/pull/53699/, https://github.com/nodejs/node/pull/53728/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-6, test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-rackspace-win2019_vs2019-x64-3, test-ibm-ubuntu2204_sharedlibs_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60058/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60108/
Example ``` not ok 2739 parallel/test-http2-large-write-multiple-requests --- duration_ms: 120052.05100 severity: fail exitcode: -15 stack: |- timeout server sends content 1 server sends content 2 server sends content 3 server sends content 4 server sends content 5 server sends content 6 server sends content 7 server sends content 8 server sends content 9 server sends content 10 server sends content 11 server sends content 12 server sends content 13 server sends content 14 server sends content 15 server sends content 16 server sends content 17 server sends content 18 server sends content 19 server sends content 20 server sends content 21 server sends content 22 server sends content 23 server sends content 24 server sends content 25 server sends content 26 server sends content 27 server sends content 28 server sends content 29 server sends content 30 server sends content 31 server s... ```

Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53724/, https://github.com/nodejs/node/pull/53728/, https://github.com/nodejs/node/pull/53682/, https://github.com/nodejs/node/pull/52166/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2, test-ibm-rhel9-x64-1, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/60098/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60139/
Example ``` not ok 2424 parallel/test-performance-function --- duration_ms: 141.99200 severity: fail exitcode: 1 stack: |- node:internal/histogram:291 validateInteger(val, 'val', 1); ^ RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0 at RecordableHistogram.record (node:internal/histogram:291:5) at processComplete (node:internal/perf/timerify:40:15) at timerified m (node:internal/perf/timerify:87:5) at /home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-performance-function.js:103:5 at runNextTicks (node:internal/process/task_queues:60:5) at listOnTimeout (node:internal/timers:565:9) at process.processTimers (node:internal/timers:539:7) { code: 'ERR_OUT_OF_RANGE' } Node.js v23.0.0-pre ... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53705/, https://github.com/nodejs/node/pull/53728/)
Appeared test-digitalocean-fedora38-x64-2, test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60062/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60108/
Example ``` not ok 343 parallel/test-blob-file-backed --- duration_ms: 112.75200 severity: fail exitcode: 1 stack: |- node:internal/blob:290 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:290:25) Node.js v23.0.0-pre ... ```

Reason parallel/test-bootstrap-modules
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/34111/, https://github.com/nodejs/node/pull/53682/)
Appeared undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/60120/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60135/
Example ``` not ok 412 parallel/test-bootstrap-modules --- duration_ms: 264.09500 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ AssertionError [ERR_ASSERTION]: These builtins are now unexpectedly loaded at run time. If this is intentional, add them to `expected.atRunTime`. # Note: loading more builtins at run time can lead to startup performance regression. - Consider lazy loading builtins that are not used universally. --- These could be added to expected.atRunTime --- [ 'NativeModule internal/worker/messaging' ] at Object. (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-bootstrap-modules.js:242:8) at Module._compile (node:internal/modules/cjs/loader:1458:14) at Object..js (node:internal/modules/cjs/loader:1542:10) at Module.load (node:internal/modules/cjs/loader:1282:32)... ```

Reason parallel/test-buffer-tostring-rangeerror
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53611/, https://github.com/nodejs/node/pull/53553/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60100/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60150/
Example ``` not ok 1524 parallel/test-buffer-tostring-rangeerror --- duration_ms: 120020.94300 severity: fail exitcode: -15 stack: |- timeout (node:699603) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead. (Use `node --trace-deprecation ...` to show where the warning was created) ... ```

Reason parallel/test-child-process-stdio-big-write-end
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs/node/pull/53698/)
Appeared test-equinix-debian11_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60061/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60094/
Example ``` not ok 3827 parallel/test-child-process-stdio-big-write-end --- duration_ms: 360041.74700 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-cli-node-options
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53683/, https://github.com/nodejs/node/pull/53658/)
Appeared test-equinix_mnx-smartos20-x64-3, test-rackspace-win2022_vs2022-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60078/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60128/
Example ``` not ok 457 parallel/test-cli-node-options --- duration_ms: 4680.05100 severity: crashed exitcode: -6 stack: |- <--- Last few GCs ---> [105438:8f4f000] 375 ms: Scavenge 3.8 (5.4) -> 3.6 (6.4) MB, pooled: 0 MB, 19.81 / 0.00 ms (average mu = 1.000, current mu = 1.000) allocation failure; <--- JS stacktrace ---> FATAL ERROR: Zone Allocation failed - process out of memory ----- Native stack trace ----- terminate called after throwing an instance of 'std::bad_alloc' 1: 1ad02c5 node::OOMErrorHandler(char const*, v8::OOMDetails const&) [/home/iojs/build/workspace/node-test-commit-smartos/nodes/smartos20-64/out/Release/node] terminate called recursively what(): std::bad_alloc ... ```

Reason parallel/test-crypto-authenticated
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53669/, https://github.com/nodejs/node/pull/53256/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/60075/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60124/
Example ``` not ok 1240 parallel/test-crypto-authenticated --- duration_ms: 120053.42100 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-crypto-dh-generate-keys
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53722/, https://github.com/nodejs-private/node-private/pull/608/)
Appeared test-rackspace-win2016_vs2015-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60073/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60077/
Example ``` not ok 955 parallel/test-crypto-dh-generate-keys --- duration_ms: 120232.43400 severity: fail exitcode: 1 stack: |- timeout ... ```

Reason parallel/test-http-get-pipeline-problem
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53685/, https://github.com/nodejs-private/node-private/pull/609/)
Appeared test-azure_msft-win2016_vs2017-x64-2, test-azure_msft-win2016_vs2017-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60070/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60106/
Example ``` not ok 351 parallel/test-http-get-pipeline-problem --- duration_ms: 328.00900 severity: fail exitcode: 3221226505 stack: |- image.length = 45658 recv 0 done 0 recv 1 done 1 recv 2 done 2 recv 3 done 3 recv 4 done 4 recv 5 done 5 recv 6 done 6 recv 7 done 7 recv 8 ... ```

Reason parallel/test-http-remove-header-stays-removed
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs/node/pull/53563/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/60092/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60109/
Example ``` not ok 1641 parallel/test-http-remove-header-stays-removed --- duration_ms: 911.31800 severity: fail exitcode: 1 stack: |- ok node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: false !== true at Timeout._onTimeout (/home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-http-remove-header-stays-removed.js:61:18) at listOnTimeout (node:internal/timers:601:17) at process.processTimers (node:internal/timers:539:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: 'strictEqual' } Node.js v23.0.0-pre ... ```

Reason parallel/test-performance-eventlooputil
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53686/, https://github.com/nodejs/node/pull/53748/)
Appeared test-ibm-ubuntu2204-x64-1, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/60132/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60141/
Example ``` not ok 2453 parallel/test-performance-eventlooputil --- duration_ms: 515.13900 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ AssertionError [ERR_ASSERTION]: 96.63115298748016 < 96.63115302116773 at Timeout.runCalcTest (/home/iojs/build/workspace/node-test-commit-linux/test/parallel/test-performance-eventlooputil.js:85:10) at Timeout.runCalcTest [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-linux/test/common/index.js:487:15) at listOnTimeout (node:internal/timers:603:11) at process.processTimers (node:internal/timers:539:7) { generatedMessage: false, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason parallel/test-worker-cleanexit-with-js
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs-private/node-private/pull/608/, https://github.com/nodejs/node/pull/53698/)
Appeared test-rackspace-win2022_vs2022-x64-1, test-rackspace-win2019_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/60052/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60094/
Example ``` not ok 890 parallel/test-worker-cleanexit-with-js --- duration_ms: 1043.05400 severity: fail exitcode: 3221226356 stack: |- ... ```

Reason parallel/test-worker-memory
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53722/, https://github.com/nodejs-private/node-private/pull/617/)
Appeared test-azure_msft-win10_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/60073/
Last CI https://ci.nodejs.org/job/node-test-pull-request/60082/
Example ``` not ok 897 parallel/test-worker-memory --- duration_ms: 308.00300 severity: crashed exitcode: 3221225477 stack: |- run() called with n=15 (numWorkers=4) run() called with n=15 (numWorkers=4) run() called with n=15 (numWorkers=4) run() called with n=15 (numWorkers=4) run() called with n=14 (numWorkers=4) ... ```

Progress