nodejs / reliability

Make the CI green again
34 stars 10 forks source link

CI Reliability 2024-06-10 #891

Open github-actions[bot] opened 1 month ago

github-actions[bot] commented 1 month ago

Failures in node-test-pull-request/59611 to node-test-pull-request/59710 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-06-10 00:08 0 5 40 3 52 5.15%

Jenkins Failure

Reason Build timed out (after 60 minutes). Marking the build as failed.
Type JENKINS_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53300/, https://github.com/nodejs/node/pull/53015/)
Appeared test-ibm-ubi81_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59636/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59696/
Example ``` Build timed out (after 60 minutes). Marking the build as failed. ```

CCTest Failure

Reason Value of: (!expectation.read_expected)
Type CC_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53332/, https://github.com/nodejs/node/pull/53366/, https://github.com/nodejs/node/pull/53364/, https://github.com/nodejs/node/pull/53370/)
Appeared test-equinix-rhel8_container-arm64-2, test-equinix-rhel8_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59652/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59709/
Example ``` Value of: (!expectation.read_expected) Actual: true Expected: false [ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (5000 ms) ```

Reason C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected)
Type CC_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53255/, https://github.com/nodejs/node/pull/53348/, https://github.com/nodejs/node/pull/53239/)
Appeared test-rackspace-win2019_vs2019-x64-3, test-azure_msft-win11_vs2022-x64-4, test-rackspace-win2019_vs2019-x64-4, test-azure_msft-win10_vs2019-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59630/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59707/
Example ``` C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected) Actual: true Expected: false [ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (5001 ms) ```

Build Failure

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53300/, https://github.com/nodejs/node/pull/52966/, https://github.com/nodejs/node/pull/53360/, https://github.com/nodejs/node/pull/53239/)
Appeared test-equinix-debian11_container-armv7l-1, test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-2, test-osuosl-ubuntu2004_container-armv7l-1, test-mnx-smartos21-x64-2, test-mnx-smartos23-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59636/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59708/
Example ``` ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? [PostBuildScript] - [INFO] Executing post build scripts. [node-test-binary-armv7l] $ /bin/bash -ex /tmp/jenkins12768703676936592769.sh + '[' -d .git ']' + git clean -fdx Removing out/ ```

JSTest Failure

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/53183/, https://github.com/nodejs/node/pull/53251/, https://github.com/nodejs/node/pull/53255/, https://github.com/nodejs/node/pull/53294/, https://github.com/nodejs/node/pull/53336/, https://github.com/nodejs/node/pull/53364/, https://github.com/nodejs/node/pull/53239/)
Appeared test-orka-macos11-x64-1, test-azure_msft-win11_vs2022-arm64-4, test-ibm-rhel8-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-5, test-azure_msft-win11_vs2022-arm64-2, test-digitalocean-rhel9-x64-1, test-digitalocean-ubuntu2204_sharedlibs_container-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59618/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59707/
Example ``` not ok 4016 benchmark/test-benchmark-crypto --- duration_ms: 3540.87800 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at main (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/benchmark/crypto/timingSafeEqual.js:21:10) at /Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/benchmark/common.js:54:9 at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 1, expected: 0, operator: 'strictEqual' } Node.js v23.0.0-pre node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at ChildProcess. (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-... ```

Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/53232/, https://github.com/nodejs/node/pull/53159/, https://github.com/nodejs/node/pull/53251/, https://github.com/nodejs/node/pull/53228/, https://github.com/nodejs/node/pull/53300/, https://github.com/nodejs/node/pull/53337/, https://github.com/nodejs/node/pull/53336/)
Appeared test-ibm-ubi81_container-x64-1, undefined, test-ibm-ubuntu2204_sharedlibs_container-x64-1, test-ibm-rhel8-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59611/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59658/
Example ``` not ok 2417 parallel/test-performance-function --- duration_ms: 220.39400 severity: fail exitcode: 1 stack: |- node:internal/histogram:291 validateInteger(val, 'val', 1); ^ RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0 at RecordableHistogram.record (node:internal/histogram:291:5) at processComplete (node:internal/perf/timerify:40:15) at timerified m (node:internal/perf/timerify:87:5) at /home/iojs/build/workspace/node-test-commit-linux-containered/test/parallel/test-performance-function.js:103:5 at runNextTicks (node:internal/process/task_queues:60:5) at listOnTimeout (node:internal/timers:540:9) at process.processTimers (node:internal/timers:514:7) { code: 'ERR_OUT_OF_RANGE' } Node.js v23.0.0-pre ... ```

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/52725/, https://github.com/nodejs/node/pull/53226/, https://github.com/nodejs/node/pull/53331/, https://github.com/nodejs/node/pull/53352/, https://github.com/nodejs/node/pull/53366/, https://github.com/nodejs/node/pull/53015/, https://github.com/nodejs/node/pull/53239/)
Appeared test-orka-macos11-x64-2, test-orka-macos11-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59627/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59706/
Example ``` not ok 4114 sequential/test-http-server-request-timeouts-mixed --- duration_ms: 3319.65100 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(request2.completed) at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5) at listOnTimeout (node:internal/timers:581:17) at process.processTimers (node:internal/timers:519:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason parallel/test-net-write-fully-async-buffer
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53251/, https://github.com/nodejs/node/pull/53336/, https://github.com/nodejs/node/pull/53355/, https://github.com/nodejs/node/pull/53370/)
Appeared test-equinix-rhel8_container-arm64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59626/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59705/
Example ``` not ok 4011 parallel/test-net-write-fully-async-buffer --- duration_ms: 360063.27100 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason wpt/test-compression
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53337/, https://github.com/nodejs/node/pull/53331/, https://github.com/nodejs/node/pull/53355/, https://github.com/nodejs/node/pull/53261/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10
First CI https://ci.nodejs.org/job/node-test-pull-request/59655/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59691/
Example ``` not ok 4081 wpt/test-compression --- duration_ms: 1440113.84100 severity: fail exitcode: -15 stack: |- timeout [SKIPPED] compression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] decompression-bad-chunks.tentative.any.js: Execution "hangs", ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] decompression-buffersource.tentative.any.js: ArrayBuffer and TypedArray is not accepted and throws, instead of rejects during writer.write [SKIPPED] idlharness-shadowrealm.window.js: ShadowRealm support is not enabled [SKIPPED] third_party/pako/pako_inflate.min.js: This is not a test file. [PASS] "a" should cause the constructor to throw [PASS] "a" should cause the constructor to throw [PASS] no input should cause the constructor to throw [PASS] no input should cause the constructor to throw [PASS] non-string inpu... ```

Reason async-hooks/test-writewrap
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53255/, https://github.com/nodejs/node/pull/53355/, https://github.com/nodejs/node/pull/53366/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-4, test-ibm-ubuntu2204_sharedlibs_container-x64-5, test-digitalocean-ubuntu2204_sharedlibs_container-x64-10
First CI https://ci.nodejs.org/job/node-test-pull-request/59630/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59693/
Example ``` not ok 3801 async-hooks/test-writewrap --- duration_ms: 120035.49900 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-buffer-tostring-rangeerror
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53255/, https://github.com/nodejs/node/pull/53226/, https://github.com/nodejs/node/pull/53337/)
Appeared test-ibm-ubuntu2204_sharedlibs_container-x64-3, test-digitalocean-ubuntu2204_sharedlibs_container-x64-2, test-digitalocean-ubuntu2204_sharedlibs_container-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/59630/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59655/
Example ``` not ok 1474 parallel/test-buffer-tostring-rangeerror --- duration_ms: 120056.71600 severity: fail exitcode: -15 stack: |- timeout (node:1474366) [DEP0005] DeprecationWarning: Buffer() is deprecated due to security and usability issues. Please use the Buffer.alloc(), Buffer.allocUnsafe(), or Buffer.from() methods instead. (Use `node --trace-deprecation ...` to show where the warning was created) ... ```

Reason parallel/test-performance-eventlooputil
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53364/, https://github.com/nodejs/node/pull/53332/)
Appeared undefined, test-ibm-rhel8-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59690/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59697/
Example ``` not ok 2447 parallel/test-performance-eventlooputil --- duration_ms: 332.14600 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ AssertionError [ERR_ASSERTION]: 49.31923294067383 >= 49.31923294067383 at Timeout.r (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-eventlooputil.js:52:10) at Timeout.r [as _onTimeout] (/home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/common/index.js:466:15) at listOnTimeout (node:internal/timers:581:17) at process.processTimers (node:internal/timers:519:7) { generatedMessage: false, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason parallel/test-pipe-file-to-http
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53292/, https://github.com/nodejs/node/pull/53373/)
Appeared test-equinix-ubuntu2004_container-armv7l-1, test-equinix-debian11_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59634/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59682/
Example ``` not ok 3836 parallel/test-pipe-file-to-http --- duration_ms: 360062.61300 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-worker-memory
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53337/, https://github.com/nodejs/node/pull/53352/)
Appeared test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win11_vs2022-x64-4, test-rackspace-win2022_vs2022-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59656/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59665/
Example ``` not ok 895 parallel/test-worker-memory --- duration_ms: 1540.45000 severity: crashed exitcode: 3221225477 stack: |- run() called with n=15 (numWorkers=4) run() called with n=15 (numWorkers=4) run() called with n=15 (numWorkers=4) run() called with n=15 (numWorkers=4) run() called with n=14 (numWorkers=4) run() called with n=14 (numWorkers=4) run() called with n=14 (numWorkers=4) run() called with n=14 (numWorkers=4) run() called with n=13 (numWorkers=4) run() called with n=13 (numWorkers=4) run() called with n=13 (numWorkers=4) run() called with n=12 (numWorkers=4) run() called with n=12 (numWorkers=4) run() called with n=13 (numWorkers=4) run() called with n=11 (numWorkers=4) run() called with n=12 (numWorkers=4) run() called with n=11 (numWorkers=4) run() called with n=12 (numWorkers=4) run() called with n=10 (numWorkers=4) run() called with n=11 (numWorkers=4) run() called with n=10 (numWorkers=4) run() called... ```

Reason parallel/test-worker-stdio-from-preload-module
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53332/, https://github.com/nodejs/node/pull/53337/)
Appeared test-rackspace-win2016_vs2015-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59652/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59656/
Example ``` not ok 896 parallel/test-worker-stdio-from-preload-module --- duration_ms: 231.00900 severity: crashed exitcode: 3221225477 stack: |- ... ```

Progress