nodejs / reliability

Make the CI green again
34 stars 10 forks source link

CI Reliability 2024-05-30 #880

Open github-actions[bot] opened 2 months ago

github-actions[bot] commented 2 months ago

Failures in node-test-pull-request/59432 to node-test-pull-request/59530 that failed 2 or more PRs (Generated with ncu-ci walk pr --stats=true --markdown /home/runner/work/reliability/reliability/results.md)

UTC Time RUNNING SUCCESS UNSTABLE ABORTED FAILURE Green Rate
2024-05-30 00:09 4 9 11 2 74 9.57%

CCTest Failure

Reason C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected)
Type CC_TEST_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/53131/, https://github.com/nodejs/node/pull/53120/, https://github.com/nodejs/node/pull/52762/, https://github.com/nodejs/node/pull/53148/, https://github.com/nodejs/node/pull/53134/)
Appeared test-azure_msft-win11_vs2022-x64-1, test-azure_msft-win10_vs2019-x64-4, test-rackspace-win2019_vs2019-x64-1, test-azure_msft-win10_vs2019-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59441/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59461/
Example ``` C:\workspace\node-compile-windows\node\test\cctest\test_inspector_socket.cc(323): error: Value of: (!expectation.read_expected) Actual: true Expected: false [ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (5001 ms) ```

Reason Value of: (!expectation.read_expected)
Type CC_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53023/, https://github.com/nodejs/node/pull/53136/, https://github.com/nodejs/node/pull/53188/)
Appeared test-equinix-rhel8_container-arm64-1, test-digitalocean-fedora38-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59464/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59517/
Example ``` Value of: (!expectation.read_expected) Actual: true Expected: false [ FAILED ] InspectorSocketTest.HostIPv6NonRoutable (4999 ms) ```

Jenkins Failure

Build Failure

Reason Error: - stderr did not match "C:\workspace\node-test-binary-windows-native-suites\node\Release\embedtest.exe: NODE_REPL_EXTERNAL_MODULE can't be used with kDisableNodeOptionsEnv\n"
Type BUILD_FAILURE
Failed PR 14 (https://github.com/nodejs/node/pull/53134/, https://github.com/nodejs/node/pull/53105/, https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52762/, https://github.com/nodejs/node/pull/53146/, https://github.com/nodejs/node/pull/53148/, https://github.com/nodejs/node/pull/53107/, https://github.com/nodejs/node/pull/53145/, https://github.com/nodejs/node/pull/53136/, https://github.com/nodejs/node/pull/53131/, https://github.com/nodejs/node/pull/53135/, https://github.com/nodejs/node/pull/53155/, https://github.com/nodejs/node/pull/53157/, https://github.com/nodejs/node/pull/53156/)
Appeared test-rackspace-win2019_vs2019-x64-4, test-rackspace-win2022_vs2022-x64-4, test-rackspace-win2019_vs2019-x64-3, test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2019_vs2019-x64-2, test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2019_vs2019-x64-1, test-rackspace-win2022_vs2022-x64-3, test-rackspace-win2022_vs2022-x64-2, test-rackspace-win2022_vs2022-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59435/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59507/
Example ``` Error: - stderr did not match "C:\\workspace\\node-test-binary-windows-native-suites\\node\\Release\\embedtest.exe: NODE_REPL_EXTERNAL_MODULE can't be used with kDisableNodeOptionsEnv\n" at logAndThrow (C:\workspace\node-test-binary-windows-native-suites\node\test\common\child_process.js:86:11) at expectSyncExit (C:\workspace\node-test-binary-windows-native-suites\node\test\common\child_process.js:109:5) at spawnSyncAndExit (C:\workspace\node-test-binary-windows-native-suites\node\test\common\child_process.js:118:10) at Object. (C:\workspace\node-test-binary-windows-native-suites\node\test\embedding\test-embedding.js:157:3) at Module._compile (node:internal/modules/cjs/loader:1434:14) ```

Reason Error: - stderr did not match "c:\workspace\node-test-binary-windows-native-suites\node\Release\embedtest.exe: NODE_REPL_EXTERNAL_MODULE can't be used with kDisableNodeOptionsEnv\n"
Type BUILD_FAILURE
Failed PR 14 (https://github.com/nodejs/node/pull/53134/, https://github.com/nodejs/node/pull/53105/, https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52762/, https://github.com/nodejs/node/pull/53146/, https://github.com/nodejs/node/pull/53148/, https://github.com/nodejs/node/pull/53107/, https://github.com/nodejs/node/pull/53145/, https://github.com/nodejs/node/pull/53136/, https://github.com/nodejs/node/pull/53131/, https://github.com/nodejs/node/pull/53135/, https://github.com/nodejs/node/pull/53155/, https://github.com/nodejs/node/pull/53157/, https://github.com/nodejs/node/pull/53156/)
Appeared test-azure_msft-win10_vs2019-x64-3, test-azure_msft-win11_vs2022-x64-3, test-azure_msft-win10_vs2019-x64-2, test-azure_msft-win11_vs2022-x64-4, test-azure_msft-win11_vs2022-x64-1, test-azure_msft-win11_vs2022-x64-2, test-azure_msft-win10_vs2019-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59435/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59507/
Example ``` Error: - stderr did not match "c:\\workspace\\node-test-binary-windows-native-suites\\node\\Release\\embedtest.exe: NODE_REPL_EXTERNAL_MODULE can't be used with kDisableNodeOptionsEnv\n" at logAndThrow (c:\workspace\node-test-binary-windows-native-suites\node\test\common\child_process.js:86:11) at expectSyncExit (c:\workspace\node-test-binary-windows-native-suites\node\test\common\child_process.js:109:5) at spawnSyncAndExit (c:\workspace\node-test-binary-windows-native-suites\node\test\common\child_process.js:118:10) at Object. (c:\workspace\node-test-binary-windows-native-suites\node\test\embedding\test-embedding.js:157:3) at Module._compile (node:internal/modules/cjs/loader:1434:14) ```

Reason Error: - stderr did not match "d:\workspace\node-test-binary-windows-native-suites\node\Release\embedtest.exe: NODE_REPL_EXTERNAL_MODULE can't be used with kDisableNodeOptionsEnv\n"
Type BUILD_FAILURE
Failed PR 14 (https://github.com/nodejs/node/pull/53134/, https://github.com/nodejs/node/pull/53105/, https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/52762/, https://github.com/nodejs/node/pull/53146/, https://github.com/nodejs/node/pull/53148/, https://github.com/nodejs/node/pull/53107/, https://github.com/nodejs/node/pull/53145/, https://github.com/nodejs/node/pull/53136/, https://github.com/nodejs/node/pull/53131/, https://github.com/nodejs/node/pull/53135/, https://github.com/nodejs/node/pull/53155/, https://github.com/nodejs/node/pull/53157/, https://github.com/nodejs/node/pull/53156/)
Appeared test-azure_msft-win11_vs2022-arm64-1, test-azure_msft-win11_vs2022-arm64-4, test-azure_msft-win11_vs2022-arm64-3, test-azure_msft-win11_vs2022-arm64-2, test-azure_msft-win11_vs2022-arm64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/59435/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59507/
Example ``` Error: - stderr did not match "d:\\workspace\\node-test-binary-windows-native-suites\\node\\Release\\embedtest.exe: NODE_REPL_EXTERNAL_MODULE can't be used with kDisableNodeOptionsEnv\n" at logAndThrow (d:\workspace\node-test-binary-windows-native-suites\node\test\common\child_process.js:86:11) at expectSyncExit (d:\workspace\node-test-binary-windows-native-suites\node\test\common\child_process.js:109:5) at spawnSyncAndExit (d:\workspace\node-test-binary-windows-native-suites\node\test\common\child_process.js:118:10) at Object. (d:\workspace\node-test-binary-windows-native-suites\node\test\embedding\test-embedding.js:157:3) at Module._compile (node:internal/modules/cjs/loader:1434:14) ```

Reason error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj]
Type BUILD_FAILURE
Failed PR 8 (https://github.com/nodejs/node/pull/52372/, https://github.com/nodejs/node/pull/53173/, https://github.com/nodejs/node/pull/53105/, https://github.com/nodejs/node/pull/53145/, https://github.com/nodejs/node/pull/53078/, https://github.com/nodejs/node/pull/53154/, https://github.com/nodejs/node/pull/53174/, https://github.com/nodejs/node/pull/52213/)
Appeared test-rackspace-win2022_vs2022-x64-5, test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2022_vs2022-x64-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59446/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59524/
Example ``` error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] string-html-tq-csa.cc C:\workspace\node-compile-windows\node\deps\v8\src\objects\tagged.h(115,1): fatal error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] set-symmetric-difference-tq-csa.cc C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.39.33519\include\type_traits(1293,1): fatal error C1060: compiler is out of heap space [C:\workspace\node-compile-windows\node\tools\v8_gypfiles\v8_initializers.vcxproj] ```

Reason ERROR: No files found with the specified search criteria.
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53078/, https://github.com/nodejs/node/pull/53175/, https://github.com/nodejs/node/pull/52213/)
Appeared test-rackspace-win2022_vs2022-x64-6, test-rackspace-win2022_vs2022-x64-4, test-rackspace-win2022_vs2022-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/59459/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59522/
Example ``` ERROR: No files found with the specified search criteria. 1 file(s) copied. > set DEBUG_HELPER=1 > call vcbuild.bat arm64 release msi ```

JSTest Failure

Reason benchmark/test-benchmark-crypto
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/52372/, https://github.com/nodejs/node/pull/51821/, https://github.com/nodejs/node/pull/53144/, https://github.com/nodejs/node/pull/51711/, https://github.com/nodejs/node/pull/53145/, https://github.com/nodejs/node/pull/53148/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-8, test-ibm-rhel8-s390x-1, test-ibm-rhel9-x64-1, test-ibm-alpine319_container-x64-1, test-osuosl-debian11_container-armv7l-1, test-osuosl-rhel8-ppc64_le-4
First CI https://ci.nodejs.org/job/node-test-pull-request/59446/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59490/
Example ``` not ok 4009 benchmark/test-benchmark-crypto --- duration_ms: 2515.08700 severity: fail exitcode: 1 stack: |- node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at main (/home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/crypto/timingSafeEqual.js:21:10) at /home/iojs/build/workspace/node-test-commit-linux-containered/benchmark/common.js:54:9 at process.processTicksAndRejections (node:internal/process/task_queues:77:11) { generatedMessage: true, code: 'ERR_ASSERTION', actual: 1, expected: 0, operator: 'strictEqual' } Node.js v23.0.0-pre node:assert:126 throw new AssertionError(obj); ^ AssertionError [ERR_ASSERTION]: Expected values to be strictly equal: 1 !== 0 at ChildProcess. (/home/iojs/build/workspace/node-test-commit-linux-containered/test/... ```

Reason sequential/test-http-server-request-timeouts-mixed
Type JS_TEST_FAILURE
Failed PR 4 (https://github.com/nodejs/node/pull/53154/, https://github.com/nodejs/node/pull/53189/, https://github.com/nodejs/node/pull/53190/, https://github.com/nodejs/node/pull/53188/)
Appeared test-orka-macos11-x64-1, test-orka-macos11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59491/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59517/
Example ``` not ok 4108 sequential/test-http-server-request-timeouts-mixed --- duration_ms: 3303.81800 severity: fail exitcode: 1 stack: |- node:assert:408 throw err; ^ AssertionError [ERR_ASSERTION]: The expression evaluated to a falsy value: assert(request2.completed) at Timeout._onTimeout (/Users/iojs/build/workspace/node-test-commit-osx/nodes/osx11-x64/test/sequential/test-http-server-request-timeouts-mixed.js:108:5) at listOnTimeout (node:internal/timers:573:17) at process.processTimers (node:internal/timers:514:7) { generatedMessage: true, code: 'ERR_ASSERTION', actual: false, expected: true, operator: '==' } Node.js v23.0.0-pre ... ```

Reason parallel/test-pipe-file-to-http
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53023/, https://github.com/nodejs/node/pull/52279/, https://github.com/nodejs/node/pull/53169/)
Appeared test-equinix-ubuntu2004_container-armv7l-2, test-osuosl-debian11_container-armv7l-1, test-equinix-debian11_container-armv7l-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59464/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59493/
Example ``` not ok 3831 parallel/test-pipe-file-to-http --- duration_ms: 360044.73500 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason sequential/test-single-executable-application-empty
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/53150/, https://github.com/nodejs/node/pull/53148/, https://github.com/nodejs/node/pull/53105/)
Appeared test-rackspace-win2016_vs2015-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59489/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59492/
Example ``` not ok 981 sequential/test-single-executable-application-empty --- duration_ms: 26010.39500 severity: fail exitcode: 1 stack: |- Copied C:\workspace\node-test-binary-windows-js-suites\node\Release\node.exe to C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.980\sea.exe [process 5724]: --- stderr --- Aborted() [process 5724]: --- stdout --- Start injection of NODE_SEA_BLOB in C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.980\sea.exe... Error: Aborted(). Build with -sASSERTIONS for more info. [process 5724]: status = 1, signal = null C:\workspace\node-test-binary-windows-js-suites\node\test\sequential\test-single-executable-application-empty.js:53 throw e; ^ Error: Cannot inject C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.980\sea-prep.blob into C:\workspace\node-test-binary-windows-js-suites\node\test\.tmp.980\sea.exe: Error: - process terminated with status 1, expected 0 ... ```

Reason parallel/test-blob-file-backed
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53184/, https://github.com/nodejs/node/pull/53190/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-ibm-rhel8-s390x-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59510/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59513/
Example ``` not ok 76 parallel/test-blob-file-backed --- duration_ms: 314.03600 severity: fail exitcode: 1 stack: |- node:internal/blob:289 const error = lazyDOMException('The blob could not be read', 'NotReadableError'); ^ DOMException [NotReadableError]: The blob could not be read at BlobReader. (node:internal/blob:289:25) Node.js v23.0.0-pre ... ```

Reason parallel/test-file-write-stream4
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53023/, https://github.com/nodejs/node/pull/52213/)
Appeared test-rackspace-win2019_vs2019-x64-1, test-equinix-ubuntu2004_container-arm64-2, test-azure_msft-win11_vs2022-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59464/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59530/
Example ``` not ok 947 parallel/test-file-write-stream4 --- duration_ms: 120160.53200 severity: fail exitcode: 1 stack: |- timeout ... ```

Reason parallel/test-performance-function
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53150/, https://github.com/nodejs/node/pull/53169/)
Appeared undefined, test-ibm-ubuntu2204-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59500/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59502/
Example ``` not ok 2446 parallel/test-performance-function --- duration_ms: 419.20800 severity: fail exitcode: 1 stack: |- node:internal/event_target:1090 process.nextTick(() => { throw err; }); ^ RangeError [ERR_OUT_OF_RANGE]: The value of "val" is out of range. It must be >= 1 && <= 9007199254740991. Received 0 at RecordableHistogram.record (node:internal/histogram:291:5) at processComplete (node:internal/perf/timerify:40:15) at timerified m (node:internal/perf/timerify:87:5) at /home/iojs/build/workspace/node-test-commit-custom-suites-freestyle/test/parallel/test-performance-function.js:103:5 at runNextTicks (node:internal/process/task_queues:60:5) at listOnTimeout (node:internal/timers:540:9) at process.processTimers (node:internal/timers:514:7) { code: 'ERR_OUT_OF_RANGE' } Node.js v23.0.0-pre ... ```

Reason parallel/test-stream-readable-unpipe-resume
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/52762/, https://github.com/nodejs/node/pull/53154/)
Appeared test-digitalocean-ubuntu2204_sharedlibs_container-x64-9, test-ibm-alpine319_container-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59445/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59491/
Example ``` not ok 3820 parallel/test-stream-readable-unpipe-resume --- duration_ms: 120105.83600 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-worker-console-listeners
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53173/, https://github.com/nodejs/node/pull/53123/)
Appeared test-azure_msft-win10_vs2019-x64-2, test-rackspace-win2022_vs2022-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/59456/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59462/
Example ``` not ok 876 parallel/test-worker-console-listeners --- duration_ms: 365.99700 severity: fail exitcode: 3221226356 stack: |- ... ```

Reason sequential/test-single-executable-application-snapshot-and-code-cache
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/53189/, https://github.com/nodejs/node/pull/53188/)
Appeared test-ibm-ubuntu2204-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/59509/
Last CI https://ci.nodejs.org/job/node-test-pull-request/59517/
Example ``` not ok 4170 sequential/test-single-executable-application-snapshot-and-code-cache --- duration_ms: 12134.33200 severity: fail exitcode: 1 stack: |- Copied /home/iojs/build/workspace/node-test-commit-linux/out/Release/node to /home/iojs/node-tmp/.tmp.4169/sea Injected /home/iojs/node-tmp/.tmp.4169/sea-prep.blob into /home/iojs/node-tmp/.tmp.4169/sea [process 2040392]: --- stderr --- Found SEA blob 0x55a9ee740080, size=4464507 Found SEA resource 0x55a9ee740080, size=4464507 Read()(4-byte), count=1: { 21223968 }, read 4 bytes Read SEA magic 143da20 Read()(4-byte), count=1: { 6 }, read 4 bytes Read SEA flags 6 Read()(8-byte), count=1: { 11 }, read 8 bytes ReadStringView(), length=11: 0x55a9ee740090, read 11 bytes, content: snapshot.js Read SEA code path 0x55a9ee740090, size=11 Read()(8-byte), count=1: { 4464472 }, read 8 bytes ReadStringView(), length=4464472: 0x55a9ee7400a3, read 4464472 bytes Read SEA r... ```

Progress