nodejs / reliability

Make the CI green again
33 stars 9 forks source link

CI failures: 20180918 #16

Closed joyeecheung closed 5 years ago

joyeecheung commented 5 years ago

Failures in node-test-pull-request/17202 to node-test-pull-request/17294 that failed more than 2 PRs

Jenkins Failure

Reason java.io.IOException: Backing channel 'JNLP4-connect connection from ... is disconnected.
Type JENKINS_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/22890/, https://github.com/nodejs/node/pull/22903/, https://github.com/nodejs/node/pull/22418/)
Appeared test-digitalocean-freebsd11-x64-2, test-softlayer-ubuntu1804_container-x64-1, test-softlayer-ubuntu1604_sharedlibs_container-x64-1, test-softlayer-ubuntu1604_sharedlibs_container-x64-5
First CI https://ci.nodejs.org/job/node-test-pull-request/17237/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17294/
Example ``` java.io.IOException: Backing channel 'JNLP4-connect connection from 107.170.28.213/107.170.28.213:59136' is disconnected. at hudson.remoting.RemoteInvocationHandler.channelOrFail(RemoteInvocationHandler.java:214) at hudson.remoting.RemoteInvocationHandler.invoke(RemoteInvocationHandler.java:283) at com.sun.proxy.$Proxy85.isAlive(Unknown Source) at hudson.Launcher$RemoteLauncher$ProcImpl.isAlive(Launcher.java:1137) at hudson.Launcher$RemoteLauncher$ProcImpl.join(Launcher.java:1129) ```

Build Failure

Reason ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run?
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/22418/, https://github.com/nodejs/node/pull/22902/, https://github.com/nodejs/node/pull/22861/, https://github.com/nodejs/node/pull/22660/, https://github.com/nodejs/node/pull/22903/)
Appeared test-requireio_williamkapke-debian9-arm64_pi3-1, test-requireio_piccoloaiutante-debian9-arm64_pi3-1, test-requireio_williamkapke-debian9-arm64_pi3-2, test-requireio_continuationlabs-debian9-armv6l_pi1p-1, test-requireio_pivotalagency-debian9-arm64_pi3-1, test-requireio_davglass-debian9-arm64_pi3-1, test-requireio_securogroup-debian9-arm64_pi3-2, test-requireio_kahwee-debian9-arm64_pi3-1, test-requireio_williamkapke-debian9-arm64_pi3-3, test-requireio_pivotalagency-debian9-arm64_pi3-2, test-requireio_securogroup-debian9-armv6l_pi1p-2, test-requireio_notthetup_sayanee-debian9-arm64_pi3-1, test-requireio_securogroup-debian9-arm64_pi3-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17259/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17270/
Example ``` ERROR: Step ‘Publish JUnit test result report’ failed: Test reports were found but none of them are new. Did leafNodes run? For example, /home/iojs/build/workspace/node-test-binary-arm/out/junit/test.xml is 7 hr 53 min old Notifying upstream projects of job completion Finished: FAILURE ```

Reason There is not enough space in the file system.
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/22846/, https://github.com/nodejs/node/pull/21846/, https://github.com/nodejs/node/pull/22740/, https://github.com/nodejs/node/pull/22239/, https://github.com/nodejs/node/pull/20713/)
Appeared test-osuosl-aix61-ppc64_be-2
First CI https://ci.nodejs.org/job/node-test-pull-request/17212/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17216/
Example ``` There is not enough space in the file system. Assembler: /tmp//cct4lCKe.s: line 1844736: 1252-161 A system problem occurred while processing file /tmp/asqMDMaa as: There is not enough space in the file system. Assembler: /tmp//ccsG2kv1.s: line 122: 1252-161 A system problem occurred while processing file /tmp/asaMFMaa ```

Reason sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory
Type BUILD_FAILURE
Failed PR 5 (https://github.com/nodejs/node/pull/22418/, https://github.com/nodejs/node/pull/22902/, https://github.com/nodejs/node/pull/22861/, https://github.com/nodejs/node/pull/22660/, https://github.com/nodejs/node/pull/22903/)
Appeared test-requireio_ceejbot-debian9-armv6l_pi1p-1, test-requireio_louiscntr-debian9-armv7l_pi2-1, test-requireio_mininodes-debian9-armv6l_pi1p-1, test-requireio_svincent-debian9-armv7l_pi2-3, test-requireio_davglass-debian9-armv6l_pi1p-1, test-requireio_mininodes-debian9-armv7l_pi2-1, test-requireio_bengl-debian9-armv6l_pi1p-1, test-requireio_ceejbot-debian9-armv7l_pi2-1, test-requireio_sambthompson-debian9-armv7l_pi2-1, test-requireio_securogroup-debian9-armv6l_pi1p-1, test-requireio_svincent-debian9-armv7l_pi2-1, test-requireio_mcollina-debian9-armv7l_pi2-1, test-requireio_rvagg-debian9-armv7l_pi2-1, test-requireio_mhdawson-debian9-armv6l_pi1p-1, test-requireio_svincent-debian9-armv7l_pi2-2, test-requireio_andineck-debian9-armv6l_pi1p-1, test-requireio_joeyvandijk-debian9-armv7l_pi2-1, test-requireio_jasnell-debian9-armv7l_pi2-1, test-requireio_joeyvandijk-debian9-armv7l_pi2-2, test-requireio_chrislea-debian9-armv6l_pi1p-1, test-requireio_bengl-debian9-armv6l_pi1p-2, test-requireio_indieisaconcept-debian9-armv6l_pi1p-1, test-requireio_continuationlabs-debian9-armv6l_pi1p-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17259/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17270/
Example ``` sh: line 41: /home/iojs/.ssh/known_hosts: No such file or directory ```

Reason Error: 'NoneType' object has no attribute 'getitem'
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/22418/, https://github.com/nodejs/node/pull/22858/, https://github.com/nodejs/node/pull/22788/)
Appeared test-softlayer-ubuntu1404-x86-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17259/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17283/
Example ``` Error: 'NoneType' object has no attribute '__getitem__' POST BUILD TASK : FAILURE END OF POST BUILD TASK : 0 Recording test results Recording fingerprints Notifying upstream projects of job completion ```

Reason error: pathspec ... did not match any file(s) known to git.
Type BUILD_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/22880/, https://github.com/nodejs/node/pull/22418/, https://github.com/nodejs/node/pull/22914/)
Appeared test-azure_msft-win10-x64-1, test-azure_msft-win10-x64-4, test-azure_msft-win10-x64-2, test-azure_msft-win10-x64-3, test-rackspace-win2008r2-x64-6, test-azure_msft-win2016-x64-5, test-azure_msft-win2016-x64-2, test-azure_msft-win2016-x64-4, test-azure_msft-win2016-x64-3, test-rackspace-win2012r2-x64-4, test-rackspace-win2012r2-x64-5, test-rackspace-win2012r2-x64-3, test-rackspace-win2012r2-x64-1, test-rackspace-win2008r2-x64-2, test-rackspace-win2008r2-x64-1, test-azure_msft-win2008r2-x64-1, test-azure_msft-win2008r2-x64-2, test-rackspace-win2012r2-x64-9, test-rackspace-win2012r2-x64-2, test-rackspace-win2012r2-x64-7, test-azure_msft-win2012r2-x64-1, test-rackspace-win2012r2-x64-8, test-azure_msft-win2012r2-x64-2, test-rackspace-win2012r2-x64-6, test-azure_msft-win2012r2-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/17218/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17293/
Example ``` error: pathspec 'refs/remotes/jenkins_tmp/jenkins-node-test-commit-windows-fanned-20827-bin-win-vs2017' did not match any file(s) known to git. c:\workspace\node-test-binary-windows>if 1 NEQ 0 exit /b 1 Build step 'Execute Windows batch command' marked build as failure Run condition [Always] enabling perform for step [[Execute Windows batch command, Execute shell]] [node-test-binary-windows] $ cmd /c call C:\Users\ADMINI~1\AppData\Local\Temp\jenkins375521525818467789.bat ```

Reason ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error?
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/22754/, https://github.com/nodejs/node/pull/22920/)
Appeared test-digitalocean-freebsd11-x64-2, test-joyent-smartos16-x64-1, test-joyent-smartos17-x64-2, test-joyent-smartos16-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/17231/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17273/
Example ``` ERROR: Step ?Publish JUnit test result report? failed: No test report files were found. Configuration error? Notifying upstream projects of job completion Finished: FAILURE ```

Reason fatal: Could not read from remote repository.
Type BUILD_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/22878/, https://github.com/nodejs/node/pull/22550/)
Appeared test-azure_msft-win2016-x64-4, test-azure_msft-win10-x64-1, test-azure_msft-win2016-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/17207/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17211/
Example ``` fatal: Could not read from remote repository. ```

JSTest Failure

Reason parallel/test-heapdump-worker
Type JS_TEST_FAILURE
Failed PR 7 (https://github.com/nodejs/node/pull/22846/, https://github.com/nodejs/node/pull/22911/, https://github.com/nodejs/node/pull/22797/, https://github.com/nodejs/node/pull/22868/, https://github.com/nodejs/node/pull/22932/, https://github.com/nodejs/node/pull/22861/, https://github.com/nodejs/node/pull/22218/)
Appeared test-azure_msft-win2016-x64-4, test-azure_msft-win2016-x64-2, test-digitalocean-ubuntu1604_sharedlibs_container-x64-6, test-joyent-ubuntu1604_sharedlibs_container-x64-3, test-digitalocean-ubuntu1604_sharedlibs_container-x64-10, test-digitalocean-ubuntu1604_sharedlibs_container-x64-1, test-digitalocean-alpine37_container-x64-2, test-softlayer-centos6-x64-1, test-rackspace-centos7-x64-1, test-rackspace-fedora27-x64-1, test-softlayer-ubuntu1404-x64-1, test-rackspace-ubuntu1604-x64-1, test-joyent-ubuntu1710-x64-1, test-digitalocean-ubuntu1804_container-x64-2, test-macstadium-macos10.11-x64-2, test-osuosl-ubuntu1404-ppc64_le-1, test-joyent-smartos16-x64-1, test-joyent-smartos17-x64-2, test-scaleway-ubuntu1604-armv7l-1, test-packetnet-ubuntu1604-arm64-2, test-requireio_indieisaconcept-debian9-armv6l_pi1p-1, test-requireio_joeyvandijk-debian9-armv7l_pi2-1, test-requireio_pivotalagency-debian9-arm64_pi3-2, undefined
First CI https://ci.nodejs.org/job/node-test-pull-request/17212/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17290/
Example ``` not ok 187 parallel/test-heapdump-worker --- duration_ms: 2.562 severity: fail exitcode: 134 stack: |- npm[7204]: src\inspector_agent.cc:729: Assertion `(client_) != nullptr' failed. 1: 00007FF7D0FB0B05 2: 00007FF7D0F8A0E6 3: 00007FF7D0F8A1B1 4: 00007FF7D0E9B476 5: 00007FF7D0EEEA9C 6: 00007FF7D0FE9AE4 7: 00007FF7D1A43080 8: 00007FF8A2648364 9: 00007FF8A3EDE851 ... ```

Reason parallel/test-zlib-convenience-methods
Type JS_TEST_FAILURE
Failed PR 6 (https://github.com/nodejs/node/pull/22846/, https://github.com/nodejs/node/pull/22331/, https://github.com/nodejs/node/pull/22904/, https://github.com/nodejs/node/pull/22660/, https://github.com/nodejs/node/pull/22927/, https://github.com/nodejs/node/pull/22932/)
Appeared test-softlayer-ubuntu1404-x86-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17212/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17285/
Example ``` not ok 2030 parallel/test-zlib-convenience-methods --- duration_ms: 0.282 severity: crashed exitcode: -6 stack: |- *** Error in `out/Release/node': double free or corruption (!prev): 0x0d3f3800 *** ... ```

Reason parallel/test-http2-pipe
Type JS_TEST_FAILURE
Failed PR 3 (https://github.com/nodejs/node/pull/22858/, https://github.com/nodejs/node/pull/22914/, https://github.com/nodejs/node/pull/22932/)
Appeared test-rackspace-win2008r2-x64-6, test-rackspace-win2008r2-x64-3
First CI https://ci.nodejs.org/job/node-test-pull-request/17238/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17285/
Example ``` not ok 270 parallel/test-http2-pipe --- duration_ms: 0.321 severity: fail exitcode: 1 stack: |- events.js:167 throw er; // Unhandled 'error' event ^ Error: read ECONNRESET at TCP.onStreamRead (internal/stream_base_commons.js:111:27) Emitted 'error' event at: at emitErrorNT (internal/streams/destroy.js:82:8) at emitErrorAndCloseNT (internal/streams/destroy.js:50:3) at process._tickCallback (internal/process/next_tick.js:63:19) ... ```

Reason addons/stringbytes-external-exceed-max/test-stringbytes-external-exceed-max-by-1-binary
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/22880/, https://github.com/nodejs/node/pull/22888/)
Appeared test-requireio-osx1010-x64-1, test-digitalocean-freebsd11-x64-2
First CI https://ci.nodejs.org/job/node-test-pull-request/17208/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17221/
Example ``` not ok 1905 addons/stringbytes-external-exceed-max/test-stringbytes-external-exceed-max-by-1-binary --- duration_ms: 120.707 severity: fail exitcode: -15 stack: |- timeout ... ```

Reason parallel/test-worker-syntax-error
Type JS_TEST_FAILURE
Failed PR 2 (https://github.com/nodejs/node/pull/22843/, https://github.com/nodejs/node/pull/22239/)
Appeared test-azure_msft-win10-x64-3, test-rackspace-win2012r2-x64-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17202/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17215/
Example ``` not ok 521 parallel/test-worker-syntax-error --- duration_ms: 0.195 severity: fail exitcode: 1 stack: |- Mismatched function calls. Expected exactly 1, actual 0. at Object.mustCall (c:\workspace\node-test-binary-windows\test\common\index.js:310:10) at Object. (c:\workspace\node-test-binary-windows\test\parallel\test-worker-syntax-error.js:12:24) at Module._compile (internal/modules/cjs/loader.js:693:30) at Object.Module._extensions..js (internal/modules/cjs/loader.js:704:10) at Module.load (internal/modules/cjs/loader.js:603:32) at tryModuleLoad (internal/modules/cjs/loader.js:542:12) at Function.Module._load (internal/modules/cjs/loader.js:534:3) at Function.Module.runMain (internal/modules/cjs/loader.js:746:12) at startup (internal/bootstrap/node.js:270:19) ... ```

Git Failure

Reason warning: failed to remove out/Release/.nfs0000000000c2d81c00000c87
Type GIT_FAILURE
Failed PR 16 (https://github.com/nodejs/node/pull/22239/, https://github.com/nodejs/node/pull/22888/, https://github.com/nodejs/node/pull/22788/, https://github.com/nodejs/node/pull/22331/, https://github.com/nodejs/node/pull/22845/, https://github.com/nodejs/node/pull/22754/, https://github.com/nodejs/node/pull/22898/, https://github.com/nodejs/node/pull/22861/, https://github.com/nodejs/node/pull/22902/, https://github.com/nodejs/node/pull/22418/, https://github.com/nodejs/node/pull/22890/, https://github.com/nodejs/node/pull/22858/, https://github.com/nodejs/node/pull/22834/, https://github.com/nodejs/node/pull/22903/, https://github.com/nodejs/node/pull/21846/, https://github.com/nodejs/node/pull/22900/)
Appeared test-requireio_continuationlabs-debian9-armv6l_pi1p-1
First CI https://ci.nodejs.org/job/node-test-pull-request/17215/
Last CI https://ci.nodejs.org/job/node-test-pull-request/17251/
Example ``` warning: failed to remove out/Release/.nfs0000000000c2d81c00000c87 ```
joyeecheung commented 5 years ago

Progress

In progress

Fixed

refack commented 5 years ago
joaocgreis commented 5 years ago

The fatal: Could not read from remote repository. should be fixed. I have a PR on the slow simmer with temp repo updates, but this part is already there.

refack commented 5 years ago

https://github.com/nodejs/node/pull/22941 landed marking 4 windows flaky test