search

rethinkdb / rethinkdb

The open-source database for the realtime web.
https://rethinkdb.com
Other
26.76k stars 1.86k forks source link

"cannot write to stdout/stderr: Broken pipe" #4731

Open RubenKelevra opened 9 years ago

RubenKelevra commented 9 years ago

I've got an issue on one node of my 5 server cluster test-installation.

4 of 5 Servers run Arch Linux, one is running Debian Jessie. Fulla is running Arch Linux as well. The only difference is that Fulla is longer installed than the others and I'm connecting to fully via ssh-forwarding for the administrations-panel.

Since ArchLinux is using systemd, RethinkDB should send it's logs to journalctl ... and this seems to work. So the question is, what's going wrong there:

[root@fulla ruben]# systemctl status rethinkdb@freifunk ● rethinkdb@freifunk.service - RethinkDB database server for instance 'freifunk' Loaded: loaded (/usr/lib/systemd/system/rethinkdb@.service; enabled; vendor preset: disabled) Active: active (running) since Mi 2015-08-19 02:04:55 CEST; 1 day 6h ago Main PID: 8677 (rethinkdb) CGroup: /system.slice/system-rethinkdb.slice/rethinkdb@freifunk.service ├─8677 /usr/bin/rethinkdb serve --config-file /etc/rethinkdb/instances.d/freif... ├─8678 /usr/bin/rethinkdb serve --config-file /etc/rethinkdb/instances.d/freif... └─8750 /usr/bin/rethinkdb serve --config-file /etc/rethinkdb/instances.d/freif...

Aug 19 02:04:56 fulla rethinkdb[8677]: Connected to server "lofn" b2640e3d-d2e1-42bf-9...39f Aug 19 02:04:57 fulla rethinkdb[8677]: Listening for client driver connections on port 28015 Aug 19 02:04:57 fulla rethinkdb[8677]: Listening for administrative HTTP connections o...080 Aug 19 02:04:57 fulla rethinkdb[8677]: Listening on addresses: 127.0.0.1, 10....e%8 Aug 19 02:04:57 fulla rethinkdb[8677]: Server ready, "fulla" 69853f9c-4628-4005-9cd8-0...e60 Aug 19 02:10:54 fulla rethinkdb[8677]: error: Heartbeat timeout, killing connection to...015 Aug 19 02:10:54 fulla rethinkdb[8677]: Disconnected from server "saga" 14ada833-c6f5-4...049 Aug 19 02:18:42 fulla rethinkdb[8677]: Connected to server "saga" 14ada833-c6f5-46c0-a...049 Aug 19 02:23:23 fulla rethinkdb[8677]: error: Heartbeat timeout, killing connection to...983 Aug 19 02:23:23 fulla rethinkdb[8677]: Disconnected from server "saga" 14ada833-c6f5-4...049 Hint: Some lines were ellipsized, use -l to show in full.

RubenKelevra commented 9 years ago

http://i.imgur.com/I68CHkf.png

danielmewes commented 9 years ago

How exactly are you making RethinkDB log to journalctl?

RubenKelevra commented 9 years ago

In changed nothing in the config-file which is related to logging, so this seems to be default.

danielmewes commented 9 years ago

I see. One more question: Did you install a systemd script/configuration or are you using the default /etc/init.d/rethinkdb script for starting RethinkDB?

RubenKelevra commented 9 years ago

I use the .service file from ArchLinux-Repo:

https://projects.archlinux.org/svntogit/community.git/tree/trunk/rethinkdb.service?h=packages/rethinkdb

RubenKelevra commented 7 years ago

Strangely this issue is now gone on the server, mentioned before, but is now happening on a different server. Since there is nearly no load on this server, it might be a simple timeout, cause the server is virtual and might be swapped out by the hypervisor?

Just an idea... :)