search

painless-security / trust-router

Moonshot Trust Router
0 stars 0 forks source link

CentOS trust_router services do not start and stop cleanly #96

Open meadmaker opened 6 years ago

meadmaker commented 6 years ago

The trust router service on CentOS does not start cleanly:

[root@tr default]# systemctl start trust_router
Job for trust_router.service failed because the control process exited with error code. See "systemctl status trust_router.service" and "journalctl -xe" for details.

The status command returns:

[root@tr default]# systemctl status trust_router.service -l
● trust_router.service - SYSV: trust_router is the GSS-EAP trust routing daemon.
   Loaded: loaded (/etc/rc.d/init.d/trust_router; bad; vendor preset: disabled)
   Active: failed (Result: exit-code) since Thu 2018-05-31 15:56:43 UTC; 13s ago
     Docs: man:systemd-sysv-generator(8)
  Process: 28765 ExecStart=/etc/rc.d/init.d/trust_router start (code=exited, status=1/FAILURE)
   CGroup: /system.slice/trust_router.service
           └─28779 /usr/bin/trust_router

May 31 15:56:43 tr.qa.painless-security.com trust_router[28765]: Skipping instance tr-test
May 31 15:56:43 tr.qa.painless-security.com systemd[1]: Failed to start SYSV: trust_router is the GSS-EAP trust routing daemon..
May 31 15:56:43 tr.qa.painless-security.com systemd[1]: Unit trust_router.service entered failed state.
May 31 15:56:43 tr.qa.painless-security.com systemd[1]: trust_router.service failed.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: trp_connection_initiate: connection failed.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: tr_trpc_thread: failed to initiate connection to multi.tr.qa.painless-security.com:12308.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: tr_trps_process_mq: outgoing connection to trustrouter/multi.tr.qa.painless-security.com lost.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: trp_connection_initiate: connection failed.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: tr_trpc_thread: failed to initiate connection to peer.example.com:12308.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: tr_trps_process_mq: outgoing connection to trustrouter/peer.example.com lost.

Journalctl outputs:

May 31 15:56:43 tr.qa.painless-security.com systemd[1]: trust_router.service: control process exited, code=exited status=1
May 31 15:56:43 tr.qa.painless-security.com trust_router[28765]: Attempting to authenticate to instance default:12309[FAILED]
May 31 15:56:43 tr.qa.painless-security.com trust_router[28765]: Skipping instance tr-test
May 31 15:56:43 tr.qa.painless-security.com systemd[1]: Failed to start SYSV: trust_router is the GSS-EAP trust routing daemon..
-- Subject: Unit trust_router.service has failed
-- Defined-By: systemd
-- Support: http://lists.freedesktop.org/mailman/listinfo/systemd-devel
-- 
-- Unit trust_router.service has failed.
-- 
-- The result is failed.
May 31 15:56:43 tr.qa.painless-security.com systemd[1]: Unit trust_router.service entered failed state.
May 31 15:56:43 tr.qa.painless-security.com systemd[1]: trust_router.service failed.
May 31 15:56:43 tr.qa.painless-security.com polkitd[10941]: Unregistered Authentication Agent for unix-process:28758:51219106 (system bus name :1.1833, object path /org/freedesktop/PolicyKit1/AuthenticationAgent, locale en_US.UTF-8) 
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: trp_connection_initiate: connection failed.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: tr_trpc_thread: failed to initiate connection to multi.tr.qa.painless-security.com:12308.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: tr_trps_process_mq: outgoing connection to trustrouter/multi.tr.qa.painless-security.com lost.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: trp_connection_initiate: connection failed.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: tr_trpc_thread: failed to initiate connection to peer.example.com:12308.
May 31 15:56:51 tr.qa.painless-security.com trust_router[28779]: tr_trps_process_mq: outgoing connection to trustrouter/peer.example.com lost.
May 31 15:57:01 tr.qa.painless-security.com trust_router[28779]: trp_connection_initiate: connection failed.
May 31 15:57:01 tr.qa.painless-security.com trust_router[28779]: tr_trpc_thread: failed to initiate connection to multi.tr.qa.painless-security.com:12308.
May 31 15:57:01 tr.qa.painless-security.com trust_router[28779]: tr_trps_process_mq: outgoing connection to trustrouter/multi.tr.qa.painless-security.com lost.
May 31 15:57:01 tr.qa.painless-security.com trust_router[28779]: trp_connection_initiate: connection failed.
May 31 15:57:01 tr.qa.painless-security.com trust_router[28779]: tr_trpc_thread: failed to initiate connection to peer.example.com:12308.
May 31 15:57:01 tr.qa.painless-security.com trust_router[28779]: tr_trps_process_mq: outgoing connection to trustrouter/peer.example.com lost.
May 31 15:57:11 tr.qa.painless-security.com trust_router[28779]: trp_connection_initiate: connection failed.
May 31 15:57:11 tr.qa.painless-security.com trust_router[28779]: tr_trpc_thread: failed to initiate connection to multi.tr.qa.painless-security.com:12308.
May 31 15:57:11 tr.qa.painless-security.com trust_router[28779]: tr_trps_process_mq: outgoing connection to trustrouter/multi.tr.qa.painless-security.com lost.
May 31 15:57:11 tr.qa.painless-security.com trust_router[28779]: trp_connection_initiate: connection failed.
May 31 15:57:11 tr.qa.painless-security.com trust_router[28779]: tr_trpc_thread: failed to initiate connection to peer.example.com:12308.
May 31 15:57:11 tr.qa.painless-security.com trust_router[28779]: tr_trps_process_mq: outgoing connection to trustrouter/peer.example.com lost.

Stopping the service doesn't work, either:

[root@tr default]# ps auxwww | grep trust
trustro+ 28649  0.0  0.3 229048  3280 ?        S    15:53   0:00 /usr/bin/trust_router
root     28731  0.0  0.0 112704   960 pts/0    R+   15:55   0:00 grep --color=auto trust
[root@tr default]# 
[root@tr default]# systemctl stop trust_router
[root@tr default]# 
[root@tr default]# ps auxwww | grep trust
trustro+ 28649  0.0  0.3 229048  3280 ?        S    15:53   0:00 /usr/bin/trust_router
root     28741  0.0  0.0 112704   960 pts/0    R+   15:55   0:00 grep --color=auto trust
jennifer-richards commented 6 years ago

This has been present for a while and is medium priority. Taking it out of the monitoring release for later triage and scheduling.