search

shinken-solutions / shinken

Flexible and scalable monitoring framework
http://www.shinken-monitoring.org
GNU Affero General Public License v3.0
1.14k stars 335 forks source link

thruck : ERROR: failed to connect. (localhost:50000) #2000

Closed nsarpaux closed 4 years ago

nsarpaux commented 4 years ago

Hello

I got a error today suddenly on a normally running config on the thruk interface ERROR: failed to connect. (localhost:50000)

When I look on /var/log/shinken/brokerd.log i got this error message :

2020-05-20 12:50:09,236 [1589971809] Error : [broker-master] The external module Livestatus goes down unexpectedly! 2020-05-20 12:50:11,358 [1589971811] Error : [Livestatus Query] Error: 'Services' object has no attribute 'itersorted' 2020-05-20 12:50:11,420 [1589971811] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:11,450 [1589971811] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:11,490 [1589971811] Error : [Livestatus Query] Error: 'Services' object has no attribute 'itersorted' 2020-05-20 12:50:11,520 [1589971811] Error : [Livestatus Query] Error: 'Services' object has no attribute 'itersorted' 2020-05-20 12:50:11,543 [1589971811] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:11,593 [1589971811] Error : [Livestatus Query] Error: 'Services' object has no attribute 'itersorted' 2020-05-20 12:50:11,638 [1589971811] Error : [Livestatus Query] Error: 'Hostgroups' object has no attribute 'itersorted' 2020-05-20 12:50:11,660 [1589971811] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:12,214 [1589971812] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:12,280 [1589971812] Error : [Livestatus Query] Error: 'Services' object has no attribute 'itersorted' 2020-05-20 12:50:12,322 [1589971812] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:12,367 [1589971812] Error : [Livestatus Query] Error: 'Services' object has no attribute 'itersorted' 2020-05-20 12:50:12,408 [1589971812] Error : [Livestatus Query] Error: 'Hostgroups' object has no attribute 'itersorted' 2020-05-20 12:50:14,380 [1589971814] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:23,973 [1589971823] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:24,015 [1589971824] Error : [Livestatus Query] Error: 'Services' object has no attribute 'itersorted' 2020-05-20 12:50:28,863 [1589971828] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:28,911 [1589971828] Error : [Livestatus Query] Error: 'Services' object has no attribute 'itersorted' 2020-05-20 12:50:28,953 [1589971828] Error : [Livestatus Query] Error: 'Hosts' object has no attribute 'itersorted' 2020-05-20 12:50:28,995 [1589971828] Error : [Livestatus Query] Error: 'Hostgroups' object has no attribute 'itersorted' 2020-05-20 12:50:41,471 [1589971841] Critical : [broker-master] I got an unrecoverable error. I have to exit

Here is the content of the shinken-specific.cfg file but no change append on it. define module { module_type livestatus module_name Livestatus modules logsqlite host * port 50000 } define module { max_logs_age 3m module_name logsqlite module_type logstore_sqlite database_file /var/log/shinken/livelogs.db }

Itried to restart shinken and thruk but same result

thruk Version 1.64

nsarpaux commented 4 years ago

Solved by using 

config check
arbiter reload
wait 120 seconds
broker restart