Kibana server is not ready yet

[LnkSaber]

how to finish it?

[LnkSaber]

my logs

[spujadas]

Need your complete logs please.

[LnkSaber]

==> /var/log/kibana/kibana5.log <==

{"type":"log","@timestamp":"2019-11-27T03:10:30Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:30Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

{"type":"log","@timestamp":"2019-11-27T03:10:32Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:32Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <==

[2019-11-27T03:10:35,205][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <==

{"type":"log","@timestamp":"2019-11-27T03:10:34Z","tags":["warning","elasticsearch","data"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:34Z","tags":["license","warning","xpack"],"pid":240,"message":"License information from the X-Pack plugin could not be obtained from Elasticsearch for the [data] cluster. Error: No Living connections"}

{"type":"log","@timestamp":"2019-11-27T03:10:34Z","tags":["warning","elasticsearch","data"],"pid":240,"message":"No living connections"}

{"type":"log","@timestamp":"2019-11-27T03:10:35Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:35Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

Terminating ELK

• Stopping Elasticsearch Server

  ...done.

Killing logstash (pid 224) with SIGTERM

Waiting for logstash (pid 224) to die...

==> /var/log/logstash/logstash-plain.log <==

[2019-11-27T03:10:38,178][WARN ][logstash.runner ] SIGTERM received. Shutting down.

==> /var/log/kibana/kibana5.log <==

{"type":"log","@timestamp":"2019-11-27T03:10:37Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:37Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

Waiting for logstash (pid 224) to die...

{"type":"log","@timestamp":"2019-11-27T03:10:38Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:38Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

Waiting for logstash (pid 224) to die...

==> /var/log/logstash/logstash-plain.log <==

[2019-11-27T03:10:40,217][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

Waiting for logstash (pid 224) to die...

==> /var/log/kibana/kibana5.log <==

{"type":"log","@timestamp":"2019-11-27T03:10:40Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:40Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

Waiting for logstash (pid 224) to die...

logstash stop failed; still running.

• Stopping Kibana5

{"type":"log","@timestamp":"2019-11-27T03:10:42Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:42Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

...done.

• Starting periodic command scheduler cron

  ...done.

• Starting Elasticsearch Server

future versions of Elasticsearch will require Java 11; your Java version from [/usr/lib/jvm/java-8-openjdk-amd64/jre] does not meet this requirement

...done.

waiting for Elasticsearch to be up (1/30)

waiting for Elasticsearch to be up (2/30)

waiting for Elasticsearch to be up (3/30)

waiting for Elasticsearch to be up (4/30)

waiting for Elasticsearch to be up (5/30)

waiting for Elasticsearch to be up (6/30)

waiting for Elasticsearch to be up (7/30)

waiting for Elasticsearch to be up (8/30)

waiting for Elasticsearch to be up (9/30)

waiting for Elasticsearch to be up (10/30)

waiting for Elasticsearch to be up (11/30)

Waiting for Elasticsearch cluster to respond (1/30)

logstash started.

• Starting Kibana5

  ...done.

==> /var/log/elasticsearch/elasticsearch.log <==

[2019-12-02T06:34:34,065][INFO ][o.e.t.TransportService ] [elk] publish_address {172.22.0.2:9300}, bound_addresses {0.0.0.0:9300}

[2019-12-02T06:34:34,077][INFO ][o.e.b.BootstrapChecks ] [elk] bound or publishing to a non-loopback address, enforcing bootstrap checks

[2019-12-02T06:34:34,120][INFO ][o.e.c.c.Coordinator ] [elk] cluster UUID [Xa6k2lARS8yu983dCrQC1g]

[2019-12-02T06:34:34,347][INFO ][o.e.c.s.MasterService ] [elk] elected-as-master ([1] nodes joined)[{elk}{eSspdTRqT7SYo_U9AnZQRA}{u1PCJe3eSo2mQ4tHUkZGMg}{172.22.0.2}{172.22.0.2:9300}{dilm}{ml.machine_memory=2095968256, xpack.installed=true, ml.max_open_jobs=20} elect leader, _BECOME_MASTERTASK, _FINISHELECTION], term: 3, version: 21, reason: master node changed {previous [], current [{elk}{eSspdTRqT7SYo_U9AnZQRA}{u1PCJe3eSo2mQ4tHUkZGMg}{172.22.0.2}{172.22.0.2:9300}{dilm}{ml.machine_memory=2095968256, xpack.installed=true, ml.max_open_jobs=20}]}

[2019-12-02T06:34:34,430][INFO ][o.e.c.s.ClusterApplierService] [elk] master node changed {previous [], current [{elk}{eSspdTRqT7SYo_U9AnZQRA}{u1PCJe3eSo2mQ4tHUkZGMg}{172.22.0.2}{172.22.0.2:9300}{dilm}{ml.machine_memory=2095968256, xpack.installed=true, ml.max_open_jobs=20}]}, term: 3, version: 21, reason: Publication{term=3, version=21}

[2019-12-02T06:34:34,619][INFO ][o.e.h.AbstractHttpServerTransport] [elk] publish_address {172.22.0.2:9200}, bound_addresses {0.0.0.0:9200}

[2019-12-02T06:34:34,621][INFO ][o.e.n.Node ] [elk] started

[2019-12-02T06:34:34,953][INFO ][o.e.l.LicenseService ] [elk] license [1aa688c7-6cc3-4435-9645-72a6fc9bd27e] mode [basic] - valid

[2019-12-02T06:34:34,957][INFO ][o.e.x.s.s.SecurityStatusChangeListener] [elk] Active license is now [BASIC]; Security is disabled

[2019-12-02T06:34:34,969][INFO ][o.e.g.GatewayService ] [elk] recovered [0] indices into cluster_state

==> /var/log/logstash/logstash-plain.log <==

[2019-11-27T03:09:58,203][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

[2019-11-27T03:10:03,213][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

[2019-11-27T03:10:09,187][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

[2019-11-27T03:10:14,198][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

[2019-11-27T03:10:19,207][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

[2019-11-27T03:10:24,220][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

[2019-11-27T03:10:29,230][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

[2019-11-27T03:10:35,205][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

[2019-11-27T03:10:38,178][WARN ][logstash.runner ] SIGTERM received. Shutting down.

[2019-11-27T03:10:40,217][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <==

{"type":"log","@timestamp":"2019-11-27T03:10:35Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:35Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

{"type":"log","@timestamp":"2019-11-27T03:10:37Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:37Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

{"type":"log","@timestamp":"2019-11-27T03:10:38Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:38Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

{"type":"log","@timestamp":"2019-11-27T03:10:40Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:40Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

{"type":"log","@timestamp":"2019-11-27T03:10:42Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"Unable to revive connection: http://localhost:9200/"}

{"type":"log","@timestamp":"2019-11-27T03:10:42Z","tags":["warning","elasticsearch","admin"],"pid":240,"message":"No living connections"}

[LnkSaber]

Should I exchange jdk8 for jdk11? How to solve it? —_—~~~~

[spujadas]

waiting for Elasticsearch to be up (11/30)

Waiting for Elasticsearch cluster to respond (1/30)

This looks good to me. Can you connect to Elasticsearch manually (e.g. http://yourhost:9200)?

==> /var/log/elasticsearch/elasticsearch.log <== ... [2019-12-02T06:34:34,969][INFO ][o.e.g.GatewayService ] [elk] recovered [0] indices into cluster_state

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T03:09:58,203][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

Strangely, the timestamps from Logstash and Kibana (dated 2019-11-27) do not match those from Elasticsearch (2019-12-02): are these logs continuously produced by a full start-up process?

Should I exchange jdk8 for jdk11?

No need, the image works fine as is with JDK8.

[LnkSaber]

I can connect to Elasticsearch manually (like http://localhost:9200),but Kibana can't（http://localhost:5601）

[LnkSaber]

mac@MacdeMacBook-Pro-3 ~ % docker logs -f ec0b11779689

• Starting periodic command scheduler cron ...done.
• Starting Elasticsearch Server future versions of Elasticsearch will require Java 11; your Java version from [/usr/lib/jvm/java-8-openjdk-amd64/jre] does not meet this requirement ...done. waiting for Elasticsearch to be up (1/30) waiting for Elasticsearch to be up (2/30) waiting for Elasticsearch to be up (3/30) waiting for Elasticsearch to be up (4/30) waiting for Elasticsearch to be up (5/30) waiting for Elasticsearch to be up (6/30) waiting for Elasticsearch to be up (7/30) waiting for Elasticsearch to be up (8/30) waiting for Elasticsearch to be up (9/30) waiting for Elasticsearch to be up (10/30) waiting for Elasticsearch to be up (11/30) Waiting for Elasticsearch cluster to respond (1/30) logstash started.
• Starting Kibana5 ...done. ==> /var/log/elasticsearch/elasticsearch.log <== [2019-11-27T02:10:40,005][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elk] adding template [.slm-history] for index patterns [.slm-history-1] [2019-11-27T02:10:40,059][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elk] adding template [.monitoring-logstash] for index patterns [.monitoring-logstash-7-] [2019-11-27T02:10:40,119][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elk] adding template [.monitoring-es] for index patterns [.monitoring-es-7-] [2019-11-27T02:10:40,153][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elk] adding template [.monitoring-beats] for index patterns [.monitoring-beats-7-] [2019-11-27T02:10:40,177][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elk] adding template [.monitoring-alerts-7] for index patterns [.monitoring-alerts-7] [2019-11-27T02:10:40,200][INFO ][o.e.c.m.MetaDataIndexTemplateService] [elk] adding template [.monitoring-kibana] for index patterns [.monitoring-kibana-7-*] [2019-11-27T02:10:40,223][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk] adding index lifecycle policy [watch-history-ilm-policy] [2019-11-27T02:10:40,271][INFO ][o.e.x.i.a.TransportPutLifecycleAction] [elk] adding index lifecycle policy [slm-history-ilm-policy] [2019-11-27T02:10:40,487][INFO ][o.e.l.LicenseService ] [elk] license [1aa688c7-6cc3-4435-9645-72a6fc9bd27e] mode [basic] - valid [2019-11-27T02:10:40,488][INFO ][o.e.x.s.s.SecurityStatusChangeListener] [elk] Active license is now [BASIC]; Security is disabled

==> /var/log/logstash/logstash-plain.log <==

==> /var/log/kibana/kibana5.log <==

==> /var/log/elasticsearch/elasticsearch.log <== [2019-11-27T02:11:17,744][INFO ][o.e.m.j.JvmGcMonitorService] [elk] [gc][35] overhead, spent [400ms] collecting in the last [1s]

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:14:01Z","tags":["info","plugins-system"],"pid":247,"message":"Setting up [4] plugins: [security,translations,inspector,data]"} {"type":"log","@timestamp":"2019-11-27T02:14:01Z","tags":["info","plugins","security"],"pid":247,"message":"Setting up plugin"} {"type":"log","@timestamp":"2019-11-27T02:14:01Z","tags":["warning","plugins","security","config"],"pid":247,"message":"Generating a random key for xpack.security.encryptionKey. To prevent sessions from being invalidated on restart, please set xpack.security.encryptionKey in kibana.yml"} {"type":"log","@timestamp":"2019-11-27T02:14:01Z","tags":["warning","plugins","security","config"],"pid":247,"message":"Session cookies will be transmitted over insecure connections. This is not recommended."} {"type":"log","@timestamp":"2019-11-27T02:14:01Z","tags":["info","plugins","translations"],"pid":247,"message":"Setting up plugin"} {"type":"log","@timestamp":"2019-11-27T02:14:01Z","tags":["info","plugins","data"],"pid":247,"message":"Setting up plugin"} {"type":"log","@timestamp":"2019-11-27T02:14:01Z","tags":["info","plugins-system"],"pid":247,"message":"Starting [3] plugins: [security,translations,data]"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:16:13,785][INFO ][logstash.setting.writabledirectory] Creating directory {:setting=>"path.queue", :path=>"/opt/logstash/data/queue"} [2019-11-27T02:16:13,810][INFO ][logstash.setting.writabledirectory] Creating directory {:setting=>"path.dead_letter_queue", :path=>"/opt/logstash/data/dead_letter_queue"} [2019-11-27T02:16:14,646][INFO ][logstash.runner ] Starting Logstash {"logstash.version"=>"7.4.0"} [2019-11-27T02:16:14,691][INFO ][logstash.agent ] No persistent UUID file found. Generating new UUID {:uuid=>"368c6c73-c292-4840-96ff-bd7d033751aa", :path=>"/opt/logstash/data/uuid"} [2019-11-27T02:16:19,097][INFO ][org.reflections.Reflections] Reflections took 80 ms to scan 1 urls, producing 20 keys and 40 values [2019-11-27T02:16:21,044][INFO ][logstash.outputs.elasticsearch][main] Elasticsearch pool URLs updated {:changes=>{:removed=>[], :added=>[http://localhost:9200/]}} [2019-11-27T02:16:21,358][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"} [2019-11-27T02:16:21,411][INFO ][logstash.outputs.elasticsearch][main] New Elasticsearch output {:class=>"LogStash::Outputs::ElasticSearch", :hosts=>["//localhost"]} [2019-11-27T02:16:21,991][WARN ][org.logstash.instrument.metrics.gauge.LazyDelegatingGauge][main] A gauge metric of an unknown type (org.jruby.RubyArray) has been create for key: cluster_uuids. This may result in invalid serialization. It is recommended to log an issue to the responsible developer/development team. [2019-11-27T02:16:21,997][INFO ][logstash.javapipeline ][main] Starting pipeline {:pipeline_id=>"main", "pipeline.workers"=>4, "pipeline.batch.size"=>125, "pipeline.batch.delay"=>50, "pipeline.max_inflight"=>500, :thread=>"#"} [2019-11-27T02:16:23,088][INFO ][logstash.inputs.beats ][main] Beats inputs: Starting input listener {:address=>"0.0.0.0:5044"} [2019-11-27T02:16:23,141][INFO ][logstash.javapipeline ][main] Pipeline started {"pipeline.id"=>"main"} [2019-11-27T02:16:23,304][INFO ][logstash.agent ] Pipelines running {:count=>1, :running_pipelines=>[:main], :non_running_pipelines=>[]} [2019-11-27T02:16:23,378][INFO ][org.logstash.beats.Server][main] Starting server on port: 5044 [2019-11-27T02:16:23,913][INFO ][logstash.agent ] Successfully started Logstash API endpoint {:port=>9600} [2019-11-27T02:16:26,440][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:kibana@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:elasticsearch@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:xpack_main@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:telemetry@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:graph@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:monitoring@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:spaces@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:security@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:searchprofiler@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:ml@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:tilemap@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:watcher@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:grokdebugger@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:dashboard_mode@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:logstash@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:beats_management@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:apm_oss@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:apm@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:code@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:data@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:visualizations@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:interpreter@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:tile_map@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:task_manager@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:maps@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:canvas@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:license_management@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:cloud@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:index_management@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:console@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:console_extensions@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:index_lifecycle_management@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:metrics@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:infra@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:rollup@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["info","siem"],"pid":247,"message":"Plugin initializing"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["info","siem"],"pid":247,"message":"Plugin done initializing"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:siem@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:remote_clusters@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:cross_cluster_replication@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:upgrade_assistant@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:uptime@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:oss_telemetry@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:file_upload@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["warning","encrypted_saved_objects"],"pid":247,"message":"Generating a random key for xpack.encrypted_saved_objects.encryptionKey. To be able to decrypt encrypted saved objects attributes after restart, please set xpack.encrypted_saved_objects.encryptionKey in kibana.yml"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:encrypted_saved_objects@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:snapshot_restore@7.4.0","info"],"pid":247,"state":"yellow","message":"Status changed from uninitialized to yellow - Waiting for Elasticsearch","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:region_map@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:kibana_react@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:timelion@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:ui_metric@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:metric_vis@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:table_vis@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:markdown_vis@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:vega@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:30Z","tags":["status","plugin:tagcloud@7.4.0","info"],"pid":247,"state":"green","message":"Status changed from uninitialized to green - Ready","prevState":"uninitialized","prevMsg":"uninitialized"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:16:31,458][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["error","elasticsearch","admin"],"pid":247,"message":"Request error, retrying\nHEAD http://localhost:9200/.apm-agent-configuration => connect ECONNREFUSED 127.0.0.1:9200"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["error","elasticsearch","admin"],"pid":247,"message":"Request error, retrying\nGET http://localhost:9200/_nodes?filter_path=nodes.*.version%2Cnodes.*.http.publish_address%2Cnodes.*.ip => connect ECONNREFUSED 127.0.0.1:9200"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:xpack_main@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:graph@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:spaces@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:searchprofiler@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:ml@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:tilemap@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:watcher@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:grokdebugger@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:logstash@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:beats_management@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:maps@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:index_management@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:index_lifecycle_management@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:rollup@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:remote_clusters@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:cross_cluster_replication@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:file_upload@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:snapshot_restore@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["status","plugin:elasticsearch@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from yellow to red - No Living connections","prevState":"yellow","prevMsg":"Waiting for Elasticsearch"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["error","elasticsearch","data"],"pid":247,"message":"Request error, retrying\nGET http://localhost:9200/_xpack => connect ECONNREFUSED 127.0.0.1:9200"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["warning","elasticsearch","data"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["license","warning","xpack"],"pid":247,"message":"License information from the X-Pack plugin could not be obtained from Elasticsearch for the [data] cluster. Error: No Living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:32Z","tags":["warning","elasticsearch","data"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:34Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:34Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["reporting","warning"],"pid":247,"message":"Generating a random key for xpack.reporting.encryptionKey. To prevent pending reports from failing on restart, please set xpack.reporting.encryptionKey in kibana.yml"} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["status","plugin:reporting@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from uninitialized to red - No Living connections","prevState":"uninitialized","prevMsg":"uninitialized"} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["status","plugin:security@7.4.0","error"],"pid":247,"state":"red","message":"Status changed from green to red - No Living connections","prevState":"green","prevMsg":"Ready"} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["reporting","warning"],"pid":247,"message":"The Reporting plugin encountered issues launching Chromium in a self-test. You may have trouble generating reports: [Error: Failed to launch chrome!\n[1127/021635.252841:WARNING:resource_bundle.cc(358)] locale_file_path.empty() for locale \n[1127/021635.253470:FATAL:zygote_host_impl_linux.cc(116)] No usable sandbox! Update your kernel or see https://chromium.googlesource.com/chromium/src/+/master/docs/linux_suid_sandbox_development.md for more information on developing with the SUID sandbox. If you want to live dangerously and need an immediate workaround, you can try using --no-sandbox.\n#0 0x56514331dbf9 \n#1 0x56514328a783 \n#2 0x56514329de23 \n#3 0x56514475c2ee \n#4 0x56514324a0f8 \n#5 0x56514476298c \n#6 0x565143243ad1 \n#7 0x565143286c3d \n#8 0x5651432869bb \n#9 0x7f4e43211b97 __libc_start_main\n#10 0x56514178d02a _start\n\nReceived signal 6\n#0 0x56514331dbf9 \n#1 0x56514328a783 \n#2 0x56514331d781 \n#3 0x7f4e4499a890 \n#4 0x7f4e4322ee97 gsignal\n#5 0x7f4e43230801 abort\n#6 0x56514331c5c5 \n#7 0x56514329e107 \n#8 0x56514475c2ee \n#9 0x56514324a0f8 \n#10 0x56514476298c \n#11 0x565143243ad1 \n#12 0x565143286c3d \n#13 0x5651432869bb \n#14 0x7f4e43211b97 __libc_start_main\n#15 0x56514178d02a _start\n r8: 0000000000000000 r9: 00007ffe9b48b3b0 r10: 0000000000000008 r11: 0000000000000246\n r12: 00007ffe9b48c678 r13: 000019db0c7c8b80 r14: 00007ffe9b48c680 r15: 00007ffe9b48c688\n di: 0000000000000002 si: 00007ffe9b48b3b0 bp: 00007ffe9b48b600 bx: 00007ffe9b48b658\n dx: 0000000000000000 ax: 0000000000000000 cx: 00007f4e4322ee97 sp: 00007ffe9b48b3b0\n ip: 00007f4e4322ee97 efl: 0000000000000246 cgf: 002b000000000033 erf: 0000000000000000\n trp: 0000000000000000 msk: 0000000000000000 cr2: 0000000000000000\n[end of stack trace]\nCalling _exit(1). Core file will not be generated.\n\n\nTROUBLESHOOTING: https://github.com/GoogleChrome/puppeteer/blob/master/docs/troubleshooting.md\n]"} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["reporting","warning"],"pid":247,"message":"See Chromium's log output at \"/opt/kibana/data/headless_shell-linux/chrome_debug.log\""} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["reporting","warning"],"pid":247,"message":"Reporting plugin self-check failed. Please check the Kibana Reporting settings. Error: Could not close browser client handle!"} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["warning","elasticsearch","data"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["warning","elasticsearch","data"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:35Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:16:36,468][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:16:37Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:37Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:38Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:38Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:39Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:39Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:16:42,456][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:16:42Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:42Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:44Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:44Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:16:47,467][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:16:47Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:47Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:49Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:49Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:16:52,476][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:16:52Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:52Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:54Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:54Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:16:57,489][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:16:57Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:57Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:16:59Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:16:59Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:02,501][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:17:02Z","tags":["warning","elasticsearch","data"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:02Z","tags":["license","warning","xpack"],"pid":247,"message":"License information from the X-Pack plugin could not be obtained from Elasticsearch for the [data] cluster. Error: No Living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:02Z","tags":["warning","elasticsearch","data"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:02Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:02Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:04Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:04Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:07,511][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:17:07Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:07Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:08Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:08Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:09Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:09Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:12Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:12Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:13,502][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:17:14Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:14Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:17Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:17Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:18,512][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:17:19Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:19Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:22Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:22Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:23,523][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:17:24Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:24Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:27Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:27Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:28,533][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:17:29Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:29Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:32Z","tags":["warning","elasticsearch","data"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:32Z","tags":["license","warning","xpack"],"pid":247,"message":"License information from the X-Pack plugin could not be obtained from Elasticsearch for the [data] cluster. Error: No Living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:32Z","tags":["warning","elasticsearch","data"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:32Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:32Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:33,542][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:17:34Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:34Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:37Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:37Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:38Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:38Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:39,535][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:17:39Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:39Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:42Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:42Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:44,545][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

==> /var/log/kibana/kibana5.log <== {"type":"log","@timestamp":"2019-11-27T02:17:44Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:44Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"} {"type":"log","@timestamp":"2019-11-27T02:17:47Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"Unable to revive connection: http://localhost:9200/"} {"type":"log","@timestamp":"2019-11-27T02:17:47Z","tags":["warning","elasticsearch","admin"],"pid":247,"message":"No living connections"}

==> /var/log/logstash/logstash-plain.log <== [2019-11-27T02:17:49,555][WARN ][logstash.outputs.elasticsearch][main] Attempted to resurrect connection to dead ES instance, but got an error. {:url=>"http://localhost:9200/", :error_type=>LogStash::Outputs::ElasticSearch::HttpClient::Pool::HostUnreachableError, :error=>"Elasticsearch Unreachable: [http://localhost:9200/][Manticore::SocketException] Connection refused (Connection refused)"}

[LnkSaber]

my docker-compose.yml

version: '2'

services: elk: image: sebp/elk volumes:

• elk_data:/data ports:
  • "5601:5601"
  • "9200:9200"
  • "5044:5044"

[spujadas]

Your set-up looks good to me. https://github.com/docker/for-mac/issues/4067 leads me to believe that this could be a Docker for Mac issue, but as I haven't got a Mac handy I can't test this. Leaving open and hoping that someone using this image with Docker for Mac sees this and has some suggestions.

[LnkSaber]

I don't think this has anything to do with the docker ◔ ‸◔？ 感谢，您之前的指导

[spujadas]

Well, from what I see, the image starts up fine, all services are running, Elasticsearch and Kibana are reachable from the host, and the issue is that Logstash and Kibana can't resolve localhost:9200. So far the only difference between known working set-ups and your set-up is Docker for Linux vs Docker for Mac. Not saying that this is definitely the explanation, but if for some reason Docker for Mac's default set-up can't resolve localhost (e.g. https://github.com/docker/for-mac/issues/1898) then that may explain the behaviour you're seeing.

[LnkSaber]

Nice ~~~ could you tell me the Location of profile （all）, I will revise them, maybe it will be MAC‘s version o(*≧▽≦)ツ ~ ┴┴

[spujadas]

Sorry, not quite sure what you're asking for.

[tedder]

For someone else running this on a Mac, try execing into the container and seeing if localhost works:

curl localhost:9200

I know mac for docker does some weird things with networking.