spujadas / elk-docker

Elasticsearch, Logstash, Kibana (ELK) Docker image
Other
2.16k stars 908 forks source link

ELK stack container refuses to restart in Docker 2.2.0.3 (42716) #310

Closed djpentz closed 2 years ago

djpentz commented 4 years ago

After updating Docker Desktop for Mac my ELK container would not start. I deleted the container and the image and rebuilt from latest yesterday using the following: docker run -p 5601:5601 -p 9200:9200 -p 5044:5044 -it --name elk sebp/elk

After running this, the ELK stack container starts, but after Ctrl-C'ing in the command line, I go to the Docker Dashboard to restart the ELK stack, and it fails to restart. It tries to restart but just exits without any error visible. The log output is as follows:

[2020-02-15T13:43:50,833][INFO ][o.e.e.NodeEnvironment ] [elk] using [1] data paths, mounts [[/var/lib/elasticsearch (/dev/sda1)]], net usable_space [40.5gb], net total_space [58.4gb], types [ext4]
[2020-02-15T13:43:50,851][INFO ][o.e.e.NodeEnvironment ] [elk] heap size [990.7mb], compressed ordinary object pointers [true]
[2020-02-15T13:43:50,929][INFO ][o.e.n.Node ] [elk] node name [elk], node ID [Eifd0WWVQ6OuLtvQY7YuNQ], cluster name [elasticsearch]
[2020-02-15T13:43:50,935][INFO ][o.e.n.Node ] [elk] version[7.5.2], pid[115], build[default/tar/8bec50e1e0ad29dad5653712cf3bb580cd1afcdf/2020-01-15T12:11:52.313576Z], OS[Linux/4.19.76-linuxkit/amd64], JVM[Private Build/OpenJDK 64-Bit Server VM/1.8.0_242/25.242-b08]
[2020-02-15T13:43:50,941][INFO ][o.e.n.Node ] [elk] JVM home [/usr/lib/jvm/java-8-openjdk-amd64/jre]
[2020-02-15T13:43:50,944][INFO ][o.e.n.Node ] [elk] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=COMPAT, -Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=/tmp/elasticsearch-5676205881241238029, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:logs/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/opt/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=tar, -Des.bundled_jdk=true]
[2020-02-15T13:44:47,050][INFO ][o.e.e.NodeEnvironment ] [elk] using [1] data paths, mounts [[/var/lib/elasticsearch (/dev/sda1)]], net usable_space [40.5gb], net total_space [58.4gb], types [ext4]
[2020-02-15T13:44:47,058][INFO ][o.e.e.NodeEnvironment ] [elk] heap size [990.7mb], compressed ordinary object pointers [true]
[2020-02-15T13:44:47,073][INFO ][o.e.n.Node ] [elk] node name [elk], node ID [Eifd0WWVQ6OuLtvQY7YuNQ], cluster name [elasticsearch]
[2020-02-15T13:44:47,077][INFO ][o.e.n.Node ] [elk] version[7.5.2], pid[115], build[default/tar/8bec50e1e0ad29dad5653712cf3bb580cd1afcdf/2020-01-15T12:11:52.313576Z], OS[Linux/4.19.76-linuxkit/amd64], JVM[Private Build/OpenJDK 64-Bit Server VM/1.8.0_242/25.242-b08]
[2020-02-15T13:44:47,080][INFO ][o.e.n.Node ] [elk] JVM home [/usr/lib/jvm/java-8-openjdk-amd64/jre]
[2020-02-15T13:44:47,082][INFO ][o.e.n.Node ] [elk] JVM arguments [-Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=COMPAT, -Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -Djava.io.tmpdir=/tmp/elasticsearch-6759571902709653160, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:logs/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -XX:MaxDirectMemorySize=536870912, -Des.path.home=/opt/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=tar, -Des.bundled_jdk=true]
[2020-02-15T13:45:10,602][INFO ][o.e.p.PluginsService ] [elk] loaded module [aggs-matrix-stats]
[2020-02-15T13:45:10,604][INFO ][o.e.p.PluginsService ] [elk] loaded module [analysis-common]
[2020-02-15T13:45:10,606][INFO ][o.e.p.PluginsService ] [elk] loaded module [flattened]
[2020-02-15T13:45:10,608][INFO ][o.e.p.PluginsService ] [elk] loaded module [frozen-indices]
[2020-02-15T13:45:10,609][INFO ][o.e.p.PluginsService ] [elk] loaded module [ingest-common]
[2020-02-15T13:45:10,610][INFO ][o.e.p.PluginsService ] [elk] loaded module [ingest-geoip]
[2020-02-15T13:45:10,611][INFO ][o.e.p.PluginsService ] [elk] loaded module [ingest-user-agent]
[2020-02-15T13:45:10,612][INFO ][o.e.p.PluginsService ] [elk] loaded module [lang-expression]
[2020-02-15T13:45:10,614][INFO ][o.e.p.PluginsService ] [elk] load
ed module [lang-mustache]
[2020-02-15T13:45:10,616][INFO ][o.e.p.PluginsService ] [elk] loaded module [lang-painless]
[2020-02-15T13:45:10,617][INFO ][o.e.p.PluginsService ] [elk] loaded module [mapper-extras]
[2020-02-15T13:45:10,619][INFO ][o.e.p.PluginsService ] [elk] loaded module [parent-join]
[2020-02-15T13:45:10,620][INFO ][o.e.p.PluginsService ] [elk] loaded module [percolator]
[2020-02-15T13:45:10,621][INFO ][o.e.p.PluginsService ] [elk] loaded module [rank-eval]
[2020-02-15T13:45:10,622][INFO ][o.e.p.PluginsService ] [elk] loaded module [reindex]
[2020-02-15T13:45:10,624][INFO ][o.e.p.PluginsService ] [elk] loaded module [repository-url]
[2020-02-15T13:45:10,625][INFO ][o.e.p.PluginsService ] [elk] loaded module [search-business-rules]
[2020-02-15T13:45:10,627][INFO ][o.e.p.PluginsService ] [elk] loaded module [spatial]
[2020-02-15T13:45:10,630][INFO ][o.e.p.PluginsService ] [elk] loaded module [transform]
[2020-02-15T13:45:10,631][INFO ][o.e.p.PluginsService ] [elk] loaded module [transport-netty4]
[2020-02-15T13:45:10,632][INFO ][o.e.p.PluginsService ] [elk] loaded module [vectors]
[2020-02-15T13:45:10,634][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-analytics]
[2020-02-15T13:45:10,635][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-ccr]
[2020-02-15T13:45:10,640][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-core]
[2020-02-15T13:45:10,642][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-deprecation]
[2020-02-15T13:45:10,644][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-enrich]
[2020-02-15T13:45:10,646][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-graph]
[2020-02-15T13:45:10,648][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-ilm]
[2020-02-15T13:45:10,649][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-logstash]
[2020-02-15T13:45:10,651][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-ml]
[2020-02-15T13:45:10,653][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-monitoring]
[2020-02-15T13:45:10,655][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-rollup]
[2020-02-15T13:45:10,657][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-security
[2020-02-15T13:45:10,658][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-sql]
[2020-02-15T13:45:10,661][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-voting-only-node]
[2020-02-15T13:45:10,663][INFO ][o.e.p.PluginsService ] [elk] loaded module [x-pack-watcher]
[2020-02-15T13:45:10,668][INFO ][o.e.p.PluginsService ] [elk] no plugins loaded

Anybody got any ideas or see anything in there that looks off?

Docker Desktop versions are as follows: Engine: 19.03.5 Compose: 1.25.4 Kubernetes: 1.15.5 Notary: 0.6.1 Credential Helper: 0.6.3

spujadas commented 4 years ago

No idea, but if anyone with a Mac wants to chime in, that would be most helpful!

amacierzynski commented 3 years ago

Have the same on Ubuntu right now. Any ideas? No errors while starting by docker. After digging into docker image via bash, there is no log under /var/log dir at all. Trying to run service manually it didn't start as well ;/

spujadas commented 2 years ago

Spring cleaning: closing this issue due to inactivity.