search

spujadas / elk-docker

Elasticsearch, Logstash, Kibana (ELK) Docker image
Other
2.16k stars 910 forks source link

Failed to start elastic search -I am trying to install on AWS image #243

Closed qakart closed 5 years ago

qakart commented 5 years ago

Hi I have tried locally on the mac its up and running without any issue same thing I would like to install on my AWS medium machine I am getting below error Any hlep appricated

thanks in advance 

docker-compose up
Recreating elk-docker_elk_1_d9d1754caf3f ... done
Attaching to elk-docker_elk_1_d9d1754caf3f
elk_1_d9d1754caf3f | + rm -f /var/run/elasticsearch/elasticsearch.pid /var/run/logstash.pid /var/run/kibana5.pid
elk_1_d9d1754caf3f | + OUTPUT_LOGFILES=
elk_1_d9d1754caf3f | + '[' '!' -z '' ']'
elk_1_d9d1754caf3f | + '[' -x /usr/local/bin/elk-pre-hooks.sh ']'
elk_1_d9d1754caf3f | + service cron start
elk_1_d9d1754caf3f |  * Starting periodic command scheduler cron
elk_1_d9d1754caf3f |    ...done.
elk_1_d9d1754caf3f | + '[' -z '' ']'
elk_1_d9d1754caf3f | + ELASTICSEARCH_START=1
elk_1_d9d1754caf3f | + '[' 1 -ne 1 ']'
elk_1_d9d1754caf3f | + chown -R elasticsearch:elasticsearch /var/lib/elasticsearch
elk_1_d9d1754caf3f | + '[' '!' -z '' ']'
elk_1_d9d1754caf3f | + '[' '!' -z '' ']'
elk_1_d9d1754caf3f | + '[' '!' -z '' ']'
elk_1_d9d1754caf3f | + '[' '!' -z '' ']'
elk_1_d9d1754caf3f | + '[' '!' -z '' ']'
elk_1_d9d1754caf3f | + service elasticsearch start
elk_1_d9d1754caf3f | + PATH=/bin:/usr/bin:/sbin:/usr/sbin
elk_1_d9d1754caf3f | + NAME=elasticsearch
elk_1_d9d1754caf3f | + DESC='Elasticsearch Server'
elk_1_d9d1754caf3f | + DEFAULT=/etc/default/elasticsearch
elk_1_d9d1754caf3f | ++ id -u
elk_1_d9d1754caf3f | + '[' 0 -ne 0 ']'
elk_1_d9d1754caf3f | + . /lib/lsb/init-functions
elk_1_d9d1754caf3f | +++ run-parts --lsbsysinit --list /lib/lsb/init-functions.d
elk_1_d9d1754caf3f | ++ for hook in '$(run-parts --lsbsysinit --list /lib/lsb/init-functions.d 2>/dev/null)'
elk_1_d9d1754caf3f | ++ '[' -r /lib/lsb/init-functions.d/01-upstart-lsb ']'
elk_1_d9d1754caf3f | ++ . /lib/lsb/init-functions.d/01-upstart-lsb
elk_1_d9d1754caf3f | +++ unset UPSTART_SESSION
elk_1_d9d1754caf3f | +++ _RC_SCRIPT=/etc/init.d/elasticsearch
elk_1_d9d1754caf3f | +++ '[' -r /etc/init//etc/init.d/elasticsearch.conf ']'
elk_1_d9d1754caf3f | +++ _UPSTART_JOB=elasticsearch
elk_1_d9d1754caf3f | +++ '[' -r /etc/init/elasticsearch.conf ']'
elk_1_d9d1754caf3f | ++ for hook in '$(run-parts --lsbsysinit --list /lib/lsb/init-functions.d 2>/dev/null)'
elk_1_d9d1754caf3f | ++ '[' -r /lib/lsb/init-functions.d/20-left-info-blocks ']'
elk_1_d9d1754caf3f | ++ . /lib/lsb/init-functions.d/20-left-info-blocks
elk_1_d9d1754caf3f | ++ for hook in '$(run-parts --lsbsysinit --list /lib/lsb/init-functions.d 2>/dev/null)'
elk_1_d9d1754caf3f | ++ '[' -r /lib/lsb/init-functions.d/40-systemd ']'
elk_1_d9d1754caf3f | ++ . /lib/lsb/init-functions.d/40-systemd
elk_1_d9d1754caf3f | +++ _use_systemctl=0
elk_1_d9d1754caf3f | +++ '[' -d /run/systemd/system ']'
elk_1_d9d1754caf3f | +++ '[' 0 = 1 ']'
elk_1_d9d1754caf3f | ++ for hook in '$(run-parts --lsbsysinit --list /lib/lsb/init-functions.d 2>/dev/null)'
elk_1_d9d1754caf3f | ++ '[' -r /lib/lsb/init-functions.d/50-ubuntu-logging ']'
elk_1_d9d1754caf3f | ++ . /lib/lsb/init-functions.d/50-ubuntu-logging
elk_1_d9d1754caf3f | +++ LOG_DAEMON_MSG=
elk_1_d9d1754caf3f | ++ FANCYTTY=
elk_1_d9d1754caf3f | ++ '[' -e /etc/lsb-base-logging.sh ']'
elk_1_d9d1754caf3f | ++ true
elk_1_d9d1754caf3f | + '[' -r /etc/default/rcS ']'
elk_1_d9d1754caf3f | + . /etc/default/rcS
elk_1_d9d1754caf3f | + ES_USER=elasticsearch
elk_1_d9d1754caf3f | + ES_GROUP=elasticsearch
elk_1_d9d1754caf3f | + ES_HOME=/opt/elasticsearch
elk_1_d9d1754caf3f | + LOG_DIR=/var/log/elasticsearch
elk_1_d9d1754caf3f | + DATA_DIR=/var/lib/elasticsearch
elk_1_d9d1754caf3f | + ES_PATH_CONF=/etc/elasticsearch
elk_1_d9d1754caf3f | + PID_DIR=/var/run/elasticsearch
elk_1_d9d1754caf3f | + '[' -f /etc/default/elasticsearch ']'
elk_1_d9d1754caf3f | + . /etc/default/elasticsearch
elk_1_d9d1754caf3f | ++ ES_STARTUP_SLEEP_TIME=5
elk_1_d9d1754caf3f | + PID_FILE=/var/run/elasticsearch/elasticsearch.pid
elk_1_d9d1754caf3f | + DAEMON=/opt/elasticsearch/bin/elasticsearch
elk_1_d9d1754caf3f | + DAEMON_OPTS='-d -p /var/run/elasticsearch/elasticsearch.pid -Epath.logs=/var/log/elasticsearch -Epath.data=/var/lib/elasticsearch'
elk_1_d9d1754caf3f | + DAEMON_ENV_VARS=ES_PATH_CONF=/etc/elasticsearch
elk_1_d9d1754caf3f | + export ES_JAVA_OPTS
elk_1_d9d1754caf3f | + export JAVA_HOME
elk_1_d9d1754caf3f | + export ES_INCLUDE
elk_1_d9d1754caf3f | + export ES_JVM_OPTIONS
elk_1_d9d1754caf3f | + '[' '!' -x /opt/elasticsearch/bin/elasticsearch ']'
elk_1_d9d1754caf3f | + case "$1" in
elk_1_d9d1754caf3f | + checkJava
elk_1_d9d1754caf3f | + '[' -x /bin/java ']'
elk_1_d9d1754caf3f | ++ which java
elk_1_d9d1754caf3f | + JAVA=/usr/bin/java
elk_1_d9d1754caf3f | + '[' '!' -x /usr/bin/java ']'
elk_1_d9d1754caf3f | + log_daemon_msg 'Starting Elasticsearch Server'
elk_1_d9d1754caf3f | + '[' -z 'Starting Elasticsearch Server' ']'
elk_1_d9d1754caf3f | + log_use_fancy_output
elk_1_d9d1754caf3f | + TPUT=/usr/bin/tput
elk_1_d9d1754caf3f | + EXPR=/usr/bin/expr
elk_1_d9d1754caf3f | + '[' -t 1 ']'
elk_1_d9d1754caf3f | + FANCYTTY=0
elk_1_d9d1754caf3f | + case "$FANCYTTY" in
elk_1_d9d1754caf3f | + false
elk_1_d9d1754caf3f | + echo ' * Starting Elasticsearch Server'
elk_1_d9d1754caf3f |  * Starting Elasticsearch Server
elk_1_d9d1754caf3f | + COL=
elk_1_d9d1754caf3f | ++ pidofproc -p /var/run/elasticsearch/elasticsearch.pid elasticsearch
elk_1_d9d1754caf3f | ++ local pidfile base status specified pid OPTIND
elk_1_d9d1754caf3f | ++ pidfile=
elk_1_d9d1754caf3f | ++ specified=
elk_1_d9d1754caf3f | ++ OPTIND=1
elk_1_d9d1754caf3f | ++ getopts p: opt
elk_1_d9d1754caf3f | ++ case "$opt" in
elk_1_d9d1754caf3f | ++ pidfile=/var/run/elasticsearch/elasticsearch.pid
elk_1_d9d1754caf3f | ++ specified=specified
elk_1_d9d1754caf3f | ++ getopts p: opt
elk_1_d9d1754caf3f | ++ shift 2
elk_1_d9d1754caf3f | ++ '[' 1 -ne 1 ']'
elk_1_d9d1754caf3f | ++ base=elasticsearch
elk_1_d9d1754caf3f | ++ '[' '!' specified ']'
elk_1_d9d1754caf3f | ++ '[' -n /var/run/elasticsearch/elasticsearch.pid ']'
elk_1_d9d1754caf3f | ++ '[' -e /var/run/elasticsearch/elasticsearch.pid ']'
elk_1_d9d1754caf3f | ++ '[' -x /bin/pidof ']'
elk_1_d9d1754caf3f | ++ '[' '!' specified ']'
elk_1_d9d1754caf3f | ++ return 3
elk_1_d9d1754caf3f | + pid=
elk_1_d9d1754caf3f | + '[' -n '' ']'
elk_1_d9d1754caf3f | + '[' -n /var/run/elasticsearch ']'
elk_1_d9d1754caf3f | + '[' '!' -e /var/run/elasticsearch ']'
elk_1_d9d1754caf3f | + mkdir -p /var/run/elasticsearch
elk_1_d9d1754caf3f | + chown elasticsearch:elasticsearch /var/run/elasticsearch
elk_1_d9d1754caf3f | + '[' -n /var/run/elasticsearch/elasticsearch.pid ']'
elk_1_d9d1754caf3f | + '[' '!' -e /var/run/elasticsearch/elasticsearch.pid ']'
elk_1_d9d1754caf3f | + touch /var/run/elasticsearch/elasticsearch.pid
elk_1_d9d1754caf3f | + chown elasticsearch:elasticsearch /var/run/elasticsearch/elasticsearch.pid
elk_1_d9d1754caf3f | + '[' -n '' ']'
elk_1_d9d1754caf3f | + '[' -n '' ']'
elk_1_d9d1754caf3f | + '[' -n '' ']'
elk_1_d9d1754caf3f | + start-stop-daemon -d /opt/elasticsearch --start --user elasticsearch -c elasticsearch --pidfile /var/run/elasticsearch/elasticsearch.pid --exec /usr/bin/env ES_PATH_CONF=/etc/elasticsearch /opt/elasticsearch/bin/elasticsearch -- -d -p /var/run/elasticsearch/elasticsearch.pid -Epath.logs=/var/log/elasticsearch -Epath.data=/var/lib/elasticsearch
elk_1_d9d1754caf3f | + return=0
elk_1_d9d1754caf3f | + '[' 0 -eq 0 ']'
elk_1_d9d1754caf3f | + i=0
elk_1_d9d1754caf3f | + timeout=10
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + i=1
elk_1_d9d1754caf3f | + '[' 1 -gt 10 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + i=2
elk_1_d9d1754caf3f | + '[' 2 -gt 10 ']'
elk_1_d9d1754caf3f | + log_end_msg 0
elk_1_d9d1754caf3f |    ...done.
elk_1_d9d1754caf3f | + '[' -z 0 ']'
elk_1_d9d1754caf3f | + '[' '' ']'
elk_1_d9d1754caf3f | + '[' 0 -eq 0 ']'
elk_1_d9d1754caf3f | + echo '   ...done.'
elk_1_d9d1754caf3f | + return 0
elk_1_d9d1754caf3f | + exit 0
elk_1_d9d1754caf3f | + re_is_numeric='^[0-9]+$'
elk_1_d9d1754caf3f | + [[ '' =~ ^[0-9]+$ ]]
elk_1_d9d1754caf3f | + ES_CONNECT_RETRY=30
elk_1_d9d1754caf3f | + '[' -z '' ']'
elk_1_d9d1754caf3f | + ELASTICSEARCH_URL=http://localhost:9200
elk_1_d9d1754caf3f | + counter=0
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 0 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (1/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (1/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 1 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (2/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (2/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 2 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (3/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (3/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 3 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (4/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (4/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 4 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (5/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (5/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 5 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (6/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (6/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 6 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (7/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (7/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 7 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (8/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (8/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 8 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (9/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (9/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 9 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (10/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (10/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 10 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (11/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (11/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 11 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (12/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (12/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 12 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (13/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (13/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 13 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (14/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (14/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 14 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (15/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (15/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 15 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (16/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (16/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 16 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (17/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (17/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 17 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (18/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (18/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 18 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (19/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (19/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 19 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (20/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (20/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 20 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (21/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (21/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 21 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (22/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (22/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 22 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (23/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (23/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 23 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (24/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (24/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 24 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (25/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (25/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 25 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (26/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (26/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 26 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (27/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (27/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 27 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (28/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (28/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 28 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (29/30)'
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (29/30)
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 29 -lt 30 ']'
elk_1_d9d1754caf3f | + sleep 1
elk_1_d9d1754caf3f | waiting for Elasticsearch to be up (30/30)
elk_1_d9d1754caf3f | + (( counter++ ))
elk_1_d9d1754caf3f | + echo 'waiting for Elasticsearch to be up (30/30)'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' -a 30 -lt 30 ']'
elk_1_d9d1754caf3f | ++ curl -k http://localhost:9200
elk_1_d9d1754caf3f | + '[' '!' '' ']'
elk_1_d9d1754caf3f | + echo 'Couln'\''t start Elasticsearch. Exiting.'
elk_1_d9d1754caf3f | + echo 'Elasticsearch log follows below.'
elk_1_d9d1754caf3f | + cat /var/log/elasticsearch/elasticsearch.log
elk_1_d9d1754caf3f | Couln't start Elasticsearch. Exiting.
elk_1_d9d1754caf3f | Elasticsearch log follows below.
elk_1_d9d1754caf3f | [2018-12-14T11:57:44,267][INFO ][o.e.e.NodeEnvironment    ] [0bkxDD1] using [1] data paths, mounts [[/var/lib/elasticsearch (/dev/nvme0n1p1)]], net usable_space [24gb], net total_space [31.3gb], types [ext4]
elk_1_d9d1754caf3f | [2018-12-14T11:57:44,270][INFO ][o.e.e.NodeEnvironment    ] [0bkxDD1] heap size [990.7mb], compressed ordinary object pointers [true]
elk_1_d9d1754caf3f | [2018-12-14T11:57:44,272][INFO ][o.e.n.Node               ] [0bkxDD1] node name derived from node ID [0bkxDD16SPGZIMV0JaLf5g]; set [node.name] to override
elk_1_d9d1754caf3f | [2018-12-14T11:57:44,272][INFO ][o.e.n.Node               ] [0bkxDD1] version[6.5.1], pid[82], build[default/tar/8c58350/2018-11-16T02:22:42.182257Z], OS[Linux/4.14.72-68.55.amzn1.x86_64/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_191/25.191-b12]
elk_1_d9d1754caf3f | [2018-12-14T11:57:44,272][INFO ][o.e.n.Node               ] [0bkxDD1] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.Y6buh2fV, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:logs/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/opt/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=tar]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,958][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [aggs-matrix-stats]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,958][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [analysis-common]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,958][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [ingest-common]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,958][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [lang-expression]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,958][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [lang-mustache]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,958][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [lang-painless]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,958][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [mapper-extras]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,958][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [parent-join]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [percolator]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [rank-eval]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [reindex]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [repository-url]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [transport-netty4]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [tribe]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-ccr]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-core]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-deprecation]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-graph]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-logstash]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-ml]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-monitoring]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-rollup]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-security]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-sql]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-upgrade]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,959][INFO ][o.e.p.PluginsService     ] [0bkxDD1] loaded module [x-pack-watcher]
elk_1_d9d1754caf3f | [2018-12-14T11:57:45,960][INFO ][o.e.p.PluginsService     ] [0bkxDD1] no plugins loaded
elk_1_d9d1754caf3f | [2018-12-14T11:57:49,567][INFO ][o.e.x.m.j.p.l.CppLogMessageHandler] [0bkxDD1] [controller/104] [Main.cc@109] controller (64 bit): Version 6.5.1 (Build 1c5fe241dd9aea) Copyright (c) 2018 Elasticsearch BV
elk_1_d9d1754caf3f | [2018-12-14T11:57:49,954][DEBUG][o.e.a.ActionModule       ] [0bkxDD1] Using REST wrapper from plugin org.elasticsearch.xpack.security.Security
elk_1_d9d1754caf3f | [2018-12-14T11:57:50,192][INFO ][o.e.d.DiscoveryModule    ] [0bkxDD1] using discovery type [zen] and host providers [settings]
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,117][INFO ][o.e.n.Node               ] [0bkxDD1] initialized
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,117][INFO ][o.e.n.Node               ] [0bkxDD1] starting ...
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,262][INFO ][o.e.t.TransportService   ] [0bkxDD1] publish_address {172.17.0.2:9300}, bound_addresses {0.0.0.0:9300}
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,273][INFO ][o.e.b.BootstrapChecks    ] [0bkxDD1] bound or publishing to a non-loopback address, enforcing bootstrap checks
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,275][ERROR][o.e.b.Bootstrap          ] [0bkxDD1] node validation exception
elk_1_d9d1754caf3f | [1] bootstrap checks failed
elk_1_d9d1754caf3f | [1]: max file descriptors [4096] for elasticsearch process is too low, increase to at least [65536]
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,277][INFO ][o.e.n.Node               ] [0bkxDD1] stopping ...
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,307][INFO ][o.e.n.Node               ] [0bkxDD1] stopped
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,307][INFO ][o.e.n.Node               ] [0bkxDD1] closing ...
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,316][INFO ][o.e.n.Node               ] [0bkxDD1] closed
elk_1_d9d1754caf3f | [2018-12-14T11:57:51,318][INFO ][o.e.x.m.j.p.NativeController] [0bkxDD1] Native controller process has stopped - no new native processes can be started
elk_1_d9d1754caf3f | + exit 1
elk-docker_elk_1_d9d1754caf3f exited with code 1
spujadas commented 5 years ago

max file descriptors [4096] for elasticsearch process is too low, increase to at least [65536]

You need to "set ulimit -n 65536 as root before starting Elasticsearch, or set nofile to 65536 in /etc/security/limits.conf" (see https://elk-docker.readthedocs.io/#frequently-encountered-issues and https://www.elastic.co/guide/en/elasticsearch/reference/current/file-descriptors.html)

qakart commented 5 years ago

thanks for quick reply 

core file size          (blocks, -c) 0
data seg size           (kbytes, -d) unlimited
scheduling priority             (-e) 0
file size               (blocks, -f) unlimited
pending signals                 (-i) 62232
max locked memory       (kbytes, -l) 64
max memory size         (kbytes, -m) unlimited
open files                      (-n) 1024
pipe size            (512 bytes, -p) 8
POSIX message queues     (bytes, -q) 819200
real-time priority              (-r) 0
stack size              (kbytes, -s) 8192
cpu time               (seconds, -t) unlimited
max user processes              (-u) 62232
virtual memory          (kbytes, -v) unlimited
file locks                      (-x) unlimited
spujadas commented 5 years ago

No problem, and as you can see in the dump from ulimit:

open files (-n) 1024

You need to bump this value up to (at least) 65536.

(Note: edited your messages to display terminal output properly. Hint: indent terminal output instead of using backquotes :wink:)

qakart commented 5 years ago

i did tried that the same

ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 62232 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 65536 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 62232 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited

qakart commented 5 years ago

i got the same error i am restarting the machine

qakart commented 5 years ago

after restarted

ulimit -a core file size (blocks, -c) 0 data seg size (kbytes, -d) unlimited scheduling priority (-e) 0 file size (blocks, -f) unlimited pending signals (-i) 62232 max locked memory (kbytes, -l) 64 max memory size (kbytes, -m) unlimited open files (-n) 1024 pipe size (512 bytes, -p) 8 POSIX message queues (bytes, -q) 819200 real-time priority (-r) 0 stack size (kbytes, -s) 8192 cpu time (seconds, -t) unlimited max user processes (-u) 62232 virtual memory (kbytes, -v) unlimited file locks (-x) unlimited

spujadas commented 5 years ago

You can set it in /etc/security/limits.conf to make the change permanent, see https://www.elastic.co/guide/en/elasticsearch/reference/current/setting-system-settings.html#limits.conf

qakart commented 5 years ago

thanks, I did try the below its worked changed to default-ulimit nofile to 1024:65536

vim /etc/sysconfig/docker

OPTIONS="--default-ulimit nofile=1024:65536"

qakart commented 5 years ago

Thanks a lot @spujadas