search

nanobox-io / nanobox-hooks-elasticsearch

Nanobox hooks for the Elasticsearch service
MIT License
1 stars 4 forks source link

Travis Tests Failing #3

Closed danhunsaker closed 7 years ago

danhunsaker commented 7 years ago

Based solely on the output from Travis, it appears the server is never actually coming up. This issue is to help with tracking details as we dig deeper into what's happening and why.

danhunsaker commented 7 years ago

When manually recreating the steps taken by simple-single.bats, I was able to enter a shell in the container while it was still running, immediately following a manual attempt at the start hook. I first checked that everything except the server itself had been set up correctly, as detailed in the hook itself. Sure enough, eth0:0 exists and is configured properly, all the files and directories the hook creates are in place, and so forth. Next I double-checked that nothing was actually listening on the expected port, and netstat -lnp showed that not only was nothing listening on the port, but no processes named elasticsearch or java were listening on any port.

Finally, I checked the output of sv status db and saw that the service was showing as running, so I also checked ps faux, and discovered that it was, in fact, running. So, off to the logs. The size of /data/var/log/elasticsearch/elasticsearch1.log was continuously growing, as the following lines were added repeatedly, with only the timestamps showing any variation:

[2017-10-12T12:10:28,154][INFO ][o.e.n.Node               ] [elasticsearch1-1] initializing ...
[2017-10-12T12:10:28,471][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch1-1] using [1] data paths, mounts [[/ (rootfs)]], net usable_space [35.2gb], net total_space [39.3gb], spins? [unknown], types [rootfs]
[2017-10-12T12:10:28,474][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch1-1] heap size [98.6mb], compressed ordinary object pointers [true]
[2017-10-12T12:10:28,478][INFO ][o.e.n.Node               ] [elasticsearch1-1] node name [elasticsearch1-1], node ID [_x16rQ5hTV6lfEFVhsZvLQ]
[2017-10-12T12:10:28,481][INFO ][o.e.n.Node               ] [elasticsearch1-1] version[5.4.0], pid[375], build[780f8c4/2017-04-28T17:43:27.229Z], OS[Linux/3.13.0-133-generic/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_144/25.144-b01]
[2017-10-12T12:10:33,072][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [aggs-matrix-stats]
[2017-10-12T12:10:33,076][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [ingest-common]
[2017-10-12T12:10:33,077][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [lang-expression]
[2017-10-12T12:10:33,078][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [lang-groovy]
[2017-10-12T12:10:33,084][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [lang-mustache]
[2017-10-12T12:10:33,085][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [lang-painless]
[2017-10-12T12:10:33,085][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [percolator]
[2017-10-12T12:10:33,087][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [reindex]
[2017-10-12T12:10:33,088][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [transport-netty3]
[2017-10-12T12:10:33,088][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [transport-netty4]
[2017-10-12T12:10:33,091][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] no plugins loaded
[2017-10-12T12:10:40,663][INFO ][o.e.d.DiscoveryModule    ] [elasticsearch1-1] using discovery type [zen]
[2017-10-12T12:10:43,720][INFO ][o.e.n.Node               ] [elasticsearch1-1] initialized
[2017-10-12T12:10:43,721][INFO ][o.e.n.Node               ] [elasticsearch1-1] starting ...
[2017-10-12T12:10:44,463][INFO ][o.e.t.TransportService   ] [elasticsearch1-1] publish_address {192.168.0.2:9300}, bound_addresses {0.0.0.0:9300}
[2017-10-12T12:10:44,514][INFO ][o.e.b.BootstrapChecks    ] [elasticsearch1-1] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks

Something isn't right, here, but I need more experience with / research into ElasticSearch to know what.

danhunsaker commented 7 years ago

Dialing up the logging level to debug following @jjkester's advice, here's some more detailed output:

[2017-10-12T13:10:09,307][DEBUG][o.e.b.SystemCallFilter   ] Linux seccomp filter installation successful, threads: [all]
[2017-10-12T13:10:09,387][DEBUG][o.e.b.JarHell            ] java.class.path: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar:/data/lib/elasticsearch/lib/lucene-core-6.5.0.jar:/data/lib/elasticsearch/lib/t-digest-3.0.jar:/data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar:/data/lib/elasticsearch/lib/spatial4j-0.6.jar:/data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar:/data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar:/data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar:/data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar:/data/lib/elasticsearch/lib/jna-4.4.0.jar:/data/lib/elasticsearch/lib/snakeyaml-1.15.jar:/data/lib/elasticsearch/lib/log4j-core-2.8.2.jar:/data/lib/elasticsearch/lib/jts-1.13.jar:/data/lib/elasticsearch/lib/securesm-1.1.jar:/data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar:/data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar:/data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar:/data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar:/data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar:/data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar:/data/lib/elasticsearch/lib/hppc-0.7.1.jar:/data/lib/elasticsearch/lib/log4j-api-2.8.2.jar:/data/lib/elasticsearch/lib/lucene-join-6.5.0.jar:/data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar:/data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar:/data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar:/data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar:/data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar:/data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar:/data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar:/data/lib/elasticsearch/lib/joda-time-2.9.5.jar:/data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar:/data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar:/data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:09,390][DEBUG][o.e.b.JarHell            ] sun.boot.class.path: /data/java/oracle-8/lib/resources.jar:/data/java/oracle-8/lib/rt.jar:/data/java/oracle-8/lib/sunrsasign.jar:/data/java/oracle-8/lib/jsse.jar:/data/java/oracle-8/lib/jce.jar:/data/java/oracle-8/lib/charsets.jar:/data/java/oracle-8/lib/jfr.jar:/data/java/oracle-8/classes
[2017-10-12T13:10:09,392][DEBUG][o.e.b.JarHell            ] classloader urls: [file:/data/lib/elasticsearch/lib/jackson-core-2.8.6.jar, file:/data/lib/elasticsearch/lib/lucene-core-6.5.0.jar, file:/data/lib/elasticsearch/lib/t-digest-3.0.jar, file:/data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar, file:/data/lib/elasticsearch/lib/spatial4j-0.6.jar, file:/data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar, file:/data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar, file:/data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar, file:/data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar, file:/data/lib/elasticsearch/lib/jna-4.4.0.jar, file:/data/lib/elasticsearch/lib/snakeyaml-1.15.jar, file:/data/lib/elasticsearch/lib/log4j-core-2.8.2.jar, file:/data/lib/elasticsearch/lib/jts-1.13.jar, file:/data/lib/elasticsearch/lib/securesm-1.1.jar, file:/data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar, file:/data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar, file:/data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar, file:/data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar, file:/data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar, file:/data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar, file:/data/lib/elasticsearch/lib/hppc-0.7.1.jar, file:/data/lib/elasticsearch/lib/log4j-api-2.8.2.jar, file:/data/lib/elasticsearch/lib/lucene-join-6.5.0.jar, file:/data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar, file:/data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar, file:/data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar, file:/data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar, file:/data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar, file:/data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar, file:/data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar, file:/data/lib/elasticsearch/lib/joda-time-2.9.5.jar, file:/data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar, file:/data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar, file:/data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar]
[2017-10-12T13:10:09,415][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:09,419][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:09,433][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:09,471][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:09,476][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:09,481][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:09,497][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:09,553][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:09,559][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:09,561][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:09,575][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:09,577][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:09,583][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:09,598][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:09,611][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:09,613][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:09,615][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:09,626][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:09,633][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:09,640][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:09,646][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:09,658][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:09,669][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:09,672][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:09,679][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:09,685][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:09,691][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:09,695][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:09,706][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:09,714][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:09,721][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:09,723][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:09,731][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:09,735][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:09,742][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:10,058][INFO ][o.e.n.Node               ] [elasticsearch1-1] initializing ...
[2017-10-12T13:10:10,448][DEBUG][o.e.e.NodeEnvironment    ] [elasticsearch1-1] using node location [[NodePath{path=/data/var/db/elasticsearch/nodes/0, spins=null}]], local_lock_id [0]
[2017-10-12T13:10:10,454][DEBUG][o.e.e.NodeEnvironment    ] [elasticsearch1-1] node data locations details:
 -> /data/var/db/elasticsearch/nodes/0, free_space [36.9gb], usable_space [35.2gb], total_space [39.3gb], spins? [unknown], mount [/ (rootfs)], type [rootfs]
[2017-10-12T13:10:10,460][INFO ][o.e.e.NodeEnvironment    ] [elasticsearch1-1] heap size [98.6mb], compressed ordinary object pointers [true]
[2017-10-12T13:10:10,463][INFO ][o.e.n.Node               ] [elasticsearch1-1] node name [elasticsearch1-1], node ID [tHFGSG4KQC6Umr8Bbkb3iw]
[2017-10-12T13:10:10,465][INFO ][o.e.n.Node               ] [elasticsearch1-1] version[5.4.0], pid[254], build[780f8c4/2017-04-28T17:43:27.229Z], OS[Linux/3.13.0-133-generic/amd64], JVM[Oracle Corporation/Java HotSpot(TM) 64-Bit Server VM/1.8.0_144/25.144-b01]
[2017-10-12T13:10:10,468][DEBUG][o.e.n.Node               ] [elasticsearch1-1] using config [/data/etc/elasticsearch], data [[/data/var/db/elasticsearch]], logs [/data/var/log/elasticsearch], plugins [/data/lib/elasticsearch/plugins]
[2017-10-12T13:10:10,584][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:10,593][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:10,597][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:10,602][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:10,692][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:10,711][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:10,719][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:10,726][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:10,732][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:10,744][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:10,746][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:10,756][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:10,762][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:10,772][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:10,775][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:10,784][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:10,805][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:10,820][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:10,825][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:10,836][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:10,839][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:10,841][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:10,850][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:10,852][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:10,865][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-groovy/lang-groovy-5.4.0.jar
[2017-10-12T13:10:10,869][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:10,877][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:10,880][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:10,884][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:10,888][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:10,895][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:10,898][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:10,903][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:10,911][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-groovy/groovy-2.4.6-indy.jar
[2017-10-12T13:10:10,938][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:10,945][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:10,950][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:11,386][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:11,394][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:11,396][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:11,400][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:11,463][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:11,465][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:11,467][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:11,469][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-expression/lang-expression-5.4.0.jar
[2017-10-12T13:10:11,471][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:11,473][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:11,478][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:11,483][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:11,487][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:11,493][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:11,499][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:11,504][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:11,517][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:11,526][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-expression/asm-5.0.4.jar
[2017-10-12T13:10:11,529][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-expression/lucene-expressions-6.5.0.jar
[2017-10-12T13:10:11,542][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:11,546][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-expression/antlr4-runtime-4.5.1-1.jar
[2017-10-12T13:10:11,550][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:11,553][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:11,556][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:11,564][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:11,569][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:11,581][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:11,584][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-expression/asm-commons-5.0.4.jar
[2017-10-12T13:10:11,590][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:11,599][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:11,601][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:11,603][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:11,613][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:11,630][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:11,649][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:11,654][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:11,665][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:11,676][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-expression/asm-tree-5.0.4.jar
[2017-10-12T13:10:11,680][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:11,686][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:11,693][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:11,763][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:11,769][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:11,771][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:11,775][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:11,806][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:11,809][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:11,812][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:11,823][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:11,829][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:11,832][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:11,837][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:11,839][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:11,842][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:11,846][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:11,848][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:11,851][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:11,864][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:11,866][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:11,872][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:11,881][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:11,885][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:11,887][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:11,893][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:11,895][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:11,913][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:11,915][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:11,917][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:11,920][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:11,926][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/aggs-matrix-stats/aggs-matrix-stats-5.4.0.jar
[2017-10-12T13:10:11,931][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:11,968][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:11,981][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:11,996][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:11,998][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:12,010][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:12,012][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:12,084][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:12,086][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:12,087][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:12,095][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:12,143][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:12,154][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:12,156][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:12,166][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:12,169][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:12,171][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:12,178][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:12,180][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:12,183][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:12,191][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:12,196][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:12,202][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:12,205][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:12,214][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:12,217][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:12,219][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:12,222][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:12,226][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:12,231][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:12,240][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:12,252][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:12,261][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:12,265][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-mustache/compiler-0.9.3.jar
[2017-10-12T13:10:12,273][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:12,282][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:12,288][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:12,302][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:12,314][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:12,339][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:12,341][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-mustache/lang-mustache-5.4.0.jar
[2017-10-12T13:10:12,352][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:12,358][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:12,362][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:12,463][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:12,466][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:12,468][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:12,473][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:12,532][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:12,539][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:12,542][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:12,548][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:12,550][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:12,554][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:12,560][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:12,562][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:12,569][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:12,573][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:12,577][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:12,581][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:12,586][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:12,594][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:12,599][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:12,602][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:12,613][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:12,620][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:12,622][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:12,629][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:12,642][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:12,650][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:12,651][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:12,654][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:12,662][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:12,674][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:12,676][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:12,680][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:12,686][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/percolator/percolator-5.4.0.jar
[2017-10-12T13:10:12,688][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:12,691][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:12,699][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:12,767][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:12,768][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:12,778][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:12,779][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:12,812][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:12,814][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:12,825][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:12,827][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:12,829][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:12,831][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:12,832][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:12,837][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:12,842][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:12,852][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:12,854][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:12,856][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:12,866][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:12,870][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/ingest-common/ingest-common-5.4.0.jar
[2017-10-12T13:10:12,879][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:12,882][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/ingest-common/jcodings-1.0.12.jar
[2017-10-12T13:10:12,892][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:12,896][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:12,906][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:12,913][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:12,922][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:12,925][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:12,940][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:12,949][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:12,959][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:12,961][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:12,963][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:12,979][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:12,982][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:13,029][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:13,033][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/ingest-common/joni-2.1.6.jar
[2017-10-12T13:10:13,035][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:13,037][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:13,044][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:13,198][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:13,205][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:13,210][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:13,211][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:13,250][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:13,254][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:13,258][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:13,262][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:13,266][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:13,268][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:13,278][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:13,282][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:13,291][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:13,294][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:13,302][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:13,304][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:13,323][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:13,331][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:13,337][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:13,343][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:13,345][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:13,349][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:13,355][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty4/netty-handler-4.1.9.Final.jar
[2017-10-12T13:10:13,358][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:13,364][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:13,370][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:13,377][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:13,379][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:13,389][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:13,391][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty4/transport-netty4-5.4.0.jar
[2017-10-12T13:10:13,393][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:13,402][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty4/netty-transport-4.1.9.Final.jar
[2017-10-12T13:10:13,408][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty4/netty-codec-http-4.1.9.Final.jar
[2017-10-12T13:10:13,411][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:13,418][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:13,422][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:13,429][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty4/netty-buffer-4.1.9.Final.jar
[2017-10-12T13:10:13,437][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:13,439][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:13,441][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:13,443][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty4/netty-resolver-4.1.9.Final.jar
[2017-10-12T13:10:13,449][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty4/netty-codec-4.1.9.Final.jar
[2017-10-12T13:10:13,451][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty4/netty-common-4.1.9.Final.jar
[2017-10-12T13:10:13,582][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:13,583][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:13,587][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:13,590][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:13,670][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:13,674][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:13,680][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:13,689][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:13,699][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:13,702][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:13,709][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:13,711][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:13,713][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-painless/asm-debug-all-5.1.jar
[2017-10-12T13:10:13,723][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:13,726][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:13,734][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:13,736][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:13,739][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:13,741][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:13,745][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:13,745][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-painless/lang-painless-5.4.0.jar
[2017-10-12T13:10:13,751][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:13,756][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:13,758][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:13,759][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:13,762][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:13,774][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:13,779][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:13,781][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:13,789][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/lang-painless/antlr4-runtime-4.5.1-1.jar
[2017-10-12T13:10:13,794][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:13,805][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:13,810][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:13,819][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:13,825][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:13,832][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:13,838][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:13,840][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:16,085][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:16,093][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:16,094][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:16,096][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:16,125][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:16,128][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:16,135][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:16,137][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:16,138][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/reindex/commons-codec-1.10.jar
[2017-10-12T13:10:16,147][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:16,150][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/reindex/rest-5.4.0.jar
[2017-10-12T13:10:16,154][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:16,155][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:16,158][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:16,169][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:16,174][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:16,182][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:16,184][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:16,187][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:16,194][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/reindex/commons-logging-1.1.3.jar
[2017-10-12T13:10:16,196][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/reindex/reindex-5.4.0.jar
[2017-10-12T13:10:16,201][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/reindex/httpasyncclient-4.1.2.jar
[2017-10-12T13:10:16,203][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:16,207][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:16,210][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:16,214][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/reindex/httpcore-4.4.5.jar
[2017-10-12T13:10:16,218][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:16,219][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:16,228][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:16,231][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/reindex/httpclient-4.5.2.jar
[2017-10-12T13:10:16,239][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:16,254][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:16,261][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:16,266][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:16,280][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/reindex/httpcore-nio-4.4.5.jar
[2017-10-12T13:10:16,289][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:16,297][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:16,305][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:16,312][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:16,315][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:16,321][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:16,324][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:16,327][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:16,407][DEBUG][o.e.b.JarHell            ] java.home: /data/java/oracle-8
[2017-10-12T13:10:16,408][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-1.2-api-2.8.2.jar
[2017-10-12T13:10:16,412][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jopt-simple-5.0.2.jar
[2017-10-12T13:10:16,413][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/elasticsearch-5.4.0.jar
[2017-10-12T13:10:16,507][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-yaml-2.8.6.jar
[2017-10-12T13:10:16,509][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-core-2.8.6.jar
[2017-10-12T13:10:16,512][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial3d-6.5.0.jar
[2017-10-12T13:10:16,518][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-join-6.5.0.jar
[2017-10-12T13:10:16,520][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/java-version-checker-5.4.0.jar
[2017-10-12T13:10:16,521][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/t-digest-3.0.jar
[2017-10-12T13:10:16,532][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-sandbox-6.5.0.jar
[2017-10-12T13:10:16,533][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/joda-time-2.9.5.jar
[2017-10-12T13:10:16,536][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jts-1.13.jar
[2017-10-12T13:10:16,541][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-6.5.0.jar
[2017-10-12T13:10:16,543][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-spatial-extras-6.5.0.jar
[2017-10-12T13:10:16,547][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty3/netty-3.10.6.Final.jar
[2017-10-12T13:10:16,565][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-analyzers-common-6.5.0.jar
[2017-10-12T13:10:16,568][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/HdrHistogram-2.1.9.jar
[2017-10-12T13:10:16,570][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-suggest-6.5.0.jar
[2017-10-12T13:10:16,577][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/snakeyaml-1.15.jar
[2017-10-12T13:10:16,580][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-api-2.8.2.jar
[2017-10-12T13:10:16,582][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/securesm-1.1.jar
[2017-10-12T13:10:16,589][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-cbor-2.8.6.jar
[2017-10-12T13:10:16,590][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/modules/transport-netty3/transport-netty3-5.4.0.jar
[2017-10-12T13:10:16,592][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-backward-codecs-6.5.0.jar
[2017-10-12T13:10:16,594][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/log4j-core-2.8.2.jar
[2017-10-12T13:10:16,604][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jna-4.4.0.jar
[2017-10-12T13:10:16,606][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-misc-6.5.0.jar
[2017-10-12T13:10:16,607][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/spatial4j-0.6.jar
[2017-10-12T13:10:16,613][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queries-6.5.0.jar
[2017-10-12T13:10:16,616][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-core-6.5.0.jar
[2017-10-12T13:10:16,629][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-queryparser-6.5.0.jar
[2017-10-12T13:10:16,639][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/hppc-0.7.1.jar
[2017-10-12T13:10:16,642][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-memory-6.5.0.jar
[2017-10-12T13:10:16,644][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-grouping-6.5.0.jar
[2017-10-12T13:10:16,650][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/lucene-highlighter-6.5.0.jar
[2017-10-12T13:10:16,651][DEBUG][o.e.b.JarHell            ] examining jar: /data/lib/elasticsearch/lib/jackson-dataformat-smile-2.8.6.jar
[2017-10-12T13:10:16,751][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [aggs-matrix-stats]
[2017-10-12T13:10:16,757][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [ingest-common]
[2017-10-12T13:10:16,757][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [lang-expression]
[2017-10-12T13:10:16,757][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [lang-groovy]
[2017-10-12T13:10:16,758][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [lang-mustache]
[2017-10-12T13:10:16,758][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [lang-painless]
[2017-10-12T13:10:16,758][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [percolator]
[2017-10-12T13:10:16,759][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [reindex]
[2017-10-12T13:10:16,759][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [transport-netty3]
[2017-10-12T13:10:16,759][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] loaded module [transport-netty4]
[2017-10-12T13:10:16,765][INFO ][o.e.p.PluginsService     ] [elasticsearch1-1] no plugins loaded
[2017-10-12T13:10:17,099][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [force_merge], size [1], queue size [unbounded]
[2017-10-12T13:10:17,104][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [fetch_shard_started], core [1], max [2], keep alive [5m]
[2017-10-12T13:10:17,111][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [listener], size [1], queue size [unbounded]
[2017-10-12T13:10:17,129][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [index], size [1], queue size [200]
[2017-10-12T13:10:17,137][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [refresh], core [1], max [1], keep alive [5m]
[2017-10-12T13:10:17,139][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [generic], core [4], max [128], keep alive [30s]
[2017-10-12T13:10:17,141][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [warmer], core [1], max [1], keep alive [5m]
[2017-10-12T13:10:17,144][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [search], size [2], queue size [1k]
[2017-10-12T13:10:17,146][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [flush], core [1], max [1], keep alive [5m]
[2017-10-12T13:10:17,152][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [fetch_shard_store], core [1], max [2], keep alive [5m]
[2017-10-12T13:10:17,157][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [management], core [1], max [5], keep alive [5m]
[2017-10-12T13:10:17,159][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [get], size [1], queue size [1k]
[2017-10-12T13:10:17,161][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [bulk], size [1], queue size [200]
[2017-10-12T13:10:17,166][DEBUG][o.e.t.ThreadPool         ] [elasticsearch1-1] created thread pool: name [snapshot], core [1], max [1], keep alive [5m]
[2017-10-12T13:10:18,004][DEBUG][o.e.s.ScriptService      ] [elasticsearch1-1] using script cache with max_size [100], expire [0s]
[2017-10-12T13:10:20,859][DEBUG][o.e.c.n.IfConfig         ] configuration:

lo
        inet 127.0.0.1 netmask:255.0.0.0 scope:host
        UP LOOPBACK mtu:65536 index:1

eth0
        inet 192.168.0.3 netmask:255.255.255.0 broadcast:192.168.0.255 scope:site
        inet 192.168.0.2 netmask:255.255.0.0 broadcast:0.0.0.0 scope:site
        hardware 02:42:C0:A8:00:02
        UP MULTICAST mtu:1450 index:41

eth0:0
        inet 192.168.0.3 netmask:255.255.255.0 broadcast:192.168.0.255 scope:site
        hardware 02:42:C0:A8:00:02
        UP MULTICAST VIRTUAL mtu:1450 index:41

[2017-10-12T13:10:21,021][DEBUG][o.e.m.j.JvmGcMonitorService] [elasticsearch1-1] enabled [true], interval [1s], gc_threshold [{default=GcThreshold{name='default', warnThreshold=10000, infoThreshold=5000, debugThreshold=2000}, young=GcThreshold{name='young', warnThreshold=1000, infoThreshold=700, debugThreshold=400}, old=GcThreshold{name='old', warnThreshold=10000, infoThreshold=5000, debugThreshold=2000}}], overhead [50, 25, 10]
[2017-10-12T13:10:21,043][DEBUG][o.e.m.o.OsProbe          ] error reading control group stats
java.nio.file.NoSuchFileException: /sys/fs/cgroup/cpuacct/docker/4792af037e3079c199477282d7c9b4717347943086a8e9de8514cebbd1b105ef/cpuacct.usage
    at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) ~[?:?]
    at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:?]
    at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:?]
    at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) ~[?:?]
    at java.nio.file.Files.newByteChannel(Files.java:361) ~[?:1.8.0_144]
    at java.nio.file.Files.newByteChannel(Files.java:407) ~[?:1.8.0_144]
    at java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:384) ~[?:1.8.0_144]
    at java.nio.file.Files.newInputStream(Files.java:152) ~[?:1.8.0_144]
    at java.nio.file.Files.newBufferedReader(Files.java:2784) ~[?:1.8.0_144]
    at java.nio.file.Files.readAllLines(Files.java:3202) ~[?:1.8.0_144]
    at java.nio.file.Files.readAllLines(Files.java:3242) ~[?:1.8.0_144]
    at org.elasticsearch.monitor.os.OsProbe.readSingleLine(OsProbe.java:185) ~[elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.monitor.os.OsProbe.readSysFsCgroupCpuAcctCpuAcctUsage(OsProbe.java:274) ~[elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.monitor.os.OsProbe.getCgroupCpuAcctUsageNanos(OsProbe.java:261) ~[elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.monitor.os.OsProbe.getCgroup(OsProbe.java:419) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.monitor.os.OsProbe.osStats(OsProbe.java:464) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.monitor.os.OsService.<init>(OsService.java:45) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.monitor.MonitorService.<init>(MonitorService.java:45) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.node.Node.<init>(Node.java:360) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.node.Node.<init>(Node.java:242) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.bootstrap.Bootstrap$6.<init>(Bootstrap.java:242) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.bootstrap.Bootstrap.setup(Bootstrap.java:242) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.bootstrap.Bootstrap.init(Bootstrap.java:360) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.bootstrap.Elasticsearch.init(Elasticsearch.java:123) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.bootstrap.Elasticsearch.execute(Elasticsearch.java:114) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.cli.EnvironmentAwareCommand.execute(EnvironmentAwareCommand.java:67) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.cli.Command.mainWithoutErrorHandling(Command.java:122) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.cli.Command.main(Command.java:88) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:91) [elasticsearch-5.4.0.jar:5.4.0]
    at org.elasticsearch.bootstrap.Elasticsearch.main(Elasticsearch.java:84) [elasticsearch-5.4.0.jar:5.4.0]
[2017-10-12T13:10:21,079][DEBUG][o.e.m.o.OsService        ] [elasticsearch1-1] using refresh_interval [1s]
[2017-10-12T13:10:21,096][DEBUG][o.e.m.p.ProcessService   ] [elasticsearch1-1] using refresh_interval [1s]
[2017-10-12T13:10:21,133][DEBUG][o.e.m.j.JvmService       ] [elasticsearch1-1] using refresh_interval [1s]
[2017-10-12T13:10:21,134][DEBUG][o.e.m.f.FsService        ] [elasticsearch1-1] using refresh_interval [1s]
[2017-10-12T13:10:21,162][DEBUG][o.e.c.r.a.d.ClusterRebalanceAllocationDecider] [elasticsearch1-1] using [cluster.routing.allocation.allow_rebalance] with [indices_all_active]
[2017-10-12T13:10:21,164][DEBUG][o.e.c.r.a.d.ConcurrentRebalanceAllocationDecider] [elasticsearch1-1] using [cluster_concurrent_rebalance] with [2]
[2017-10-12T13:10:21,649][DEBUG][o.e.c.r.a.d.ThrottlingAllocationDecider] [elasticsearch1-1] using node_concurrent_outgoing_recoveries [2], node_concurrent_incoming_recoveries [2], node_initial_primaries_recoveries [4]
[2017-10-12T13:10:25,282][DEBUG][o.e.i.s.IndexStoreConfig ] [elasticsearch1-1] using indices.store.throttle.type [NONE], with index.store.throttle.max_bytes_per_sec [0b]
[2017-10-12T13:10:25,297][DEBUG][o.e.i.IndicesQueryCache  ] [elasticsearch1-1] using [node] query cache with size [9.8mb] max filter count [10000]
[2017-10-12T13:10:25,327][DEBUG][o.e.i.IndexingMemoryController] [elasticsearch1-1] using indexing buffer size [48mb] with indices.memory.shard_inactive_time [5m], indices.memory.interval [5s]
[2017-10-12T13:10:25,501][DEBUG][o.e.h.n.Netty4HttpServerTransport] [elasticsearch1-1] using max_chunk_size[8kb], max_header_size[8kb], max_initial_line_length[4kb], max_content_length[100mb], receive_predictor[64kb->64kb], pipelining[true], pipelining_max_events[10000]
[2017-10-12T13:10:25,514][INFO ][o.e.d.DiscoveryModule    ] [elasticsearch1-1] using discovery type [zen]
[2017-10-12T13:10:25,526][DEBUG][o.e.d.z.UnicastZenPing   ] [elasticsearch1-1] using initial hosts [127.0.0.1], with concurrent_connects [10], resolve_timeout [5s]
[2017-10-12T13:10:25,532][DEBUG][o.e.d.z.ElectMasterService] [elasticsearch1-1] using minimum_master_nodes [-1]
[2017-10-12T13:10:25,542][DEBUG][o.e.d.z.ZenDiscovery     ] [elasticsearch1-1] using ping_timeout [3s], join.timeout [1m], master_election.ignore_non_master [false]
[2017-10-12T13:10:25,547][DEBUG][o.e.d.z.MasterFaultDetection] [elasticsearch1-1] [master] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
[2017-10-12T13:10:25,561][DEBUG][o.e.d.z.NodesFaultDetection] [elasticsearch1-1] [node  ] uses ping_interval [1s], ping_timeout [30s], ping_retries [3]
[2017-10-12T13:10:26,467][DEBUG][o.e.i.r.RecoverySettings ] [elasticsearch1-1] using max_bytes_per_sec[40mb]
[2017-10-12T13:10:27,863][DEBUG][o.e.g.GatewayAllocator$InternalPrimaryShardAllocator] [elasticsearch1-1] using initial_shards [quorum]
[2017-10-12T13:10:28,614][DEBUG][o.e.g.GatewayMetaState   ] [elasticsearch1-1] took 9ms to load state
[2017-10-12T13:10:28,661][DEBUG][o.e.n.Node               ] [elasticsearch1-1] initializing HTTP handlers ...
[2017-10-12T13:10:29,289][INFO ][o.e.n.Node               ] [elasticsearch1-1] initialized
[2017-10-12T13:10:29,290][INFO ][o.e.n.Node               ] [elasticsearch1-1] starting ...
[2017-10-12T13:10:29,377][DEBUG][i.n.c.MultithreadEventLoopGroup] -Dio.netty.eventLoopThreads: 2
[2017-10-12T13:10:29,480][DEBUG][i.n.u.i.PlatformDependent] -Dio.netty.noUnsafe: true
[2017-10-12T13:10:29,481][DEBUG][i.n.u.i.PlatformDependent] sun.misc.Unsafe: unavailable (io.netty.noUnsafe)
[2017-10-12T13:10:29,485][DEBUG][i.n.u.i.PlatformDependent0] java.nio.DirectByteBuffer.<init>(long, int): unavailable
[2017-10-12T13:10:29,495][DEBUG][i.n.u.i.PlatformDependent] Java version: 8
[2017-10-12T13:10:29,501][DEBUG][i.n.u.i.PlatformDependent] maxDirectMemory: 103415808 bytes (maybe)
[2017-10-12T13:10:29,503][DEBUG][i.n.u.i.PlatformDependent] -Dio.netty.tmpdir: /tmp (java.io.tmpdir)
[2017-10-12T13:10:29,507][DEBUG][i.n.u.i.PlatformDependent] -Dio.netty.bitMode: 64 (sun.arch.data.model)
[2017-10-12T13:10:29,509][DEBUG][i.n.u.i.PlatformDependent] -Dio.netty.noPreferDirect: true
[2017-10-12T13:10:29,510][DEBUG][i.n.u.i.PlatformDependent] io.netty.maxDirectMemory: -1 bytes
[2017-10-12T13:10:29,602][DEBUG][i.n.c.n.NioEventLoop     ] -Dio.netty.noKeySetOptimization: true
[2017-10-12T13:10:29,603][DEBUG][i.n.c.n.NioEventLoop     ] -Dio.netty.selectorAutoRebuildThreshold: 512
[2017-10-12T13:10:29,611][DEBUG][i.n.u.i.PlatformDependent] org.jctools-core.MpscChunkedArrayQueue: unavailable
[2017-10-12T13:10:29,688][DEBUG][o.e.t.n.Netty4Transport  ] [elasticsearch1-1] using profile[default], worker_count[2], port[9300-9400], bind_host[null], publish_host[null], compress[false], connect_timeout[30s], connections_per_node[2/3/6/1/1], receive_predictor[64kb->64kb]
[2017-10-12T13:10:29,710][DEBUG][o.e.t.n.Netty4Transport  ] [elasticsearch1-1] binding server bootstrap to: [0.0.0.0]
[2017-10-12T13:10:29,785][DEBUG][i.n.c.DefaultChannelId   ] -Dio.netty.processId: 254 (auto-detected)
[2017-10-12T13:10:29,797][DEBUG][i.n.u.NetUtil            ] -Djava.net.preferIPv4Stack: false
[2017-10-12T13:10:29,805][DEBUG][i.n.u.NetUtil            ] -Djava.net.preferIPv6Addresses: false
[2017-10-12T13:10:29,810][DEBUG][i.n.u.NetUtil            ] Loopback interface: lo (lo, 127.0.0.1)
[2017-10-12T13:10:29,813][DEBUG][i.n.u.NetUtil            ] /proc/sys/net/core/somaxconn: 128
[2017-10-12T13:10:29,823][DEBUG][i.n.c.DefaultChannelId   ] -Dio.netty.machineId: 02:42:c0:ff:fe:a8:00:02 (auto-detected)
[2017-10-12T13:10:29,903][DEBUG][i.n.u.ResourceLeakDetector] -Dio.netty.leakDetection.level: simple
[2017-10-12T13:10:29,908][DEBUG][i.n.u.ResourceLeakDetector] -Dio.netty.leakDetection.maxRecords: 4
[2017-10-12T13:10:30,051][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.numHeapArenas: 1
[2017-10-12T13:10:30,059][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.numDirectArenas: 1
[2017-10-12T13:10:30,059][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.pageSize: 8192
[2017-10-12T13:10:30,060][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.maxOrder: 11
[2017-10-12T13:10:30,060][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.chunkSize: 16777216
[2017-10-12T13:10:30,060][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.tinyCacheSize: 512
[2017-10-12T13:10:30,062][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.smallCacheSize: 256
[2017-10-12T13:10:30,063][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.normalCacheSize: 64
[2017-10-12T13:10:30,063][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.maxCachedBufferCapacity: 32768
[2017-10-12T13:10:30,064][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.cacheTrimInterval: 8192
[2017-10-12T13:10:30,064][DEBUG][i.n.b.PooledByteBufAllocator] -Dio.netty.allocator.useCacheForAllThreads: true
[2017-10-12T13:10:30,136][DEBUG][i.n.b.ByteBufUtil        ] -Dio.netty.allocator.type: pooled
[2017-10-12T13:10:30,138][DEBUG][i.n.b.ByteBufUtil        ] -Dio.netty.threadLocalDirectBufferSize: 65536
[2017-10-12T13:10:30,138][DEBUG][i.n.b.ByteBufUtil        ] -Dio.netty.maxThreadLocalCharBufferSize: 16384
[2017-10-12T13:10:30,222][DEBUG][o.e.t.n.Netty4Transport  ] [elasticsearch1-1] Bound profile [default] to address {0.0.0.0:9300}
[2017-10-12T13:10:30,251][INFO ][o.e.t.TransportService   ] [elasticsearch1-1] publish_address {192.168.0.2:9300}, bound_addresses {0.0.0.0:9300}
[2017-10-12T13:10:30,296][INFO ][o.e.b.BootstrapChecks    ] [elasticsearch1-1] bound or publishing to a non-loopback or non-link-local address, enforcing bootstrap checks
[2017-10-12T13:10:30,421][DEBUG][o.e.n.Node               ] [elasticsearch1-1] waiting to join the cluster. timeout [30s]
[2017-10-12T13:10:30,427][DEBUG][o.e.c.s.ClusterService   ] [elasticsearch1-1] processing [initial_join]: execute
[2017-10-12T13:10:30,467][DEBUG][o.e.c.s.ClusterService   ] [elasticsearch1-1] processing [initial_join]: took [26ms] no change in cluster_state
[2017-10-12T13:10:30,861][DEBUG][i.n.b.AbstractByteBuf    ] -Dio.netty.buffer.bytebuf.checkAccessible: true
[2017-10-12T13:10:30,874][DEBUG][i.n.u.ResourceLeakDetectorFactory] Loaded default ResourceLeakDetector: io.netty.util.ResourceLeakDetector@7526eb0e
[2017-10-12T13:10:30,917][DEBUG][i.n.u.Recycler           ] -Dio.netty.recycler.maxCapacityPerThread: disabled
[2017-10-12T13:10:30,917][DEBUG][i.n.u.Recycler           ] -Dio.netty.recycler.maxSharedCapacityFactor: disabled
[2017-10-12T13:10:30,918][DEBUG][i.n.u.Recycler           ] -Dio.netty.recycler.linkCapacity: disabled
[2017-10-12T13:10:30,918][DEBUG][i.n.u.Recycler           ] -Dio.netty.recycler.ratio: disabled

Again, it's an endlessly looping mess.

Not seeing much that's obvious, here. Perhaps it's an issue of insufficient RAM...

jjkester commented 7 years ago

Well, I see an IOException in there, not sure if it is lethal though.

jjkester commented 7 years ago

According to https://discuss.elastic.co/t/xpack-unable-to-find-cpuacct-usage/75168/2 that exception should not be causing these issues.

danhunsaker commented 7 years ago

It's a RAM thing. Watch for f213380 to fix this.