Open gquintard opened 9 months ago
@gquintard Did you figure this out? I get the same error.
@MLB-BIOMETRIC , not yet, but I'll be sure to update this if I have a way around
Hey folks, I am not able to reproduce this on my setup.
@sherifabdlnaby , thanks for looking at this. I've try a fresh install an still getting this. Could you start from scratch, notably by either wiping all container images first, or at least pulling all the images?
I'm having the same error
also same problem here
same here
not investigate the root cause, I just change to single-node discovery type, and also remove log4j2.properties, it works. this issue should related with cluster mode and logs.
@gquintard The logs you have shared don't seem to show the actual reason for the crash. The stacktrace related to aws config can be ignored according to this issue : https://github.com/elastic/elasticsearch/issues/62493 I also got sidetracked by it, upon looking at the logs up to the elasticsearch container crashing, I noticed another error.
{"type": "server", "timestamp": "2024-07-17T13:55:06,065Z", "level": "ERROR", "component": "o.e.b.Elasticsearch", "cluster.name": "elastdocker-cluster", "node.name": "elastdocker-node-0", "message": "node validation exception\n[1] bootstrap checks failed. You must address the points described in the following [1] lines before starting Elasticsearch.\nbootstrap check failure [1] of [1]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]" }
ERROR: Elasticsearch did not exit normally - check the logs at /usr/share/elasticsearch/logs/elastdocker-cluster.log
{"type": "server", "timestamp": "2024-07-17T13:55:06,070Z", "level": "WARN", "component": "o.e.n.Node", "cluster.name": "elastdocker-cluster", "node.name": "elastdocker-node-0", "message": "unexpected exception while waiting for http server to close",
"stacktrace": ["java.util.concurrent.ExecutionException: java.lang.IllegalStateException: Can't move to stopped state when not started",
"at java.util.concurrent.FutureTask.report(FutureTask.java:122) ~[?:?]",
"at java.util.concurrent.FutureTask.get(FutureTask.java:191) ~[?:?]",
"at org.elasticsearch.node.Node.prepareForClose(Node.java:1754) ~[elasticsearch-8.10.2.jar:?]",
"at org.elasticsearch.bootstrap.Elasticsearch.shutdown(Elasticsearch.java:466) ~[elasticsearch-8.10.2.jar:?]",
"at java.lang.Thread.run(Thread.java:1623) ~[?:?]",
"Caused by: java.lang.IllegalStateException: Can't move to stopped state when not started",
"at org.elasticsearch.common.component.Lifecycle.canMoveToStopped(Lifecycle.java:128) ~[elasticsearch-8.10.2.jar:?]",
"at org.elasticsearch.common.component.AbstractLifecycleComponent.stop(AbstractLifecycleComponent.java:73) ~[elasticsearch-8.10.2.jar:?]",
"at org.elasticsearch.node.Node.lambda$prepareForClose$58(Node.java:1746) ~[elasticsearch-8.10.2.jar:?]",
"at java.util.concurrent.FutureTask.run(FutureTask.java:317) ~[?:?]",
"... 1 more"] }
{"type": "server", "timestamp": "2024-07-17T13:55:06,071Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "elastdocker-cluster", "node.name": "elastdocker-node-0", "message": "stopping ..." }
{"type": "server", "timestamp": "2024-07-17T13:55:06,084Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "elastdocker-cluster", "node.name": "elastdocker-node-0", "message": "stopped" }
{"type": "server", "timestamp": "2024-07-17T13:55:06,084Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "elastdocker-cluster", "node.name": "elastdocker-node-0", "message": "closing ..." }
{"type": "server", "timestamp": "2024-07-17T13:55:06,091Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "elastdocker-cluster", "node.name": "elastdocker-node-0", "message": "closed" }
{"type": "server", "timestamp": "2024-07-17T13:55:06,093Z", "level": "INFO", "component": "o.e.x.m.p.NativeController", "cluster.name": "elastdocker-cluster", "node.name": "elastdocker-node-0", "message": "Native controller process has stopped - no new native processes can be started" }
ERROR: Elasticsearch exited unexpectedly, with exit code 78
🧐 node validation exception\n[1] bootstrap checks failed. You must address the points described in the following [1] lines before starting Elasticsearch.\nbootstrap check failure [1] of [1]: max virtual memory areas vm.max_map_count [65530] is too low, increase to at least [262144]
According to README.md
:
root
)
sysctl -w vm.max_map_count=262144
By default, Virtual Memory is not enough.
I did just that, and the crashes stopped !
hi, thank you for your answer, I won't be able to check if the solution works though as I have move to other tools and will lack the time to set up an environment again.
Hi!
It looks like the
elastisearch
container reboots in a loop when I runI'm attaching the beginning of the logs, but from what I saw
elasticsearch-1
keeps getting restarted and crashing the same way. Am I doing something wrong?