ukncsc / lme

Logging Made Easy
Apache License 2.0
707 stars 117 forks source link

[BUG] Install stuck on "Waiting for elasticsearch to be ready" #108

Closed rcooperllanes closed 1 year ago

rcooperllanes commented 3 years ago

Hi All,

I'm unfortunately getting stuck at the elasticsearch during the install:

"Waiting for elasticsearch to be ready"

I have tried the suggested fixes in the other bug posts, however I'm still getting stuck.

I ran the following command:

sudo docker stack deploy lme --compose-file /opt/lme/Chapter\ 3\ Files/docker-compose-stack-live.yml

Output: Updating service lme_elasticsearch (id: 8wmpe8k2dq4tap41g96wckzwd) Updating service lme_kibana (id: qtd8aor36d26ajow6oym2ssvf) Updating service lme_logstash (id: ixxl4bvgay0nyzda6nt4wmr28)

Our firewall doesn't seem to be blocking any connections to and from the server, any suggestions are greatly appreciated.

Cheers

duncan-ncc commented 3 years ago

Hello,

Can you please provide the output from the elasticsearch service when your installation gets stuck on "Waiting for elasticsearch to be ready" as described in the following issue: https://github.com/ukncsc/lme/issues/103#issuecomment-845499736

Also worth mentioning that if your installation failed before connecting to elasticsearch then you will probably need to reinstall LME as "docker stack deploy...." will not have the correct configuration files.

rcooperllanes commented 3 years ago

Hi, thanks for the quick response, please see the output below:

Command Ran: sudo docker stack ps lme

Output: ID NAME IMAGE NODE DESIRED STATE CURRENT STATE ERROR PORTS gafr3qc0v2o7 lmeelasticsearch.1 docker.elastic.co/elasticsearch/elasticsearch:7.11.2 lme Running Running 3 hours ago
k028ms5qd0lr \
lmeelasticsearch.1 docker.elastic.co/elasticsearch/elasticsearch:7.11.2 lme Shutdown Shutdown 3 hours ago
90c87kczlgad \
lme_elasticsearch.1 docker.elastic.co/elasticsearch/elasticsearch:7.11.2 lme Shutdown Failed 3 hours ago "No such container: lmeelasti…"
qkbs7e7txzo7 \
lme_elasticsearch.1 docker.elastic.co/elasticsearch/elasticsearch:7.11.2 lme Shutdown Failed 2 weeks ago "No such container: lmeelasti…"
wvbmp57us0mx \
lme_elasticsearch.1 docker.elastic.co/elasticsearch/elasticsearch:7.11.2 lme Shutdown Shutdown 5 weeks ago
dgyr2r5zf409 lmekibana.1 docker.elastic.co/kibana/kibana:7.11.2 lme Running Running 3 hours ago
vva63qjcfaow \
lmekibana.1 docker.elastic.co/kibana/kibana:7.11.2 lme Shutdown Shutdown 3 hours ago
slyd9mco5q9r \
lme_kibana.1 docker.elastic.co/kibana/kibana:7.11.2 lme Shutdown Failed 3 hours ago "No such container: lmekibana…"
p2558kf560zo \
lme_kibana.1 docker.elastic.co/kibana/kibana:7.11.2 lme Shutdown Failed 2 weeks ago "No such container: lmekibana…"
0xy5v7fhjo5e \
lme_kibana.1 docker.elastic.co/kibana/kibana:7.11.2 lme Shutdown Shutdown 5 weeks ago
at6dtw7cy738 lmelogstash.1 docker.elastic.co/logstash/logstash:7.11.2 lme Running Running 3 hours ago
v79aqzktq8k6 \
lmelogstash.1 docker.elastic.co/logstash/logstash:7.11.2 lme Shutdown Failed 3 hours ago "task: non-zero exit (137)"
mqu7un758s06 \
lme_logstash.1 docker.elastic.co/logstash/logstash:7.11.2 lme Shutdown Failed 5 weeks ago "No such container: lmelogsta…"
093zocpq9xvw \
lmelogstash.1 docker.elastic.co/logstash/logstash:7.11.2 lme Shutdown Failed 5 weeks ago "task: non-zero exit (137)"
m7vhlirpwgb7 \
lme_logstash.1 docker.elastic.co/logstash/logstash:7.11.2 lme Shutdown Failed 5 weeks ago "task: non-zero exit (137)"

Command Ran sudo docker service logs lme_elasticsearch --tail 200

Output: lme_elasticsearch.1.k028ms5qd0lr@lme | Created elasticsearch keystore in /usr/share/elasticsearch/config/elasticsearch.keystore lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:17,968Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "version[7.11.2], pid[7], build[default/docker/3e5a16cfec50876d20ea77b075070932c6464c7d/2021-03-06T05:54:38.141101Z], OS[Linux/5.8.0-59-generic/amd64], JVM[AdoptOpenJDK/OpenJDK 64-Bit Server VM/15.0.1/15.0.1+9]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:17,973Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "JVM home [/usr/share/elasticsearch/jdk], using bundled JDK [true]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:17,974Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "JVM arguments [-Xshare:auto, -Des.networkaddress.cache.ttl=60, -Des.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -XX:+UseG1GC, -Djava.io.tmpdir=/tmp/elasticsearch-12081308566196463430, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=data, -XX:ErrorFile=logs/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=logs/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Des.cgroups.hierarchy.override=/, -Xms5g, -Xmx5g, -XX:MaxDirectMemorySize=2684354560, -XX:G1HeapRegionSize=4m, -XX:InitiatingHeapOccupancyPercent=30, -XX:G1ReservePercent=15, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/usr/share/elasticsearch/config, -Des.distribution.flavor=default, -Des.distribution.type=docker, -Des.bundled_jdk=true]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,836Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [aggs-matrix-stats]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,836Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [analysis-common]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,837Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [constant-keyword]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,837Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [flattened]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,838Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [frozen-indices]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,838Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-common]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,838Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-geoip]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,838Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [ingest-user-agent]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,839Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [kibana]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,840Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-expression]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,845Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-mustache]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,846Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [lang-painless]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,846Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [mapper-extras]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,847Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [mapper-version]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,847Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [parent-join]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,851Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [percolator]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,852Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [rank-eval]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,852Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [reindex]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,852Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [repositories-metering-api]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,852Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [repository-url]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,853Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [search-business-rules]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,854Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [searchable-snapshots]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,854Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [spatial]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,855Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [transform]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,856Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [transport-netty4]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,856Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [unsigned-long]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,856Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [vectors]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,857Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [wildcard]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,857Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-aggregate-metric]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,857Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-analytics]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,858Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-async]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,858Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-async-search]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,858Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-autoscaling]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,859Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ccr]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,859Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-core]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,860Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-data-streams]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,860Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-deprecation]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,861Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-enrich]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,861Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-eql]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,861Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-fleet]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,862Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-graph]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,863Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-identity-provider]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,864Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ilm]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,865Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ingest]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,866Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-logstash]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,866Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ml]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,866Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-monitoring]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,866Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-ql]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,867Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-rollup]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,867Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-runtime-fields]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,867Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-security]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,869Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-sql]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,869Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-stack]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,869Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-voting-only-node]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,870Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "loaded module [x-pack-watcher]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,871Z", "level": "INFO", "component": "o.e.p.PluginsService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "no plugins loaded" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,950Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "using [1] data paths, mounts [[/usr/share/elasticsearch/data (/dev/sda5)]], net usable_space [34gb], net total_space [48.4gb], types [ext4]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:33,953Z", "level": "INFO", "component": "o.e.e.NodeEnvironment", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "heap size [5gb], compressed ordinary object pointers [true]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:34,343Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "node name [es01], node ID [MJr9GEdhSJeQfgQrgQAiQQ], cluster name [loggingmadeeasy-es], roles [transform, master, remote_cluster_client, data, ml, data_content, data_hot, data_warm, data_cold, ingest]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "deprecation", "timestamp": "2021-07-15T07:58:41,937Z", "level": "DEPRECATION", "component": "o.e.d.c.s.Settings", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "[xpack.monitoring.enabled] setting was deprecated in Elasticsearch and will be removed in a future release! See the breaking changes documentation for the next major version." } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:51,007Z", "level": "INFO", "component": "o.e.x.m.p.l.CppLogMessageHandler", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "[controller/478] [Main.cc@117] controller (64 bit): Version 7.11.2 (Build c940034b34c11c) Copyright (c) 2021 Elasticsearch BV" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:52,507Z", "level": "INFO", "component": "o.e.x.s.a.s.FileRolesStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "parsed [0] roles from file [/usr/share/elasticsearch/config/roles.yml]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:58,109Z", "level": "INFO", "component": "o.e.t.NettyAllocator", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "creating NettyAllocator with the following configs: [name=elasticsearch_configured, chunk_size=1mb, suggested_max_allocation_size=1mb, factors={es.unsafe.use_netty_default_chunk_and_page_size=false, g1gc_enabled=true, g1gc_region_size=4mb}]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:58,274Z", "level": "INFO", "component": "o.e.d.DiscoveryModule", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "using discovery type [zen] and seed hosts providers [settings]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:58:59,687Z", "level": "INFO", "component": "o.e.g.DanglingIndicesState", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:00,340Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "initialized" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:00,340Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "starting ..." } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:00,356Z", "level": "INFO", "component": "o.e.x.s.c.PersistentCache", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "persistent cache index loaded" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:00,602Z", "level": "INFO", "component": "o.e.t.TransportService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "publish_address {10.0.0.4:9300}, bound_addresses {0.0.0.0:9300}" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:01,170Z", "level": "INFO", "component": "o.e.b.BootstrapChecks", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "bound or publishing to a non-loopback address, enforcing bootstrap checks" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:01,177Z", "level": "INFO", "component": "o.e.c.c.Coordinator", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "cluster UUID [jqcTNMvSQsGRM1vdvPIsIA]" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:01,437Z", "level": "INFO", "component": "o.e.c.s.MasterService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "elected-as-master ([1] nodes joined)[{es01}{MJr9GEdhSJeQfgQrgQAiQQ}{VOwOTyYTRmqjxU4wZgiBSQ}{10.0.0.4}{10.0.0.4:9300}{cdhilmrstw}{ml.machine_memory=16791490560, xpack.installed=true, transform.node=true, ml.max_open_jobs=20, ml.max_jvm_size=5368709120} elect leader, _BECOME_MASTERTASK, _FINISHELECTION], term: 11, version: 67, delta: master node changed {previous [], current [{es01}{MJr9GEdhSJeQfgQrgQAiQQ}{VOwOTyYTRmqjxU4wZgiBSQ}{10.0.0.4}{10.0.0.4:9300}{cdhilmrstw}{ml.machine_memory=16791490560, xpack.installed=true, transform.node=true, ml.max_open_jobs=20, ml.max_jvm_size=5368709120}]}" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:01,619Z", "level": "INFO", "component": "o.e.c.s.ClusterApplierService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "master node changed {previous [], current [{es01}{MJr9GEdhSJeQfgQrgQAiQQ}{VOwOTyYTRmqjxU4wZgiBSQ}{10.0.0.4}{10.0.0.4:9300}{cdhilmrstw}{ml.machine_memory=16791490560, xpack.installed=true, transform.node=true, ml.max_open_jobs=20, ml.max_jvm_size=5368709120}]}, term: 11, version: 67, reason: Publication{term=11, version=67}" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:01,666Z", "level": "WARN", "component": "o.e.d.SeedHostsResolver", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "failed to resolve host [es01]", lme_elasticsearch.1.k028ms5qd0lr@lme | "stacktrace": ["java.net.UnknownHostException: es01: Name or service not known", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.net.Inet4AddressImpl.lookupAllHostAddr(Native Method) ~[?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.net.InetAddress$PlatformNameService.lookupAllHostAddr(InetAddress.java:932) ~[?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.net.InetAddress.getAddressesFromNameService(InetAddress.java:1517) ~[?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.net.InetAddress$NameServiceAddresses.get(InetAddress.java:851) ~[?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.net.InetAddress.getAllByName0(InetAddress.java:1507) ~[?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.net.InetAddress.getAllByName(InetAddress.java:1366) ~[?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.net.InetAddress.getAllByName(InetAddress.java:1300) ~[?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at org.elasticsearch.transport.TcpTransport.parse(TcpTransport.java:545) ~[elasticsearch-7.11.2.jar:7.11.2]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at org.elasticsearch.transport.TcpTransport.addressesFromString(TcpTransport.java:487) ~[elasticsearch-7.11.2.jar:7.11.2]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at org.elasticsearch.transport.TransportService.addressesFromString(TransportService.java:967) ~[elasticsearch-7.11.2.jar:7.11.2]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at org.elasticsearch.discovery.SeedHostsResolver.lambda$resolveHostsLists$0(SeedHostsResolver.java:133) ~[elasticsearch-7.11.2.jar:7.11.2]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.util.concurrent.FutureTask.run(FutureTask.java:264) ~[?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:673) ~[elasticsearch-7.11.2.jar:7.11.2]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1130) [?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:630) [?:?]", lme_elasticsearch.1.k028ms5qd0lr@lme | "at java.lang.Thread.run(Thread.java:832) [?:?]"] } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:01,873Z", "level": "INFO", "component": "o.e.h.AbstractHttpServerTransport", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "publish_address {10.0.0.4:9200}, bound_addresses {0.0.0.0:9200}", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:01,874Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "started", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:02,512Z", "level": "INFO", "component": "o.e.l.LicenseService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "license [e3e341b9-58e0-4062-9397-88d42e401e72] mode [basic] - valid", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:02,514Z", "level": "INFO", "component": "o.e.x.s.s.SecurityStatusChangeListener", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Active license is now [BASIC]; Security is enabled", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:02,529Z", "level": "INFO", "component": "o.e.g.GatewayService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "recovered [0] indices into cluster_state", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:04,816Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:06,191Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:06,553Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:06,702Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:09,201Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:11,289Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:11,598Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:11,702Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:14,203Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:16,312Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:16,620Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:16,706Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:19,208Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:21,340Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:21,636Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:21,713Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:24,213Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:24,305Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:24,340Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:26,369Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:26,653Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:26,711Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:29,214Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:31,388Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:31,667Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:31,714Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:34,218Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:36,407Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:36,680Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:36,716Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:39,217Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:41,425Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:41,705Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:41,717Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:44,218Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:46,443Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:46,718Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:46,731Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:49,219Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:51,458Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:51,718Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:51,741Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:54,204Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:54,219Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:56,475Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:56,721Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:56,752Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T07:59:59,220Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:01,493Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:01,726Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:01,772Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:04,223Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:06,509Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:06,723Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:06,788Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:09,225Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:11,521Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:11,724Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:11,805Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:14,226Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:16,537Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:16,727Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:16,821Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:19,227Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:21,560Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:21,728Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:21,838Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:24,205Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:24,226Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:26,576Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:26,726Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:26,862Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:29,229Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:31,589Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:31,728Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:31,887Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:34,232Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:36,610Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:36,734Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:36,904Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:39,231Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:41,064Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "stopping ...", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:41,076Z", "level": "INFO", "component": "o.e.x.m.p.l.CppLogMessageHandler", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "[controller/478] [Main.cc@169] ML controller exiting", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:41,077Z", "level": "INFO", "component": "o.e.x.m.p.NativeController", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Native controller process has stopped - no new native processes can be started", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:41,079Z", "level": "INFO", "component": "o.e.x.w.WatcherService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "stopping watch service, reason [shutdown initiated]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:41,080Z", "level": "INFO", "component": "o.e.x.w.WatcherLifeCycleService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "watcher has stopped and shutdown", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:41,390Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "stopped", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:41,390Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "closing ...", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.k028ms5qd0lr@lme | {"type": "server", "timestamp": "2021-07-15T08:00:41,400Z", "level": "INFO", "component": "o.e.n.Node", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "closed", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:42,865Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:45,366Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:45,762Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:45,771Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:47,866Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:50,366Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:50,766Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:50,775Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:52,867Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:55,369Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:55,771Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:55,779Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:22:57,868Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:00,369Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:00,775Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:00,783Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:02,870Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:05,370Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:05,779Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:05,787Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:07,715Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:07,871Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:10,372Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:10,784Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:10,791Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:12,872Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:15,373Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:15,789Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:15,795Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:17,874Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:20,380Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:20,793Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:20,799Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:22,875Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:25,376Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:25,797Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:25,803Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:27,877Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:30,379Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:30,802Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:30,808Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:32,879Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:35,380Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:35,812Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:35,814Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:37,717Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:37,880Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:40,381Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:40,818Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:40,819Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:42,881Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:45,383Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:45,824Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:47,883Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:50,384Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:50,830Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:52,884Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:55,386Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:55,834Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:55,838Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:23:57,884Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:00,385Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:00,841Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:00,842Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:02,885Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:05,386Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:05,846Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:05,847Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:07,716Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:07,886Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:10,388Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:10,851Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:10,851Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:12,888Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:15,389Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:15,855Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:17,890Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:20,390Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:20,859Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:20,860Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:22,890Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:25,390Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:25,864Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:27,892Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:30,393Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:30,868Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:30,868Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:32,893Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:35,393Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:35,872Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:37,716Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:37,894Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:40,401Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:40,876Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:40,877Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:42,895Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:45,396Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:45,881Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:47,896Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:50,397Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:50,886Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:52,898Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:55,399Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:55,890Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:24:57,899Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:00,400Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:00,895Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:02,900Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:05,402Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:05,900Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:05,901Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:07,717Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:07,902Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:10,403Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:10,904Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:10,905Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:12,903Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:15,404Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:15,909Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:17,904Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:20,405Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:20,913Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:20,927Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:22,906Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:25,407Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:25,918Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:25,932Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:27,907Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:30,408Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:30,922Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:30,936Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:32,908Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:35,410Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:35,927Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:35,940Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:37,716Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:37,910Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:40,411Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:40,932Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:40,945Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:42,911Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:45,412Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:45,936Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:45,949Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:47,911Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:50,412Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:50,941Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:50,953Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:52,912Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:55,413Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:55,945Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:55,957Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:25:57,913Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:00,414Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:00,950Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:00,962Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:02,914Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:05,416Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:05,954Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:05,966Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:07,716Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:07,916Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:10,417Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:10,958Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:10,970Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:12,917Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:15,418Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:15,965Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:15,974Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:17,918Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:20,418Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:20,970Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:20,985Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:22,918Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:25,419Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:25,989Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:27,919Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:30,420Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:30,996Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:32,920Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:35,421Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:36,000Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:37,716Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:37,921Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:40,422Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:41,004Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:41,012Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:42,921Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:45,423Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:46,009Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:46,018Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:47,923Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:50,424Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:51,013Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:51,022Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:52,923Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:55,424Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:56,018Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:56,027Z", "level": "ERROR", "component": "o.e.x.s.a.e.NativeUsersStore", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "security index is unavailable. short circuiting retrieval of user [logstash_writer]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" } lme_elasticsearch.1.gafr3qc0v2o7@lme | {"type": "server", "timestamp": "2021-07-15T11:26:57,924Z", "level": "INFO", "component": "o.e.x.s.a.AuthenticationService", "cluster.name": "loggingmadeeasy-es", "node.name": "es01", "message": "Authentication of [kibana] was terminated by realm [reserved] - failed to authenticate user [kibana]", "cluster.uuid": "jqcTNMvSQsGRM1vdvPIsIA", "node.id": "MJr9GEdhSJeQfgQrgQAiQQ" }

duncan-ncc commented 3 years ago

Hi,

As mentioned before and potentially indicated by the authentication failures visible in the logs, I suspect as the inital install did not complete successfully that you will need to reinstall.

If after reinstalling you get the same error, please run the docker service logs command above again before you have attempted to start the stack via docker compose.

rcooperllanes commented 3 years ago

Hi,

I have reinstalled and now I get the following when running the install script:

Command: sudo docker stack ps lme

Output:

ID NAME IMAGE NODE DESIRED STATE CURRENT STATE ERROR PORTS eq29m600ieav lmeelasticsearch.1 docker.elastic.co/elasticsearch/elastic search:7.11.2 administrator-virtual-machine Ready Preparing less t han a second ago stc13oz2hi1x \ lmeelasticsearch.1 docker.elastic.co/elasticsearch/elastic search:7.11.2 administrator-virtual-machine Shutdown Rejected 4 secon ds ago "No such image: docker.elastic…" k0i9pe688xk3 \ lmeelasticsearch.1 docker.elastic.co/elasticsearch/elastic search:7.11.2 administrator-virtual-machine Shutdown Rejected 9 secon ds ago "No such image: docker.elastic…" 79d3o8dw9gab \ lmeelasticsearch.1 docker.elastic.co/elasticsearch/elastic search:7.11.2 administrator-virtual-machine Shutdown Rejected 10 seco nds ago "No such image: docker.elastic…" fa41ripi93ms \ lme_elasticsearch.1 docker.elastic.co/elasticsearch/elastic search:7.11.2 administrator-virtual-machine Shutdown Rejected 25 seco nds ago "No such image: docker.elastic…" 2ox1r28lrii8 lmekibana.1 docker.elastic.co/kibana/kibana:7.11.2 administrator-virtual-machine Ready Preparing less t han a second ago ywbzo99lcfmo \ lmekibana.1 docker.elastic.co/kibana/kibana:7.11.2 administrator-virtual-machine Shutdown Rejected 4 secon ds ago "No such image: docker.elastic…" utygg3vwbxa6 \ lmekibana.1 docker.elastic.co/kibana/kibana:7.11.2 administrator-virtual-machine Shutdown Rejected 9 secon ds ago "No such image: docker.elastic…" dd9moc7fur9e \ lmekibana.1 docker.elastic.co/kibana/kibana:7.11.2 administrator-virtual-machine Shutdown Rejected 10 seco nds ago "No such image: docker.elastic…" j1u4hxfgubnn \ lme_kibana.1 docker.elastic.co/kibana/kibana:7.11.2 administrator-virtual-machine Shutdown Rejected 25 seco nds ago "No such image: docker.elastic…" zlafv0k7ofup lmelogstash.1 docker.elastic.co/logstash/logstash:7.1 1.2 administrator-virtual-machine Ready Preparing less t han a second ago eds8fszqa7v6 \ lmelogstash.1 docker.elastic.co/logstash/logstash:7.1 1.2 administrator-virtual-machine Shutdown Rejected 4 secon ds ago "No such image: docker.elastic…" xq5j275ptsxk \ lmelogstash.1 docker.elastic.co/logstash/logstash:7.1 1.2 administrator-virtual-machine Shutdown Rejected 9 secon ds ago "No such image: docker.elastic…" r2vi1tshufte \ lmelogstash.1 docker.elastic.co/logstash/logstash:7.1 1.2 administrator-virtual-machine Shutdown Rejected 10 seco nds ago "No such image: docker.elastic…" x3ou4fazamy1 \ lme_logstash.1 docker.elastic.co/logstash/logstash:7.1 1.2 administrator-virtual-machine Shutdown Rejected 25 seco nds ago "No such image: docker.elastic…"

adam-ncc commented 2 years ago

Hi @rcooperllanes, the errors in the new installation seem to suggest you can't reach elastic's docker repo for some reason, as it seems to be unable to find the required images.

Are you still having this issue with the latest release or were you able to resolve it? It's probably worth making sure can reach the required connections via any outbound proxies following the instructions here.

jgilgan commented 2 years ago

I had the same message as in the Bug title. In my installation I used self-signed certificates and it turned out that deploy.sh used the IP 127.0.0.1 as host address (which wont verify with the certificate) The problem could be resolved to add an --insecure parameter to all the curl commands and the installation went fine

charliedontsurf commented 2 years ago

I had the same message as in the Bug title. In my installation I used self-signed certificates and it turned out that deploy.sh used the IP 127.0.0.1 as host address (which wont verify with the certificate) The problem could be resolved to add an --insecure parameter to all the curl commands and the installation went fine

I may not be the most proficient with curl - added --insecure immediately after the curl command itself (and before, for example, -k) but this does not seem to have done the trick. Any tips on the precise format?

**** edit

So after running some other troubleshooting, for example sudo docker stack ps lme I found that as @adam-ncc suggested, it was along lines of not reaching the docker repo. After further investigating I was getting error permission denied while trying to connect to the Docker daemon socket

Therefore to fix this I ran sudo chmod 666 /var/run/docker.sock

This allowed everything docker related to start working as expected.

duncan-ncc commented 2 years ago

Hello,

The self signed certificate has a Subject Alternative Name (SAN) of 127.0.0.1 added during creation so the insecure flag should not be needed to get a trusted connection between the elastic components and the deploy script.

@charliedontsurf - You should be able to connect to the docker socket if you are using sudo before docker commands, chmod of 666 will allow anyone on your system to be able to call docker commands, just something to be aware of.

jgilgan commented 2 years ago

Hello,

The self signed certificate has a Subject Alternative Name (SAN) of 127.0.0.1 added during creation so the insecure flag should not be needed to get a trusted connection between the elastic components and the deploy script.

@charliedontsurf - You should be able to connect to the docker socket if you are using sudo before docker commands, chmod of 666 will allow anyone on your system to be able to call docker commands, just something to be aware of.

You are right. The certificate contains 127.0.0.1 as SAN and should work. The main issue turned out to be a slow machine on my end.

duncan-ncc commented 1 year ago

Closed due to project archive