Closed davidcr01 closed 11 months ago
Reproducible in OpenSearch 2.8.0.
root@vagrant:/home/vagrant# cat /var/log/opensearch/opensearch.log | grep -i -E "error|warn"
[2023-12-01T15:25:21,449][INFO ][o.o.n.Node ] [vagrant] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1g, -Xmx1g, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-7772892676629475703, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/opensearch, -XX:ErrorFile=/var/log/opensearch/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/opensearch/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/opensearch/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -XX:MaxDirectMemorySize=536870912, -Dopensearch.path.home=/usr/share/opensearch, -Dopensearch.path.conf=/etc/opensearch, -Dopensearch.distribution.type=deb, -Dopensearch.bundled_jdk=true]
[2023-12-01T15:25:23,412][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] Directory /etc/opensearch has insecure file permissions (should be 0700)
[2023-12-01T15:25:23,412][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] Directory /etc/opensearch/opensearch-observability has insecure file permissions (should be 0700)
[2023-12-01T15:25:23,413][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-observability/observability.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,413][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] Directory /etc/opensearch/opensearch-security has insecure file permissions (should be 0700)
[2023-12-01T15:25:23,413][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/tenants.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,414][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/allowlist.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,414][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/nodes_dn.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,414][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/roles.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,415][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/config.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,415][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/internal_users.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,415][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/audit.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,416][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/opensearch.yml.example has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,416][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/roles_mapping.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,416][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/action_groups.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,417][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-security/whitelist.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,417][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] Directory /etc/opensearch/opensearch-notifications-core has insecure file permissions (should be 0700)
[2023-12-01T15:25:23,417][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-notifications-core/notifications-core.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,418][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] Directory /etc/opensearch/opensearch-reports-scheduler has insecure file permissions (should be 0700)
[2023-12-01T15:25:23,418][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-reports-scheduler/reports-scheduler.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,418][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/log4j2.properties has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,418][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,419][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] Directory /etc/opensearch/opensearch-notifications has insecure file permissions (should be 0700)
[2023-12-01T15:25:23,419][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-notifications/notifications.yml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,419][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] Directory /etc/opensearch/opensearch-performance-analyzer has insecure file permissions (should be 0700)
[2023-12-01T15:25:23,420][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-performance-analyzer/performance-analyzer.properties has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,420][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-performance-analyzer/rca_idle_cluster_manager.conf has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,420][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-performance-analyzer/plugin-stats-metadata has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,421][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-performance-analyzer/rca.conf has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,421][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-performance-analyzer/rca_cluster_manager.conf has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,421][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-performance-analyzer/opensearch_security.policy has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,421][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-performance-analyzer/log4j2.xml has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,422][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-performance-analyzer/supervisord.conf has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,422][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/opensearch-performance-analyzer/agent-stats-metadata has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,423][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] File /etc/opensearch/jvm.options has insecure file permissions (should be 0600)
[2023-12-01T15:25:23,423][WARN ][o.o.s.OpenSearchSecurityPlugin] [vagrant] Directory /etc/opensearch/jvm.options.d has insecure file permissions (should be 0700)
[2023-12-01T15:25:27,990][WARN ][o.o.s.c.Salt ] [vagrant] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes
[2023-12-01T15:25:29,100][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,169][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,174][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,175][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,175][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,175][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,176][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,176][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,176][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,176][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,177][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,177][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,177][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,177][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,178][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,178][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,181][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,182][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,183][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,184][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,184][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,185][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,185][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,185][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,186][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,186][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,186][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,186][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,187][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,187][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,187][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,188][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,188][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,188][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:29,188][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [vagrant] Fail to read queue capacity via reflection
[2023-12-01T15:25:30,360][WARN ][o.o.g.DanglingIndicesState] [vagrant] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually
[2023-12-01T15:25:31,259][WARN ][o.o.b.BootstrapChecks ] [vagrant] the default discovery settings are unsuitable for production use; at least one of [discovery.seed_hosts, discovery.seed_providers, cluster.initial_cluster_manager_nodes / cluster.initial_master_nodes] must be configured
[2023-12-01T15:25:34,639][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [vagrant] Config override setting update called with empty string. Ignoring.
[2023-12-01T15:25:36,688][WARN ][o.o.s.a.r.AuditMessageRouter] [vagrant] No endpoint configured for categories [BAD_HEADERS, FAILED_LOGIN, MISSING_PRIVILEGES, GRANTED_PRIVILEGES, OPENDISTRO_SECURITY_INDEX_ATTEMPT, SSL_EXCEPTION, AUTHENTICATED, INDEX_EVENT, COMPLIANCE_DOC_READ, COMPLIANCE_DOC_WRITE, COMPLIANCE_EXTERNAL_CONFIG, COMPLIANCE_INTERNAL_CONFIG_READ, COMPLIANCE_INTERNAL_CONFIG_WRITE], using default endpoint
Describe the bug
In the WIA release testing, a warning has been found in the Wazuh indexer logs. The generated message is
Fail to read queue capacity via reflection
in a Ubuntu 22 system. The Wazuh indexer version is4.7.1
Besides, this error was observed in https://github.com/wazuh/wazuh-packages/issues/1582#issuecomment-1238142892.To Reproduce Steps to reproduce the behavior:
bash wazuh-install.sh -a
option in a Ubuntu 22 system.Expected behavior This message should not be generated. If it is the normal behavior, please justify why this message is generated.
Plugins No extra plugins are enabled.
Screenshots
Errors
```shellsession root@ip-172-31-46-26:/home/ubuntu# egrep -i "ERROR|WARNING" /var/log/wazuh-indexer/wazuh.log | wc -l grep: /var/log/wazuh-indexer/wazuh.log: No such file or directory 0 root@ip-172-31-46-26:/home/ubuntu# egrep -i "ERROR|WARNING" /var/log/wazuh-indexer/wazuh-cluster.log | wc -l 13 root@ip-172-31-46-26:/home/ubuntu# cat /var/log/wazuh-indexer/wazuh-cluster.log | grep -i -E "error|warn" [2023-11-29T15:30:06,476][INFO ][o.o.n.Node ] [node-1] JVM arguments [-Xshare:auto, -Dopensearch.networkaddress.cache.ttl=60, -Dopensearch.networkaddress.cache.negative.ttl=10, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -XX:+ShowCodeDetailsInExceptionMessages, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dio.netty.allocator.numDirectArenas=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.locale.providers=SPI,COMPAT, -Xms1929m, -Xmx1929m, -XX:+UseG1GC, -XX:G1ReservePercent=25, -XX:InitiatingHeapOccupancyPercent=30, -Djava.io.tmpdir=/tmp/opensearch-5986877441711222989, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/wazuh-indexer, -XX:ErrorFile=/var/log/wazuh-indexer/hs_err_pid%p.log, -Xlog:gc*,gc+age=trace,safepoint:file=/var/log/wazuh-indexer/gc.log:utctime,pid,tags:filecount=32,filesize=64m, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///etc/wazuh-indexer/opensearch-performance-analyzer/opensearch_security.policy, --add-opens=jdk.attach/sun.tools.attach=ALL-UNNAMED, -Dclk.tck=100, -Djdk.attach.allowAttachSelf=true, -Djava.security.policy=file:///usr/share/wazuh-indexer/plugins/opendistro-performance-analyzer/pa_config/es_security.policy, -XX:MaxDirectMemorySize=1011875840, -Dopensearch.path.home=/usr/share/wazuh-indexer, -Dopensearch.path.conf=/etc/wazuh-indexer, -Dopensearch.distribution.type=rpm, -Dopensearch.bundled_jdk=true] [2023-11-29T15:30:10,182][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles_mapping.yml has insecure file permissions (should be 0600) [2023-11-29T15:30:10,183][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/roles.yml has insecure file permissions (should be 0600) [2023-11-29T15:30:10,183][WARN ][o.o.s.OpenSearchSecurityPlugin] [node-1] File /etc/wazuh-indexer/opensearch-security/internal_users.yml has insecure file permissions (should be 0600) [2023-11-29T15:30:19,143][WARN ][o.o.s.c.Salt ] [node-1] If you plan to use field masking pls configure compliance salt e1ukloTsQlOgPquJ to be a random string of 16 chars length identical on all nodes [2023-11-29T15:30:19,198][ERROR][o.o.s.a.s.SinkProvider ] [node-1] Default endpoint could not be created, auditlog will not work properly. [2023-11-29T15:30:19,199][WARN ][o.o.s.a.r.AuditMessageRouter] [node-1] No default storage available, audit log may not work properly. Please check configuration. [2023-11-29T15:30:21,628][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,654][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,660][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,660][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,661][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,661][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,662][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,662][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,662][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,663][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,663][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,664][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,664][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,664][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,677][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,677][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,680][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,689][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,690][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,690][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,690][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,691][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,691][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,692][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,692][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,692][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,693][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,693][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,693][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,694][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,694][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,695][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,695][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,695][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:21,696][WARN ][o.o.p.c.ThreadPoolMetricsCollector] [node-1] Fail to read queue capacity via reflection [2023-11-29T15:30:22,817][WARN ][o.o.g.DanglingIndicesState] [node-1] gateway.auto_import_dangling_indices is disabled, dangling indices will not be automatically detected or imported and must be managed manually [2023-11-29T15:30:24,905][WARN ][o.o.p.c.s.h.ConfigOverridesClusterSettingHandler] [node-1] Config override setting update called with empty string. Ignoring. [2023-11-29T15:30:24,990][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:24,990][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:24,990][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:24,991][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:24,991][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:24,991][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:24,991][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:24,991][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:24,992][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:24,992][ERROR][o.o.s.c.ConfigurationLoaderSecurity7] [node-1] Failure no such index [.opendistro_security] retrieving configuration for [INTERNALUSERS, ACTIONGROUPS, CONFIG, ROLES, ROLESMAPPING, TENANTS, NODESDN, WHITELIST, ALLOWLIST, AUDIT] (index=.opendistro_security) [2023-11-29T15:30:25,513][ERROR][o.o.s.a.BackendRegistry ] [node-1] Not yet initialized (you may need to run securityadmin) ```Host/Environment (please complete the following information):