codelibs / fess

Fess is very powerful and easily deployable Enterprise Search Server.
https://fess.codelibs.org
Apache License 2.0
1k stars 166 forks source link

Install issue with ES 6.3.2 and Fess 12.2.0 #1807

Closed geovations closed 6 years ago

geovations commented 6 years ago

I created a clean cluster with ES 6.3.2 in AWS. The cluster can see each other and everything is apparently healthy.

I want to install Fess on the cluster, but I'm having issues getting it to start. I've installed the plugins identified by the installation instructions, as well as using the .deb package to install fess. It apparently can't find the mapping.txt file from the config dir (/data/var/lib/elasticsearch/config/ja, specifically). I'm attaching stack traces from Fess.

All of the files it's complaining about are present: fess.json is found at /usr/share/fess/app/WEB-INF/classes/fess_indices/fess.json mappings are present at /data/var/lib/elasticsearch/config/ja/mapping.txt

The fess user can see both of these files, so it's not a permission issue. If you use ls, the user can see it, and has sufficient permissions to read the file.

fess.log

2018-08-15 15:48:42,465 [localhost-startStop-1] WARN  fess_indices/fess.json is not found.
java.lang.IllegalArgumentException: IOException while reading mappings_path: /data/var/lib/elasticsearch/config/ja/mapping.txt
        at org.elasticsearch.index.analysis.Analysis.getWordList(Analysis.java:254) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.analysis.common.MappingCharFilterFactory.<init>(MappingCharFilterFactory.java:43) ~[analysis-common-6.3.2.jar:6.3.2]
        at org.elasticsearch.plugins.AnalysisPlugin$1.get(AnalysisPlugin.java:130) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.index.analysis.AnalysisRegistry.buildMapping(AnalysisRegistry.java:344) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.index.analysis.AnalysisRegistry.buildCharFilterFactories(AnalysisRegistry.java:182) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.index.analysis.AnalysisRegistry.build(AnalysisRegistry.java:154) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.index.IndexService.<init>(IndexService.java:162) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.index.IndexModule.newIndexService(IndexModule.java:367) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.indices.IndicesService.createIndexService(IndicesService.java:453) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.indices.IndicesService.createIndex(IndicesService.java:407) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.MetaDataCreateIndexService$IndexCreationTask.execute(MetaDataCreateIndexService.java:438) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.ClusterStateUpdateTask.execute(ClusterStateUpdateTask.java:45) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.service.MasterService.executeTasks(MasterService.java:630) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.service.MasterService.calculateTaskOutputs(MasterService.java:267) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.service.MasterService.runTasks(MasterService.java:197) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.service.MasterService$Batcher.run(MasterService.java:132) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.service.TaskBatcher.runIfNotProcessed(TaskBatcher.java:150) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.service.TaskBatcher$BatchedTask.run(TaskBatcher.java:188) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.common.util.concurrent.ThreadContext$ContextPreservingRunnable.run(ThreadContext.java:626) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.runAndClean(PrioritizedEsThreadPoolExecutor.java:244) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.common.util.concurrent.PrioritizedEsThreadPoolExecutor$TieBreakingPrioritizedRunnable.run(PrioritizedEsThreadPoolExecutor.java:207) ~[elasticsearch-6.3.2.jar:6.3.2]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
Caused by: java.nio.file.NoSuchFileException: /data/var/lib/elasticsearch/config/ja/mapping.txt
        at sun.nio.fs.UnixException.translateToIOException(UnixException.java:86) ~[?:1.8.0_181]
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102) ~[?:1.8.0_181]
        at sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107) ~[?:1.8.0_181]
        at sun.nio.fs.UnixFileSystemProvider.newByteChannel(UnixFileSystemProvider.java:214) ~[?:1.8.0_181]
        at java.nio.file.Files.newByteChannel(Files.java:361) ~[?:1.8.0_181]
        at java.nio.file.Files.newByteChannel(Files.java:407) ~[?:1.8.0_181]
        at java.nio.file.spi.FileSystemProvider.newInputStream(FileSystemProvider.java:384) ~[?:1.8.0_181]
        at java.nio.file.Files.newInputStream(Files.java:152) ~[?:1.8.0_181]
        at java.nio.file.Files.newBufferedReader(Files.java:2784) ~[?:1.8.0_181]
        at org.elasticsearch.index.analysis.Analysis.getWordList(Analysis.java:245) ~[elasticsearch-6.3.2.jar:6.3.2]
        ... 23 more
2018-08-15 15:48:42,504 [localhost-startStop-1] WARN  fess_indices/fess/alias is not found.
org.elasticsearch.index.IndexNotFoundException: no such index
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.indexNotFoundException(IndexNameExpressionResolver.java:678) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.innerResolve(IndexNameExpressionResolver.java:630) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.resolve(IndexNameExpressionResolver.java:586) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndices(IndexNameExpressionResolver.java:164) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:143) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:103) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.admin.indices.alias.TransportIndicesAliasesAction.masterOperation(TransportIndicesAliasesAction.java:97) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.admin.indices.alias.TransportIndicesAliasesAction.masterOperation(TransportIndicesAliasesAction.java:55) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction.masterOperation(TransportMasterNodeAction.java:88) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction$2.doRun(TransportMasterNodeAction.java:174) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.common.util.concurrent.EsExecutors$1.execute(EsExecutors.java:135) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction.doStart(TransportMasterNodeAction.java:171) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction.start(TransportMasterNodeAction.java:127) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction.doExecute(TransportMasterNodeAction.java:105) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction.doExecute(TransportMasterNodeAction.java:55) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:128) ~[?:?]
        at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:79) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:69) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.doRun(SecurityServerTransportInterceptor.java:259) ~[?:?]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.messageReceived(SecurityServerTransportInterceptor.java:317) ~[?:?]
        at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:66) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1592) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.common.util.concurrent.EsExecutors$1.execute(EsExecutors.java:135) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.TcpTransport.handleRequest(TcpTransport.java:1550) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1414) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.TcpTransport.handleRequest(TcpTransport.java:1550) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1414) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:64) ~[transport-netty4-6.3.2.jar:6.3.2]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:310) ~[netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:297) ~[netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:413) ~[netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[netty-handler-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1359) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:935) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:545) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:499) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) ~[netty-common-4.1.16.Final.jar:4.1.16.Final]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
2018-08-15 15:48:42,571 [localhost-startStop-1] ERROR Failed to initialize Lasta Di.
org.lastaflute.di.exception.ContainerInitFailureException: Look! Read the message below.
/* * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * * *
Failed to initialize the container.

[Path]
esclient.xml

[Namespace]
null

[Included by]
esflute_config.xml
esflute_user.xml
esflute_log.xml
* * * * * * * * * */
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.throwContainerInitFailureException(LaContainerImpl.java:463) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.init(LaContainerImpl.java:415) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.doInit(LaContainerImpl.java:431) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.init(LaContainerImpl.java:413) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.doInit(LaContainerImpl.java:431) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.init(LaContainerImpl.java:413) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.doInit(LaContainerImpl.java:431) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.init(LaContainerImpl.java:413) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.factory.SingletonLaContainerFactory.init(SingletonLaContainerFactory.java:66) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.web.container.WebLastaContainerInitializer.doInitContainer(WebLastaContainerInitializer.java:81) ~[lastaflute-1.0.8.jar:?]
        at org.lastaflute.web.container.WebLastaContainerInitializer.initialize(WebLastaContainerInitializer.java:45) ~[lastaflute-1.0.8.jar:?]
        at org.lastaflute.web.servlet.filter.LastaPrepareFilter.initializeContainer(LastaPrepareFilter.java:136) [lastaflute-1.0.8.jar:?]
        at org.lastaflute.web.servlet.filter.LastaPrepareFilter.init(LastaPrepareFilter.java:94) [lastaflute-1.0.8.jar:?]
        at org.apache.catalina.core.ApplicationFilterConfig.initFilter(ApplicationFilterConfig.java:285) [classes/:?]
        at org.apache.catalina.core.ApplicationFilterConfig.getFilter(ApplicationFilterConfig.java:266) [classes/:?]
        at org.apache.catalina.core.ApplicationFilterConfig.<init>(ApplicationFilterConfig.java:108) [classes/:?]
        at org.apache.catalina.core.StandardContext.filterStart(StandardContext.java:4621) [classes/:?]
        at org.apache.catalina.core.StandardContext.startInternal(StandardContext.java:5266) [classes/:?]
        at org.apache.catalina.util.LifecycleBase.start(LifecycleBase.java:150) [classes/:?]
        at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1421) [classes/:?]
        at org.apache.catalina.core.ContainerBase$StartChild.call(ContainerBase.java:1411) [classes/:?]
        at java.util.concurrent.FutureTask.run(FutureTask.java:266) [?:1.8.0_181]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_181]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_181]
        at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
Caused by: org.lastaflute.di.core.exception.IllegalMethodRuntimeException: [ESSR0060]Can not configure method(open) of org.codelibs.fess.es.client.FessEsClient, because [fess.20180815] IndexNotFoundException[no such index]
        at org.lastaflute.di.core.assembler.AbstractMethodAssembler.invoke(AbstractMethodAssembler.java:61) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.assembler.DefaultInitMethodAssembler.assemble(DefaultInitMethodAssembler.java:40) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.deployer.SingletonComponentDeployer.assemble(SingletonComponentDeployer.java:57) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.deployer.SingletonComponentDeployer.deploy(SingletonComponentDeployer.java:41) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.deployer.SingletonComponentDeployer.init(SingletonComponentDeployer.java:35) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.ComponentDefImpl.init(ComponentDefImpl.java:85) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.doInit(LaContainerImpl.java:434) ~[lasta-di-0.7.6.jar:?]
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.init(LaContainerImpl.java:413) ~[lasta-di-0.7.6.jar:?]
        ... 23 more
        at org.lastaflute.di.core.meta.impl.LaContainerImpl.init(LaContainerImpl.java:413) ~[lasta-di-0.7.6.jar:?]
        ... 23 more
Caused by: org.elasticsearch.index.IndexNotFoundException: no such index
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.indexNotFoundException(IndexNameExpressionResolver.java:678) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.innerResolve(IndexNameExpressionResolver.java:630) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver$WildcardExpressionResolver.resolve(IndexNameExpressionResolver.java:586) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndices(IndexNameExpressionResolver.java:164) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:143) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.cluster.metadata.IndexNameExpressionResolver.concreteIndexNames(IndexNameExpressionResolver.java:76) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.admin.indices.mapping.get.TransportGetMappingsAction.checkBlock(TransportGetMappingsAction.java:62) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.admin.indices.mapping.get.TransportGetMappingsAction.checkBlock(TransportGetMappingsAction.java:40) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction.doStart(TransportMasterNodeAction.java:136) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction$AsyncSingleAction.start(TransportMasterNodeAction.java:127) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction.doExecute(TransportMasterNodeAction.java:105) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.master.TransportMasterNodeAction.doExecute(TransportMasterNodeAction.java:55) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:167) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.xpack.security.action.filter.SecurityActionFilter.apply(SecurityActionFilter.java:128) ~[?:?]
        at org.elasticsearch.action.support.TransportAction$RequestFilterChain.proceed(TransportAction.java:165) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.TransportAction.execute(TransportAction.java:139) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:79) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.action.support.HandledTransportAction$TransportHandler.messageReceived(HandledTransportAction.java:69) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler$1.doRun(SecurityServerTransportInterceptor.java:259) ~[?:?]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.xpack.security.transport.SecurityServerTransportInterceptor$ProfileSecuredRequestHandler.messageReceived(SecurityServerTransportInterceptor.java:317) ~[?:?]
        at org.elasticsearch.transport.RequestHandlerRegistry.processMessageReceived(RequestHandlerRegistry.java:66) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.TcpTransport$RequestHandler.doRun(TcpTransport.java:1592) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.common.util.concurrent.AbstractRunnable.run(AbstractRunnable.java:37) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.common.util.concurrent.EsExecutors$1.execute(EsExecutors.java:135) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.TcpTransport.handleRequest(TcpTransport.java:1550) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1414) ~[elasticsearch-6.3.2.jar:6.3.2]
        at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:64) ~[transport-netty4-6.3.2.jar:6.3.2]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:310) ~[netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:297) ~[netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:413) ~[netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[netty-codec-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[netty-handler-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1359) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:935) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:545) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:499) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) ~[netty-transport-4.1.16.Final.jar:4.1.16.Final]
        at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) ~[netty-common-4.1.16.Final.jar:4.1.16.Final]
        ... 1 more
marevol commented 6 years ago

Did you set the following setting in elasticsearch.yml?

configsync.config_path: /data/var/lib/elasticsearch/config
geovations commented 6 years ago

I did set that variable.

marevol commented 6 years ago

Did you check elasticsearch.log?

geovations commented 6 years ago
[2018-08-20T11:44:16,648][INFO ][o.e.e.NodeEnvironment    ] [fess_1] using [1] data paths, mounts [[/data (/dev/xvdb)]], net usable_space [933.4gb], net total_space [984.1gb], types [ext4]
[2018-08-20T11:44:16,649][INFO ][o.e.e.NodeEnvironment    ] [fess_1] heap size [990.7mb], compressed ordinary object pointers [true]
[2018-08-20T11:44:16,681][INFO ][o.e.n.Node               ] [fess_1] node name [fess_1], node ID [fPlJQgXRQta9Zc473E-VTQ]
[2018-08-20T11:44:16,682][INFO ][o.e.n.Node               ] [fess_1] version[6.3.2], pid[8820], build[default/deb/053779d/2018-07-20T05:20:23.451332Z], OS[Linux/4.4.0-1065-aws/amd64], JVM[Oracle Corporation/OpenJDK 64-Bit Server VM/1.8.0_181/25.181-b13]
[2018-08-20T11:44:16,682][INFO ][o.e.n.Node               ] [fess_1] JVM arguments [-Xms1g, -Xmx1g, -XX:+UseConcMarkSweepGC, -XX:CMSInitiatingOccupancyFraction=75, -XX:+UseCMSInitiatingOccupancyOnly, -XX:+AlwaysPreTouch, -Xss1m, -Djava.awt.headless=true, -Dfile.encoding=UTF-8, -Djna.nosys=true, -XX:-OmitStackTraceInFastThrow, -Dio.netty.noUnsafe=true, -Dio.netty.noKeySetOptimization=true, -Dio.netty.recycler.maxCapacityPerThread=0, -Dlog4j.shutdownHookEnabled=false, -Dlog4j2.disable.jmx=true, -Djava.io.tmpdir=/tmp/elasticsearch.gwpuaUlj, -XX:+HeapDumpOnOutOfMemoryError, -XX:HeapDumpPath=/var/lib/elasticsearch, -XX:ErrorFile=/var/log/elasticsearch/hs_err_pid%p.log, -XX:+PrintGCDetails, -XX:+PrintGCDateStamps, -XX:+PrintTenuringDistribution, -XX:+PrintGCApplicationStoppedTime, -Xloggc:/var/log/elasticsearch/gc.log, -XX:+UseGCLogFileRotation, -XX:NumberOfGCLogFiles=32, -XX:GCLogFileSize=64m, -Des.path.home=/usr/share/elasticsearch, -Des.path.conf=/etc/elasticsearch, -Des.distribution.flavor=default, -Des.distribution.type=deb]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [aggs-matrix-stats]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [analysis-common]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [ingest-common]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [lang-expression]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [lang-mustache]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [lang-painless]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [mapper-extras]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [parent-join]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [percolator]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [rank-eval]
[2018-08-20T11:44:19,969][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [reindex]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [repository-url]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [transport-netty4]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [tribe]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-core]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-deprecation]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-graph]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-logstash]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-ml]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-monitoring]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-rollup]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-security]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-sql]
[2018-08-20T11:44:19,970][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-upgrade]
[2018-08-20T11:44:19,971][INFO ][o.e.p.PluginsService     ] [fess_1] loaded module [x-pack-watcher]
[2018-08-20T11:44:19,971][INFO ][o.e.p.PluginsService     ] [fess_1] loaded plugin [analysis-extension]
[2018-08-20T11:44:19,971][INFO ][o.e.p.PluginsService     ] [fess_1] loaded plugin [analysis-fess]
[2018-08-20T11:44:19,971][INFO ][o.e.p.PluginsService     ] [fess_1] loaded plugin [configsync]
[2018-08-20T11:44:19,971][INFO ][o.e.p.PluginsService     ] [fess_1] loaded plugin [dataformat]
[2018-08-20T11:44:19,971][INFO ][o.e.p.PluginsService     ] [fess_1] loaded plugin [discovery-ec2]
[2018-08-20T11:44:19,971][INFO ][o.e.p.PluginsService     ] [fess_1] loaded plugin [langfield]
[2018-08-20T11:44:19,971][INFO ][o.e.p.PluginsService     ] [fess_1] loaded plugin [learning-to-rank]
[2018-08-20T11:44:19,972][INFO ][o.e.p.PluginsService     ] [fess_1] loaded plugin [minhash]
[2018-08-20T11:44:19,972][INFO ][o.e.p.PluginsService     ] [fess_1] loaded plugin [repository-s3]
[2018-08-20T11:44:23,697][INFO ][o.e.x.s.a.s.FileRolesStore] [fess_1] parsed [0] roles from file [/etc/elasticsearch/roles.yml]
[2018-08-20T11:44:24,187][INFO ][o.e.x.m.j.p.l.CppLogMessageHandler] [controller/8885] [Main.cc@109] controller (64 bit): Version 6.3.2 (Build 903094f295d249) Copyright (c) 2018 Elasticsearch BV
[2018-08-20T11:44:24,659][DEBUG][o.e.a.ActionModule       ] Using REST wrapper from plugin org.elasticsearch.xpack.security.Security
[2018-08-20T11:44:25,310][INFO ][o.e.d.DiscoveryModule    ] [fess_1] using discovery type [zen]
[2018-08-20T11:44:26,294][INFO ][o.e.n.Node               ] [fess_1] initialized
[2018-08-20T11:44:26,294][INFO ][o.e.n.Node               ] [fess_1] starting ...
[2018-08-20T11:44:26,490][INFO ][o.e.t.TransportService   ] [fess_1] publish_address {172.40.0.53:9300}, bound_addresses {[::1]:9300}, {127.0.0.1:9300}, {172.40.0.53:9300}, {[fe80::87a:9dff:fe8c:ccec]:9300}
[2018-08-20T11:44:26,533][INFO ][o.e.b.BootstrapChecks    ] [fess_1] bound or publishing to a non-loopback address, enforcing bootstrap checks
[2018-08-20T11:44:26,561][DEBUG][o.e.a.a.c.h.TransportClusterHealthAction] [fess_1] no known master node, scheduling a retry
[2018-08-20T11:44:30,315][INFO ][o.e.c.s.ClusterApplierService] [fess_1] detected_master {fess-2}{Zxc79khyTRWyjwxJ2X6CLA}{eMoacQRcR6u7pbV6_bPbwQ}{172.40.0.189}{172.40.0.189:9300}{aws_availability_zone=us-east-1a, ml.machine_memory=16825729024, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true}, added {{fess-3}{g2Gcxp6mTUydY4dv99aAFg}{ndk9XDkDRfqQgm9zvbe1pg}{172.40.0.113}{172.40.0.113:9300}{aws_availability_zone=us-east-1a, ml.machine_memory=16825724928, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},{fess-2}{Zxc79khyTRWyjwxJ2X6CLA}{eMoacQRcR6u7pbV6_bPbwQ}{172.40.0.189}{172.40.0.189:9300}{aws_availability_zone=us-east-1a, ml.machine_memory=16825729024, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true},}, reason: apply cluster state (from master [master {fess-2}{Zxc79khyTRWyjwxJ2X6CLA}{eMoacQRcR6u7pbV6_bPbwQ}{172.40.0.189}{172.40.0.189:9300}{aws_availability_zone=us-east-1a, ml.machine_memory=16825729024, ml.max_open_jobs=20, xpack.installed=true, ml.enabled=true} committed version [275]])
[2018-08-20T11:44:30,341][INFO ][o.e.c.s.ClusterSettings  ] [fess_1] updating [xpack.monitoring.collection.enabled] from [false] to [true]
[2018-08-20T11:44:30,693][WARN ][o.e.x.s.a.s.m.NativeRoleMappingStore] [fess_1] Failed to clear cache for realms [[]]
[2018-08-20T11:44:30,695][INFO ][o.e.x.s.a.TokenService   ] [fess_1] refresh keys
[2018-08-20T11:44:31,250][INFO ][o.e.x.s.a.TokenService   ] [fess_1] refreshed keys
[2018-08-20T11:44:31,294][INFO ][o.e.l.LicenseService     ] [fess_1] license [2b31e738-9609-448c-b498-c236982fc8d6] mode [basic] - valid
[2018-08-20T11:44:31,397][INFO ][o.e.x.s.t.n.SecurityNetty4HttpServerTransport] [fess_1] publish_address {172.40.0.53:9200}, bound_addresses {[::1]:9200}, {127.0.0.1:9200}, {172.40.0.53:9200}, {[fe80::87a:9dff:fe8c:ccec]:9200}
[2018-08-20T11:44:31,397][INFO ][o.e.n.Node               ] [fess_1] started
[2018-08-20T11:44:32,491][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.configsync] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:32,505][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.configsync] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:32,545][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.configsync] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:32,633][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.configsync] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:32,663][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.configsync] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:32,678][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.configsync] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:32,686][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.configsync] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:47,473][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.20] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:47,483][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.20] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:47,491][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.20] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:47,506][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.20] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:47,512][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-kibana-6-2018.08.20] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:47,518][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.20] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:47,525][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.20] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:47,545][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.19] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:47,550][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.19] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:47,556][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.19] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:47,571][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.19] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:47,580][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-kibana-6-2018.08.19] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:47,590][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.19] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:47,600][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.19] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:47,656][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] ConfigFileUpdater is started at 1m intervals.
[2018-08-20T11:44:49,771][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-es-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:49,797][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:49,808][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:49,846][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:49,856][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-es-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:49,868][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-es-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:49,879][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:50,075][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.kibana] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:50,086][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.kibana] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:50,096][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.kibana] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:50,127][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.kibana] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:50,139][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.kibana] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:50,165][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.kibana] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:50,178][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.kibana] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:50,318][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:50,334][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:50,366][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:50,402][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:50,412][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-kibana-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:50,421][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:50,426][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:50,808][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.16] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:50,814][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.16] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:50,819][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.16] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:50,838][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.16] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:50,845][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-kibana-6-2018.08.16] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:50,851][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.16] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:50,857][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.16] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:51,708][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-es-6-2018.08.14] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:51,714][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.14] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:51,720][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.14] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:51,736][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.14] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:51,742][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-es-6-2018.08.14] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:51,748][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-es-6-2018.08.14] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:51,756][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.14] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:52,464][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:52,471][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:52,478][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-kibana-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:52,510][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:52,517][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-kibana-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:52,524][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:52,532][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-kibana-6-2018.08.17] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:53,356][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-es-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:53,363][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:53,369][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:53,397][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:53,403][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-es-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:53,410][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-es-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:53,416][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.15] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:54,404][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-es-6-2018.08.13] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:54,411][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.13] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:54,417][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.13] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:54,433][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.13] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:54,439][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-es-6-2018.08.13] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:54,444][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-es-6-2018.08.13] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:54,450][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.13] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:44:55,323][INFO ][o.c.e.f.i.a.JapaneseIterationMarkCharFilterFactory] [fess_1] [.monitoring-es-6-2018.08.18] org.codelibs.elasticsearch.extension.analysis.KuromojiIterationMarkCharFilterFactory is found.
[2018-08-20T11:44:55,328][INFO ][o.c.e.f.i.a.JapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.18] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:55,335][INFO ][o.c.e.f.i.a.ReloadableJapaneseTokenizerFactory] [fess_1] [.monitoring-es-6-2018.08.18] org.codelibs.elasticsearch.extension.analysis.ReloadableKuromojiTokenizerFactory is found.
[2018-08-20T11:44:55,350][INFO ][o.c.e.f.i.a.JapaneseBaseFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.18] org.codelibs.elasticsearch.extension.analysis.KuromojiBaseFormFilterFactory is found.
[2018-08-20T11:44:55,356][INFO ][o.c.e.f.i.a.JapaneseKatakanaStemmerFactory] [fess_1] [.monitoring-es-6-2018.08.18] org.codelibs.elasticsearch.extension.analysis.KuromojiKatakanaStemmerFactory is found.
[2018-08-20T11:44:55,362][INFO ][o.c.e.f.i.a.JapanesePartOfSpeechFilterFactory] [fess_1] [.monitoring-es-6-2018.08.18] org.codelibs.elasticsearch.extension.analysis.KuromojiPartOfSpeechFilterFactory is found.
[2018-08-20T11:44:55,368][INFO ][o.c.e.f.i.a.JapaneseReadingFormFilterFactory] [fess_1] [.monitoring-es-6-2018.08.18] org.codelibs.elasticsearch.extension.analysis.KuromojiReadingFormFilterFactory is found.
[2018-08-20T11:46:29,982][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/mapping.txt
[2018-08-20T11:46:29,983][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ckb-iq/protwords.txt
[2018-08-20T11:46:29,984][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ar/protwords.txt
[2018-08-20T11:46:29,985][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/cs/protwords.txt
[2018-08-20T11:46:29,987][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ca/protwords.txt
[2018-08-20T11:46:29,988][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/da/protwords.txt
[2018-08-20T11:46:29,988][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/synonym.txt
[2018-08-20T11:46:29,990][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/fa/mapping.txt
[2018-08-20T11:46:29,990][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/el/protwords.txt
[2018-08-20T11:46:29,991][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/fa/protwords.txt
[2018-08-20T11:46:29,992][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/en-ie/protwords.txt
[2018-08-20T11:46:29,993][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/es/protwords.txt
[2018-08-20T11:46:29,994][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/de/protwords.txt
[2018-08-20T11:46:29,995][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/fi/protwords.txt
[2018-08-20T11:46:29,996][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/en/protwords.txt
[2018-08-20T11:46:29,997][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/eu/protwords.txt
[2018-08-20T11:46:30,000][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ja/mapping.txt
[2018-08-20T11:46:30,001][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ja/kuromoji.txt
[2018-08-20T11:46:30,002][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/hi/protwords.txt
[2018-08-20T11:46:30,003][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/fr/protwords.txt
[2018-08-20T11:46:30,004][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/hu/protwords.txt
[2018-08-20T11:46:30,004][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/id/protwords.txt
[2018-08-20T11:46:30,005][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/it/protwords.txt
[2018-08-20T11:46:30,006][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/hy/protwords.txt
[2018-08-20T11:46:30,007][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/gl/protwords.txt
[2018-08-20T11:46:30,008][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ko/seunjeon.txt
[2018-08-20T11:46:30,009][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ru/protwords.txt
[2018-08-20T11:46:30,010][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/lv/protwords.txt
[2018-08-20T11:46:30,011][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/pt-br/protwords.txt
[2018-08-20T11:46:30,012][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/lt/protwords.txt
[2018-08-20T11:46:30,012][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/nl/protwords.txt
[2018-08-20T11:46:30,013][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/pt/protwords.txt
[2018-08-20T11:46:30,014][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/no/protwords.txt
[2018-08-20T11:46:30,015][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ro/protwords.txt
[2018-08-20T11:46:30,016][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/bg/stopwords.txt
[2018-08-20T11:46:30,017][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ca/stopwords.txt
[2018-08-20T11:46:30,018][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/cs/stopwords.txt
[2018-08-20T11:46:30,019][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ar/stopwords.txt
[2018-08-20T11:46:30,020][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ckb-iq/stopwords.txt
[2018-08-20T11:46:30,021][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/da/stopwords.txt
[2018-08-20T11:46:30,022][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/th/protwords.txt
[2018-08-20T11:46:30,023][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/sv/protwords.txt
[2018-08-20T11:46:30,024][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/tr/protwords.txt
[2018-08-20T11:46:30,026][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/fa/stopwords.txt
[2018-08-20T11:46:30,028][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/es/stopwords.txt
[2018-08-20T11:46:30,029][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/fi/stopwords.txt
[2018-08-20T11:46:30,030][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/de/stopwords.txt
[2018-08-20T11:46:30,031][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/fr/stopwords.txt
[2018-08-20T11:46:30,032][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/en-ie/stopwords.txt
[2018-08-20T11:46:30,033][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/eu/stopwords.txt
[2018-08-20T11:46:30,034][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/el/stopwords.txt
[2018-08-20T11:46:30,035][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/en/stopwords.txt
[2018-08-20T11:46:30,037][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/id/stopwords.txt
[2018-08-20T11:46:30,038][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/hi/stopwords.txt
[2018-08-20T11:46:30,039][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/it/stopwords.txt
[2018-08-20T11:46:30,040][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/hu/stopwords.txt
[2018-08-20T11:46:30,041][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/gl/stopwords.txt
[2018-08-20T11:46:30,042][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/lt/stopwords.txt
[2018-08-20T11:46:30,043][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/hy/stopwords.txt
[2018-08-20T11:46:30,044][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ja/stopwords.txt
[2018-08-20T11:46:30,045][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ko/stopwords.txt
[2018-08-20T11:46:30,046][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ro/stopwords.txt
[2018-08-20T11:46:30,047][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ru/stopwords.txt
[2018-08-20T11:46:30,048][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/pt/stopwords.txt
[2018-08-20T11:46:30,049][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/th/stopwords.txt
[2018-08-20T11:46:30,050][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/lv/stopwords.txt
[2018-08-20T11:46:30,051][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/no/stopwords.txt
[2018-08-20T11:46:30,052][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/pt-br/stopwords.txt
[2018-08-20T11:46:30,053][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/sv/stopwords.txt
[2018-08-20T11:46:30,054][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/nl/stopwords.txt
[2018-08-20T11:46:30,055][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/tr/stopwords.txt
[2018-08-20T11:46:30,055][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/vi/stopwords.txt
[2018-08-20T11:46:30,056][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/zh-cn/stopwords.txt
[2018-08-20T11:46:30,057][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/zh-tw/stopwords.txt
[2018-08-20T11:46:30,058][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ckb-iq/stemmer_override.txt
[2018-08-20T11:46:30,059][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ar/stemmer_override.txt
[2018-08-20T11:46:30,060][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/bg/stemmer_override.txt
[2018-08-20T11:46:30,060][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ca/stemmer_override.txt
[2018-08-20T11:46:30,061][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/cs/stemmer_override.txt
[2018-08-20T11:46:30,062][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/en-ie/stemmer_override.txt
[2018-08-20T11:46:30,063][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/da/stemmer_override.txt
[2018-08-20T11:46:30,064][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/de/stemmer_override.txt
[2018-08-20T11:46:30,065][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/el/stemmer_override.txt
[2018-08-20T11:46:30,066][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/en/stemmer_override.txt
[2018-08-20T11:46:30,067][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/es/stemmer_override.txt
[2018-08-20T11:46:30,068][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/eu/stemmer_override.txt
[2018-08-20T11:46:30,068][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/fi/stemmer_override.txt
[2018-08-20T11:46:30,069][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/fr/stemmer_override.txt
[2018-08-20T11:46:30,070][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/nl/stemmer_override.txt
[2018-08-20T11:46:30,071][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/gl/stemmer_override.txt
[2018-08-20T11:46:30,072][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/hi/stemmer_override.txt
[2018-08-20T11:46:30,073][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/hu/stemmer_override.txt
[2018-08-20T11:46:30,073][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/hy/stemmer_override.txt
[2018-08-20T11:46:30,074][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/id/stemmer_override.txt
[2018-08-20T11:46:30,075][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/it/stemmer_override.txt
[2018-08-20T11:46:30,076][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/lt/stemmer_override.txt
[2018-08-20T11:46:30,077][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/lv/stemmer_override.txt
[2018-08-20T11:46:30,078][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/no/stemmer_override.txt
[2018-08-20T11:46:30,079][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/pt-br/stemmer_override.txt
[2018-08-20T11:46:30,080][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/pt/stemmer_override.txt
[2018-08-20T11:46:30,081][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ro/stemmer_override.txt
[2018-08-20T11:46:30,082][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/ru/stemmer_override.txt
[2018-08-20T11:46:30,083][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/sv/stemmer_override.txt
[2018-08-20T11:46:30,084][INFO ][o.c.e.c.s.ConfigSyncService] [fess_1] Updated /data/var/lib/elasticsearch/config/tr/stemmer_override.txt
[2018-08-20T11:46:30,089][WARN ][r.suppressed             ] path: /_configsync/flush, params: {}
org.elasticsearch.transport.RemoteTransportException: [fess-3][172.40.0.113:9300][cluster:configsync/flush]
Caused by: org.elasticsearch.transport.ActionNotFoundTransportException: No handler for action [cluster:configsync/flush]
    at org.elasticsearch.transport.TcpTransport.handleRequest(TcpTransport.java:1537) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.transport.TcpTransport.messageReceived(TcpTransport.java:1414) ~[elasticsearch-6.3.2.jar:6.3.2]
    at org.elasticsearch.transport.netty4.Netty4MessageChannelHandler.channelRead(Netty4MessageChannelHandler.java:64) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
    at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:310) ~[?:?]
    at io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:297) ~[?:?]
    at io.netty.handler.codec.ByteToMessageDecoder.callDecode(ByteToMessageDecoder.java:413) ~[?:?]
    at io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:265) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
    at io.netty.handler.logging.LoggingHandler.channelRead(LoggingHandler.java:241) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:340) ~[?:?]
    at io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1359) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:362) ~[?:?]
    at io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:348) ~[?:?]
    at io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:935) ~[?:?]
    at io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:134) ~[?:?]
    at io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:645) ~[?:?]
    at io.netty.channel.nio.NioEventLoop.processSelectedKeysPlain(NioEventLoop.java:545) ~[?:?]
    at io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:499) ~[?:?]
    at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:459) ~[?:?]
    at io.netty.util.concurrent.SingleThreadEventExecutor$5.run(SingleThreadEventExecutor.java:858) ~[?:?]
    at java.lang.Thread.run(Thread.java:748) [?:1.8.0_181]
marevol commented 6 years ago

Plugins seem not to be installed. See Installation Guide.

geovations commented 6 years ago

plugins are installed per the Installation guide for 12.2.

Name   component          version description
fess_1 analysis-extension 6.3.2   This plugin provides an analysis library.
fess_1 analysis-fess      6.3.2   FessAnalysis Plugin for Elasticsearch
fess_1 configsync         6.3.1   ConfigSync plugin syncs up with configuration files in .configsync index.
fess_1 dataformat         6.3.1   This plugin provides several response formats.
fess_1 langfield          6.3.1   This plugin provides langfield type.
fess_1 learning-to-rank   6.3.0   Learing to Rank Query w/ RankLib Models
fess_1 minhash            6.3.1   This plugin provides b-bit minhash algorism.
marevol commented 6 years ago

[2018-08-20T11:46:30,089][WARN ][r.suppressed ] path: /_configsync/flush, params: {}

Some of nodes might miss some plugins...

geovations commented 6 years ago

I checked that. Here's the complete listing:

fess-2 analysis-extension 6.3.2   This plugin provides an analysis library.
fess-3 analysis-extension 6.3.2   This plugin provides an analysis library.
fess_1 analysis-extension 6.3.2   This plugin provides an analysis library.
fess-2 analysis-fess      6.3.2   FessAnalysis Plugin for Elasticsearch
fess-3 analysis-fess      6.3.2   FessAnalysis Plugin for Elasticsearch
fess_1 analysis-fess      6.3.2   FessAnalysis Plugin for Elasticsearch
fess-2 configsync         6.3.1   ConfigSync plugin syncs up with configuration files in .configsync index.
fess-3 configsync         6.3.1   ConfigSync plugin syncs up with configuration files in .configsync index.
fess_1 configsync         6.3.1   ConfigSync plugin syncs up with configuration files in .configsync index.
fess-2 dataformat         6.3.1   This plugin provides several response formats.
fess-3 dataformat         6.3.1   This plugin provides several response formats.
fess_1 dataformat         6.3.1   This plugin provides several response formats.
fess-2 discovery-ec2      6.3.2   The EC2 discovery plugin allows to use AWS API for the unicast discovery mechanism.
fess-3 discovery-ec2      6.3.2   The EC2 discovery plugin allows to use AWS API for the unicast discovery mechanism.
fess_1 discovery-ec2      6.3.2   The EC2 discovery plugin allows to use AWS API for the unicast discovery mechanism.
fess-2 langfield          6.3.1   This plugin provides langfield type.
fess-3 langfield          6.3.1   This plugin provides langfield type.
fess_1 langfield          6.3.1   This plugin provides langfield type.
fess-2 learning-to-rank   6.3.0   Learing to Rank Query w/ RankLib Models
fess-3 learning-to-rank   6.3.0   Learing to Rank Query w/ RankLib Models
fess_1 learning-to-rank   6.3.0   Learing to Rank Query w/ RankLib Models
fess-2 minhash            6.3.1   This plugin provides b-bit minhash algorism.
fess-3 minhash            6.3.1   This plugin provides b-bit minhash algorism.
fess_1 minhash            6.3.1   This plugin provides b-bit minhash algorism.
fess-2 repository-s3      6.3.2   The S3 repository plugin adds S3 repositories
fess-3 repository-s3      6.3.2   The S3 repository plugin adds S3 repositories
fess_1 repository-s3      6.3.2   The S3 repository plugin adds S3 repositories
geovations commented 6 years ago

I found it. The configsync setting was missing from one of the machines. That apparently won't let it start. Thanks for your help.