search

ncolomer / elasticsearch-osmosis-plugin

An Osmosis plugin that index OpenStreetMap data into elasticsearch
Apache License 2.0
101 stars 34 forks source link

Got exception when trying to read => failed to get local cluster state (ElasticSearch 2.1.2 / osmosis 0.45) #26

Open mhorn69 opened 8 years ago

mhorn69 commented 8 years ago

Hi,

When trying to import an osm file (single ES-Node-seems fine) I got this exception - (System: Ubuntu Server 14.04 LTS / 2 Cores - 7GB):

xxx:/usr/share/elasticsearch# osmosis --read-pbf /osm/extract/guyane-latest.osm.pbf --write-elasticsearch cluster.hosts="localhost" Jul 04, 2016 7:38:43 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Osmosis Version 0.45 Jul 04, 2016 7:38:43 AM org.openstreetmap.osmosis.core.Osmosis run INFO: Preparing pipeline. Jul 04, 2016 7:38:43 AM org.openstreetmap.osmosis.plugin.elasticsearch.client.ElasticsearchClientBuilder buildTransportClient INFO: Connecting to elasticsearch cluster 'elasticsearch' via [localhost] using TransportClient 07:38:43.664 [main] INFO org.elasticsearch.plugins - [Skin] loaded [], sites [] 07:38:43.694 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [force_merge], type [fixed], size [1], queue_size [null] 07:38:43.701 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [percolate], type [fixed], size [2], queue_size [1k] 07:38:43.712 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [fetch_shard_started], type [scaling], min [1], size [4], keep_alive [5m] 07:38:43.713 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [listener], type [fixed], size [1], queue_size [null] 07:38:43.714 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [index], type [fixed], size [2], queue_size [200] 07:38:43.714 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [refresh], type [scaling], min [1], size [1], keep_alive [5m] 07:38:43.714 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [suggest], type [fixed], size [2], queue_size [1k] 07:38:43.714 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [generic], type [cached], keep_alive [30s] 07:38:43.715 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [warmer], type [scaling], min [1], size [1], keep_alive [5m] 07:38:43.716 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [search], type [fixed], size [4], queue_size [1k] 07:38:43.716 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [flush], type [scaling], min [1], size [1], keep_alive [5m] 07:38:43.716 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [fetch_shard_store], type [scaling], min [1], size [4], keep_alive [5m] 07:38:43.716 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [management], type [scaling], min [1], size [5], keep_alive [5m] 07:38:43.717 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [get], type [fixed], size [2], queue_size [1k] 07:38:43.717 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [bulk], type [fixed], size [2], queue_size [50] 07:38:43.717 [main] DEBUG org.elasticsearch.threadpool - [Skin] creating thread_pool [snapshot], type [scaling], min [1], size [1], keep_alive [5m] 07:38:44.086 [main] DEBUG org.elasticsearch.common.network - configuration:

lo inet 127.0.0.1 netmask:255.0.0.0 scope:host inet6 ::1 prefixlen:128 scope:host UP LOOPBACK mtu:65536 index:1

eth0 inet 10.0.0.4 netmask:255.255.255.0 broadcast:10.0.0.255 scope:site inet6 fe80::20d:3aff:fe22:ed45 prefixlen:64 scope:link hardware 00:0D:3A:22:ED:45 UP MULTICAST mtu:1500 index:2

07:38:44.114 [main] DEBUG org.elasticsearch.common.netty - using gathering [true] 07:38:44.129 [main] DEBUG org.elasticsearch.client.transport - [Skin] node_sampler_interval[5s] 07:38:44.144 [main] DEBUG o.e.n.c.socket.nio.SelectorUtil - Using select timeout of 500 07:38:44.144 [main] DEBUG o.e.n.c.socket.nio.SelectorUtil - Epoll-bug workaround enabled = false 07:38:44.176 [main] DEBUG org.elasticsearch.client.transport - [Skin] adding address [{#transport#-1}{127.0.0.1}{localhost/127.0.0.1:9300}] 07:38:44.276 [elasticsearch[Skin][management][T#1]] DEBUG org.elasticsearch.transport.netty - [Skin] connected to node [{#transport#-1}{127.0.0.1}{localhost/127.0.0.1:9300}] 07:38:44.388 [elasticsearch[Skin][transport_client_worker][T#1]{New I/O worker #1}] INFO org.elasticsearch.client.transport - [Skin] failed to get local cluster state for {#transport#-1}{127.0.0.1}{localhost/127.0.0.1:9300}, disconnecting... org.elasticsearch.transport.RemoteTransportException: [Failed to deserialize response of type [org.elasticsearch.action.admin.cluster.state.ClusterStateResponse]] Caused by: org.elasticsearch.transport.TransportSerializationException: Failed to deserialize response of type [org.elasticsearch.action.admin.cluster.state.ClusterStateResponse] at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:179) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:138) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91] Caused by: java.lang.ExceptionInInitializerError: null at org.elasticsearch.Version.fromId(Version.java:508) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.Version.readVersion(Version.java:280) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.cluster.node.DiscoveryNode.readFrom(DiscoveryNode.java:327) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.cluster.node.DiscoveryNode.readNode(DiscoveryNode.java:310) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.cluster.node.DiscoveryNodes.readFrom(DiscoveryNodes.java:594) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.cluster.node.DiscoveryNodes$Builder.readFrom(DiscoveryNodes.java:674) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.cluster.ClusterState.readFrom(ClusterState.java:699) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.cluster.ClusterState$Builder.readFrom(ClusterState.java:677) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.action.admin.cluster.state.ClusterStateResponse.readFrom(ClusterStateResponse.java:58) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.transport.netty.MessageChannelHandler.handleResponse(MessageChannelHandler.java:177) [elasticsearch-osmosis-plugin-2.1.0.jar:na] ... 23 common frames omitted Caused by: java.lang.IllegalArgumentException: An SPI class of type org.apache.lucene.codecs.PostingsFormat with name 'Lucene50' does not exist. You need to add the corresponding JAR file supporting this SPI to your classpath. The current classpath supports the following names: [es090, completion090, XBloomFilter] at org.apache.lucene.util.NamedSPILoader.lookup(NamedSPILoader.java:109) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.apache.lucene.codecs.PostingsFormat.forName(PostingsFormat.java:112) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.elasticsearch.common.lucene.Lucene.(Lucene.java:68) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] ... 33 common frames omitted 07:38:44.390 [elasticsearch[Skin][transport_client_worker][T#1]{New I/O worker #1}] DEBUG org.elasticsearch.transport.netty - [Skin] disconnecting from [{#transport#-1}{127.0.0.1}{localhost/127.0.0.1:9300}] due to explicit disconnect call 07:38:44.392 [elasticsearch[Skin][transport_client_worker][T#1]{New I/O worker #1}] WARN org.elasticsearch.transport.netty - [Skin] exception caught on transport layer [[id: 0xc470f506, /127.0.0.1:37351 :> localhost/127.0.0.1:9300]], closing connection java.lang.IllegalStateException: Message not fully read (response) for requestId [0], handler [org.elasticsearch.client.transport.TransportClientNodesService$SniffNodesSampler$1$1@7af7b083], error [false]; resetting at org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:145) ~[elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:296) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:268) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.Channels.fireMessageReceived(Channels.java:255) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:337) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at org.jboss.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) [elasticsearch-osmosis-plugin-2.1.0.jar:na] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) [na:1.8.0_91] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_91] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_91] Jul 04, 2016 7:38:44 AM org.openstreetmap.osmosis.core.Osmosis main SEVERE: Execution aborted. NoNodeAvailableException[None of the configured nodes are available: [{#transport#-1}{127.0.0.1}{localhost/127.0.0.1:9300}]] at org.elasticsearch.client.transport.TransportClientNodesService.ensureNodesAreAvailable(TransportClientNodesService.java:290) at org.elasticsearch.client.transport.TransportClientNodesService.execute(TransportClientNodesService.java:207) at org.elasticsearch.client.transport.support.TransportProxyClient.execute(TransportProxyClient.java:55) at org.elasticsearch.client.transport.TransportClient.doExecute(TransportClient.java:283) at org.elasticsearch.client.support.AbstractClient.execute(AbstractClient.java:347) at org.elasticsearch.client.support.AbstractClient$ClusterAdmin.execute(AbstractClient.java:841) at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:85) at org.elasticsearch.action.ActionRequestBuilder.execute(ActionRequestBuilder.java:59) at org.openstreetmap.osmosis.plugin.elasticsearch.client.ElasticsearchClientBuilder.checkConnection(ElasticsearchClientBuilder.java:116) at org.openstreetmap.osmosis.plugin.elasticsearch.client.ElasticsearchClientBuilder.build(ElasticsearchClientBuilder.java:60) at org.openstreetmap.osmosis.plugin.elasticsearch.ElasticSearchWriterFactory.buildElasticsearchClient(ElasticSearchWriterFactory.java:83) at org.openstreetmap.osmosis.plugin.elasticsearch.ElasticSearchWriterFactory.createTaskManagerImpl(ElasticSearchWriterFactory.java:29) at org.openstreetmap.osmosis.core.pipeline.common.TaskManagerFactory.createTaskManager(TaskManagerFactory.java:60) at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.buildTasks(Pipeline.java:50) at org.openstreetmap.osmosis.core.pipeline.common.Pipeline.prepare(Pipeline.java:112) at org.openstreetmap.osmosis.core.Osmosis.run(Osmosis.java:86) at org.openstreetmap.osmosis.core.Osmosis.main(Osmosis.java:37) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:330) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:238) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) at org.codehaus.classworlds.Launcher.main(Launcher.java:47)