Closed pschichtel closed 8 years ago
elasticsearch version is 2.1.1 (but also happened with 1.x) and the system is Debian Jessy
Hi,
Graylog 1.3 does not support Elasticsearch 2.x, so you should go back to 1.7 before trying anything else. Unfortunately, the error you posted is not saying much, could you please check for any errors in your Graylog server logs when you try to access that page?
Graylog 1.x isn't compatible with ES 2.x at all, so the list of indices also can't be retrieved. Closing this issue.
Didn't you read my comment? it also happened with 1.x ! I upgraded Elasticsearch after I saw the error as I thought the ES version might be too old
@pschichtel Please check the logs of your Graylog server node(s) for error messages regarding Elasticsearch and post them in this issue.
2016-01-11T11:36:05.160+01:00 ERROR [AnyExceptionClassMapper] Unhandled exception in REST resource
java.lang.NullPointerException
at org.graylog2.rest.resources.system.indexer.IndicesResource.indexStats(IndicesResource.java:262)
at org.graylog2.rest.resources.system.indexer.IndicesResource.all(IndicesResource.java:120)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:606)
at org.glassfish.jersey.server.model.internal.ResourceMethodInvocationHandlerFactory$1.invoke(ResourceMethodInvocationHandlerFactory.java:81)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher$1.run(AbstractJavaResourceMethodDispatcher.java:144)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.invoke(AbstractJavaResourceMethodDispatcher.java:161)
at org.glassfish.jersey.server.model.internal.JavaResourceMethodDispatcherProvider$TypeOutInvoker.doDispatch(JavaResourceMethodDispatcherProvider.java:205)
at org.glassfish.jersey.server.model.internal.AbstractJavaResourceMethodDispatcher.dispatch(AbstractJavaResourceMethodDispatcher.java:99)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.invoke(ResourceMethodInvoker.java:389)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:347)
at org.glassfish.jersey.server.model.ResourceMethodInvoker.apply(ResourceMethodInvoker.java:102)
at org.glassfish.jersey.server.ServerRuntime$2.run(ServerRuntime.java:326)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:271)
at org.glassfish.jersey.internal.Errors$1.call(Errors.java:267)
at org.glassfish.jersey.internal.Errors.process(Errors.java:315)
at org.glassfish.jersey.internal.Errors.process(Errors.java:297)
at org.glassfish.jersey.internal.Errors.process(Errors.java:267)
at org.glassfish.jersey.process.internal.RequestScope.runInScope(RequestScope.java:317)
at org.glassfish.jersey.server.ServerRuntime.process(ServerRuntime.java:305)
at org.glassfish.jersey.server.ApplicationHandler.handle(ApplicationHandler.java:1154)
at org.graylog2.jersey.container.netty.NettyContainer.messageReceived(NettyContainer.java:356)
at org.jboss.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70)
at org.jboss.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564)
at org.jboss.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791)
at org.jboss.netty.handler.execution.ChannelUpstreamEventRunnable.doRun(ChannelUpstreamEventRunnable.java:43)
at org.jboss.netty.handler.execution.ChannelEventRunnable.run(ChannelEventRunnable.java:67)
at com.codahale.metrics.InstrumentedExecutorService$InstrumentedRunnable.run(InstrumentedExecutorService.java:176)
at org.jboss.netty.handler.execution.MemoryAwareThreadPoolExecutor$MemoryAwareRunnable.run(MemoryAwareThreadPoolExecutor.java:606)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
elasticsearch version is now 1.7.4 (installed using the puppet module)
@pschichtel Please post the output of the following curl commands (replace "localhost" with the host name or IP address of one of your Elasticsearch nodes):
# curl -i -X GET http://localhost:9200/?pretty
# curl -i -X GET http://localhost:9200/_stats?pretty
Are there any error messages in your Elasticsearch logs?
Hi, i'm just sending the outputs, because @pschichtel is n/a today anymore...
# curl -i -X GET http://<hostname>:9200/?pretty
HTTP/1.1 200 OK
Content-Type: application/json; charset=UTF-8
Content-Length: 247
{
"status" : 200,
"name" : "<hostname>-graylog",
"version" : {
"number" : "1.0.3",
"build_hash" : "NA",
"build_timestamp" : "NA",
"build_snapshot" : false,
"lucene_version" : "4.6"
},
"tagline" : "You Know, for Search"
}
# curl -i -X GET http://localhost:9200/_stats?pretty
see https://gist.github.com/wagnst/bbdb822f91d608500643
@joschi wasn't able to find any errors in the elasticsearch logs. There are only "INFO" entries...
Inside application log of graylog-web i find ERRORS like below...
63
64 2016-01-11T11:35:12.691+01:00 - [ERROR] - from org.graylog2.restclient.lib.ApiClient in pool-11-thread-1
65 Connection refused: /127.0.0.1:12900
66
67 2016-01-11T11:35:14.622+01:00 - [ERROR] - from org.graylog2.restclient.lib.ApiClient in servernodes-refresh-0
68 Connection refused: /127.0.0.1:12900
69
70 2016-01-11T11:35:19.625+01:00 - [ERROR] - from org.graylog2.restclient.lib.ApiClient in servernodes-refresh-0
71 Connection refused: /127.0.0.1:12900
72
73 2016-01-11T11:35:24.627+01:00 - [ERROR] - from org.graylog2.restclient.lib.ApiClient in servernodes-refresh-0
74 Connection refused: /127.0.0.1:12900
Appreciate your help, Steffen
btw I guess this should be reopened
@pschichtel @wagnst Thanks for posting those outputs. You're using Elasticsearch 1.0.3 which isn't supported by Graylog 1.1.x, 1.2.x, or 1.3.x. Please upgrade to Elasticsearch 1.7.4 and try again.
For now I don't see a bug in Graylog, so I won't reopen the issue.
@joschi that is interesting, because APT tells me that 1.7.4 is installed
ok seems like the puppet module failed to properly restart the instance, so it was still the 1.x instance running.
The exception is gone now
@joschi thanks for your help!
The /system/indices page is showing an API error since I upgraded to 1.3 from 1.2. Everything else seems to be working as expected.
(You caused a org.graylog2.restclient.lib.APIException. API call failed GET http://@127.0.0.1:12900/system/indexer/indices returned 500 Internal Server Error body: {"type":"ApiError","message":""})
Reason: Could not get indices. We expected HTTP 200, but got a HTTP 500.