search

rafal-szypulka / grafana-ibm-apm

Grafana datasource plugin for IBM APM
MIT License
28 stars 15 forks source link

KFWITM454E on large implementation #20

Closed tysonrm closed 5 years ago

tysonrm commented 6 years ago

Happens after refresh of the same dataset

KFWITM454E Request failed due to offline managed system(s)

{"msgId":"ATKRST100E","stackTrace":"com.ibm.usmi.console.navigator.model.NavException: (ATKRST100E) ATKRST100E An unexpected error occured. The error message is as follows: 'KFWITM454E Request failed due to offline managed system(s).'.: nested exception is: \n\tcom.ibm.tivoli.monitoring.provider.navmodel.ITMRuntimeException: KFWITM454E Request failed due to offline managed system(s).\n\tat com.ibm.tivoli.rest.RestURI.getExceptionResponse(RestURI.java:580)\n\tat com.ibm.tivoli.rest.RestProvidersURI.getDatasourceDatasetItems(RestProvidersURI.java:2304)\n\tat sun.reflect.GeneratedMethodAccessor33.invoke(Unknown Source)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)\n\tat java.lang.reflect.Method.invoke(Method.java:611)\n\tat org.apache.wink.server.internal.handlers.InvokeMethodHandler.handleRequest(InvokeMethodHandler.java:63)\n\tat org.apache.wink.server.handlers.AbstractHandler.handleRequest(AbstractHandler.java:33)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.CreateInvocationParametersHandler.handleRequest(CreateInvocationParametersHandler.java:54)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.handlers.AbstractHandler.handleRequest(AbstractHandler.java:34)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.FindResourceMethodHandler.handleSubResourceMethod(FindResourceMethodHandler.java:188)\n\tat org.apache.wink.server.internal.handlers.FindResourceMethodHandler.handleRequest(FindResourceMethodHandler.java:110)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.FindRootResourceHandler.handleRequest(FindRootResourceHandler.java:95)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.HeadMethodHandler.handleRequest(HeadMethodHandler.java:53)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.OptionsMethodHandler.handleRequest(OptionsMethodHandler.java:46)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.SearchResultHandler.handleRequest(SearchResultHandler.java:33)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.log.ResourceInvocation.handleRequest(ResourceInvocation.java:92)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.log.Requests.handleRequest(Requests.java:76)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.run(AbstractHandlersChain.java:52)\n\tat org.apache.wink.server.internal.RequestProcessor.handleRequestWithoutFaultBarrier(RequestProcessor.java:207)\n\tat org.apache.wink.server.internal.RequestProcessor.handleRequest(RequestProcessor.java:154)\n\tat com.ibm.tivoli.rest.RestRequestProcessor.handleRequest(RestRequestProcessor.java:381)\n\tat org.apache.wink.server.internal.servlet.RestServlet.service(RestServlet.java:124)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:668)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1230)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:775)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:457)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.handleRequest(ServletWrapperImpl.java:178)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterChain.invokeTarget(WebAppFilterChain.java:136)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:79)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:928)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:1025)\n\tat com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:87)\n\tat com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:908)\n\tat com.ibm.ws.webcontainer.WSWebContainer.handleRequest(WSWebContainer.java:1662)\n\tat com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:195)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:453)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewRequest(HttpInboundLink.java:515)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.processRequest(HttpInboundLink.java:306)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.ready(HttpInboundLink.java:277)\n\tat com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.sendToDiscriminators(NewConnectionInitialReadCallback.java:214)\n\tat com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.complete(NewConnectionInitialReadCallback.java:113)\n\tat com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:166)\n\tat com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)\n\tat com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)\n\tat com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:138)\n\tat com.ibm.io.async.ResultHandler.complete(ResultHandler.java:204)\n\tat com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:775)\n\tat com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:905)\n\tat com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1691)\nCaused by: com.ibm.tivoli.monitoring.provider.navmodel.ITMRuntimeException: KFWITM454E Request failed due to offline managed system(s).\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getResult(ITMNavReportCollection.java:859)\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getLargeTableModelNodes(ITMNavReportCollection.java:318)\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getAllNodes(ITMNavReportCollection.java:344)\n\tat com.ibm.tivoli.rest.navmodel.NavNodeFilter.getNodes(NavNodeFilter.java:152)\n\tat com.ibm.tivoli.rest.navmodel.NavCollection.getNodes(NavCollection.java:1191)\n\tat com.ibm.tivoli.rest.RestProvidersURI.getDatasourceDatasetItems(RestProvidersURI.java:2287)\n\t... 77 more\nCaused by: KFWITM454E Request failed due to offline managed system(s).\n\tat com.ibm.TEPS.CTQuery.QueryModelManager.executeRequest(QueryModelManager.java:438)\n\tat candle.fw.model.PBasedRequest.execute(PBasedRequest.java:894)\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getResult(ITMNavReportCollection.java:854)\n\t... 82 more\nCaused by: exception candle.fw.corba.CTProperty.PropertyBasedException {\ncandle.fw.corba.CTProperty.Property[] errorProperties={struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-1020\",\norg.omg.CORBA.Any value=\"autoNT_Processor\"\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2101a\",\norg.omg.CORBA.Any value=701\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2102\",\norg.omg.CORBA.Any value=\"Query node(s) offline, report id = \\'autoNT_Processor\\'.\"\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2105\",\norg.omg.CORBA.Any value=\"REPT101\"\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2108\",\norg.omg.CORBA.Any value=true\n}}\n}\n\tat candle.fw.corba.CTProperty.PropertyBasedExceptionHelper.read(PropertyBasedExceptionHelper.java:27)\n\tat candle.fw.corba.CTQuery._EvaluatorStub.executeRequest(_EvaluatorStub.java:82)\n\tat com.ibm.TEPS.CTQuery.CTQueryBrokerImpl.executeRequest(CTQueryBrokerImpl.java:150)\n\tat com.ibm.TEPS.CTQuery.QueryModelManager.executeRequest(QueryModelManager.java:373)\n\t... 84 more\n","msgSeverity":"error","msgText":"ATKRST100E An unexpected error occured. The error message is as follows: 'KFWITM454E Request failed due to offline managed system(s).'."}
rafal-szypulka commented 6 years ago

It looks like ITM problem. Did you try to run API call via http://:15200/ITMRESTPrivider/test.html as described in chapter "Troubleshooting"? https://github.com/rafal-szypulka/grafana-ibm-apm#troubleshooting

On Fri, Aug 31, 2018 at 7:09 AM tmidboe@us.ibm.com notifications@github.com wrote:

ping me please

KFWITM454E Request failed due to offline managed system(s)

{"msgId":"ATKRST100E","stackTrace":"com.ibm.usmi.console.navigator.model.NavException: (ATKRST100E) ATKRST100E An unexpected error occured. The error message is as follows: 'KFWITM454E Request failed due to offline managed system(s).'.: nested exception is: \n\tcom.ibm.tivoli.monitoring.provider.navmodel.ITMRuntimeException: KFWITM454E Request failed due to offline managed system(s).\n\tat com.ibm.tivoli.rest.RestURI.getExceptionResponse(RestURI.java:580)\n\tat com.ibm.tivoli.rest.RestProvidersURI.getDatasourceDatasetItems(RestProvidersURI.java:2304)\n\tat sun.reflect.GeneratedMethodAccessor33.invoke(Unknown Source)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)\n\tat java.lang.reflect.Method.invoke(Method.java:611)\n\tat org.apache.wink.server.internal.handlers.InvokeMethodHandler.handleRequest(InvokeMethodHandler.java:63)\n\tat org.apache.wink.server.handlers.AbstractHandler.handleRequest(AbstractHandler.java:33)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.CreateInvocationParametersHandler.handleRequest(CreateInvocationParametersHandler.java:54)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.handlers.AbstractHandler.handleRequest(AbstractHandler.java:34)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.FindResourceMethodHandler.handleSubResourceMethod(FindResourceMethodHandler.java:188)\n\tat org.apache.wink.server.internal.handlers.FindResourceMethodHandler.handleRequest(FindResourceMethodHandler.java:110)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.FindRootResourceHandler.handleRequest(FindRootResourceHandler.java:95)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.HeadMethodHandler.handleRequest(HeadMethodHandler.java:53)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.OptionsMethodHandler.handleRequest(OptionsMethodHandler.java:46)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.SearchResultHandler.handleRequest(SearchResultHandler.java:33)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.log.ResourceInvocation.handleRequest(ResourceInvocation.java:92)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.log.Requests.handleRequest(Requests.java:76)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.run(AbstractHandlersChain.java:52)\n\tat org.apache.wink.server.internal.RequestProcessor.handleRequestWithoutFaultBarrier(RequestProcessor.java:207)\n\tat org.apache.wink.server.internal.RequestProcessor.handleRequest(RequestProcessor.java:154)\n\tat com.ibm.tivoli.rest.RestRequestProcessor.handleRequest(RestRequestProcessor.java:381)\n\tat org.apache.wink.server.internal.servlet.RestServlet.service(RestServlet.java:124)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:668)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1230)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:775)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:457)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.handleRequest(ServletWrapperImpl.java:178)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterChain.invokeTarget(WebAppFilterChain.java:136)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:79)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:928)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:1025)\n\tat com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:87)\n\tat com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:908)\n\tat com.ibm.ws.webcontainer.WSWebContainer.handleRequest(WSWebContainer.java:1662)\n\tat com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:195)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:453)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewRequest(HttpInboundLink.java:515)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.processRequest(HttpInboundLink.java:306)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.ready(HttpInboundLink.java:277)\n\tat com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.sendToDiscriminators(NewConnectionInitialReadCallback.java:214)\n\tat com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.complete(NewConnectionInitialReadCallback.java:113)\n\tat com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:166)\n\tat com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)\n\tat com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)\n\tat com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:138)\n\tat com.ibm.io.async.ResultHandler.complete(ResultHandler.java:204)\n\tat com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:775)\n\tat com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:905)\n\tat com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1691)\nCaused by: com.ibm.tivoli.monitoring.provider.navmodel.ITMRuntimeException: KFWITM454E Request failed due to offline managed system(s).\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getResult(ITMNavReportCollection.java:859)\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getLargeTableModelNodes(ITMNavReportCollection.java:318)\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getAllNodes(ITMNavReportCollection.java:344)\n\tat com.ibm.tivoli.rest.navmodel.NavNodeFilter.getNodes(NavNodeFilter.java:152)\n\tat com.ibm.tivoli.rest.navmodel.NavCollection.getNodes(NavCollection.java:1191)\n\tat com.ibm.tivoli.rest.RestProvidersURI.getDatasourceDatasetItems(RestProvidersURI.java:2287)\n\t... 77 more\nCaused by: KFWITM454E Request failed due to offline managed system(s).\n\tat com.ibm.TEPS.CTQuery.QueryModelManager.executeRequest(QueryModelManager.java:438)\n\tat candle.fw.model.PBasedRequest.execute(PBasedRequest.java:894)\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getResult(ITMNavReportCollection.java:854)\n\t... 82 more\nCaused by: exception candle.fw.corba.CTProperty.PropertyBasedException {\ncandle.fw.corba.CTProperty.Property[] errorProperties={struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-1020\",\norg.omg.CORBA.Any value=\"autoNT_Processor\"\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2101a\",\norg.omg.CORBA.Any value=701\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2102\",\norg.omg.CORBA.Any value=\"Query node(s) offline, report id = \'autoNT_Processor\'.\"\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2105\",\norg.omg.CORBA.Any value=\"REPT101\"\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2108\",\norg.omg.CORBA.Any value=true\n}}\n}\n\tat candle.fw.corba.CTProperty.PropertyBasedExceptionHelper.read(PropertyBasedExceptionHelper.java:27)\n\tat candle.fw.corba.CTQuery._EvaluatorStub.executeRequest(_EvaluatorStub.java:82)\n\tat com.ibm.TEPS.CTQuery.CTQueryBrokerImpl.executeRequest(CTQueryBrokerImpl.java:150)\n\tat com.ibm.TEPS.CTQuery.QueryModelManager.executeRequest(QueryModelManager.java:373)\n\t... 84 more\n","msgSeverity":"error","msgText":"ATKRST100E An unexpected error occured. The error message is as follows: 'KFWITM454E Request failed due to offline managed system(s).'."}

  • What Grafana version are you using?
  • What IBM APM datasource version are you using and how you installed it (git clone/downloaded git release/grafana-cli) ?
  • What OS are you running grafana on?
  • What did you do?
  • What was the expected result?
  • What happened instead?
  • If related to metric query / query editor: Include raw network request & response: get by opening Chrome Dev Tools (F12, Ctrl+Shift+I on windows, Cmd+Opt+I on Mac), go the network tab.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/rafal-szypulka/grafana-ibm-apm/issues/20, or mute the thread https://github.com/notifications/unsubscribe-auth/ALH8CQVR4WSEsQwfAQol5WjXk0MVAmBKks5uWMTzgaJpZM4WUmmT .

dan-nadel commented 6 years ago

Hello,

We resolved the issue by giving more memory to the JAVA app on the TEPS server. Still does occur if the request for dates is huge.

Thank you,

Dan Nadel

Office Depot|Max 6600 North Military Trail, Boca Raton, FL 33496-2434 Office - 561-438-8123 / Mobile - 561-541-4896

From: tmidboe@us.ibm.com [mailto:notifications@github.com] Sent: Friday, August 31, 2018 1:09 AM To: rafal-szypulka/grafana-ibm-apm grafana-ibm-apm@noreply.github.com Cc: Subscribed subscribed@noreply.github.com Subject: [rafal-szypulka/grafana-ibm-apm] KFWITM454E on large implementation (#20)

ping me please

KFWITM454E Request failed due to offline managed system(s)

{"msgId":"ATKRST100E","stackTrace":"com.ibm.usmi.console.navigator.model.NavException: (ATKRST100E) ATKRST100E An unexpected error occured. The error message is as follows: 'KFWITM454E Request failed due to offline managed system(s).'.: nested exception is: \n\tcom.ibm.tivoli.monitoring.provider.navmodel.ITMRuntimeException: KFWITM454E Request failed due to offline managed system(s).\n\tat com.ibm.tivoli.rest.RestURI.getExceptionResponse(RestURI.java:580)\n\tat com.ibm.tivoli.rest.RestProvidersURI.getDatasourceDatasetItems(RestProvidersURI.java:2304)\n\tat sun.reflect.GeneratedMethodAccessor33.invoke(Unknown Source)\n\tat sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:37)\n\tat java.lang.reflect.Method.invoke(Method.java:611)\n\tat org.apache.wink.server.internal.handlers.InvokeMethodHandler.handleRequest(InvokeMethodHandler.java:63)\n\tat org.apache.wink.server.handlers.AbstractHandler.handleRequest(AbstractHandler.java:33)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.CreateInvocationParametersHandler.handleRequest(CreateInvocationParametersHandler.java:54)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.handlers.AbstractHandler.handleRequest(AbstractHandler.java:34)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.FindResourceMethodHandler.handleSubResourceMethod(FindResourceMethodHandler.java:188)\n\tat org.apache.wink.server.internal.handlers.FindResourceMethodHandler.handleRequest(FindResourceMethodHandler.java:110)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.FindRootResourceHandler.handleRequest(FindRootResourceHandler.java:95)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.HeadMethodHandler.handleRequest(HeadMethodHandler.java:53)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.OptionsMethodHandler.handleRequest(OptionsMethodHandler.java:46)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.handlers.SearchResultHandler.handleRequest(SearchResultHandler.java:33)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.log.ResourceInvocation.handleRequest(ResourceInvocation.java:92)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.internal.log.Requests.handleRequest(Requests.java:76)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:26)\n\tat org.apache.wink.server.handlers.RequestHandlersChain.handle(RequestHandlersChain.java:22)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.doChain(AbstractHandlersChain.java:67)\n\tat org.apache.wink.server.handlers.AbstractHandlersChain.run(AbstractHandlersChain.java:52)\n\tat org.apache.wink.server.internal.RequestProcessor.handleRequestWithoutFaultBarrier(RequestProcessor.java:207)\n\tat org.apache.wink.server.internal.RequestProcessor.handleRequest(RequestProcessor.java:154)\n\tat com.ibm.tivoli.rest.RestRequestProcessor.handleRequest(RestRequestProcessor.java:381)\n\tat org.apache.wink.server.internal.servlet.RestServlet.service(RestServlet.java:124)\n\tat javax.servlet.http.HttpServlet.service(HttpServlet.java:668)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapper.service(ServletWrapper.java:1230)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:775)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapper.handleRequest(ServletWrapper.java:457)\n\tat com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.handleRequest(ServletWrapperImpl.java:178)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterChain.invokeTarget(WebAppFilterChain.java:136)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterChain.doFilter(WebAppFilterChain.java:79)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterManager.doFilter(WebAppFilterManager.java:928)\n\tat com.ibm.ws.webcontainer.filter.WebAppFilterManager.invokeFilters(WebAppFilterManager.java:1025)\n\tat com.ibm.ws.webcontainer.servlet.CacheServletWrapper.handleRequest(CacheServletWrapper.java:87)\n\tat com.ibm.ws.webcontainer.WebContainer.handleRequest(WebContainer.java:908)\n\tat com.ibm.ws.webcontainer.WSWebContainer.handleRequest(WSWebContainer.java:1662)\n\tat com.ibm.ws.webcontainer.channel.WCChannelLink.ready(WCChannelLink.java:195)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleDiscrimination(HttpInboundLink.java:453)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.handleNewRequest(HttpInboundLink.java:515)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.processRequest(HttpInboundLink.java:306)\n\tat com.ibm.ws.http.channel.inbound.impl.HttpInboundLink.ready(HttpInboundLink.java:277)\n\tat com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.sendToDiscriminators(NewConnectionInitialReadCallback.java:214)\n\tat com.ibm.ws.tcp.channel.impl.NewConnectionInitialReadCallback.complete(NewConnectionInitialReadCallback.java:113)\n\tat com.ibm.ws.tcp.channel.impl.AioReadCompletionListener.futureCompleted(AioReadCompletionListener.java:166)\n\tat com.ibm.io.async.AbstractAsyncFuture.invokeCallback(AbstractAsyncFuture.java:217)\n\tat com.ibm.io.async.AsyncChannelFuture.fireCompletionActions(AsyncChannelFuture.java:161)\n\tat com.ibm.io.async.AsyncFuture.completed(AsyncFuture.java:138)\n\tat com.ibm.io.async.ResultHandler.complete(ResultHandler.java:204)\n\tat com.ibm.io.async.ResultHandler.runEventProcessingLoop(ResultHandler.java:775)\n\tat com.ibm.io.async.ResultHandler$2.run(ResultHandler.java:905)\n\tat com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1691)\nCaused by: com.ibm.tivoli.monitoring.provider.navmodel.ITMRuntimeException: KFWITM454E Request failed due to offline managed system(s).\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getResult(ITMNavReportCollection.java:859)\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getLargeTableModelNodes(ITMNavReportCollection.java:318)\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getAllNodes(ITMNavReportCollection.java:344)\n\tat com.ibm.tivoli.rest.navmodel.NavNodeFilter.getNodes(NavNodeFilter.java:152)\n\tat com.ibm.tivoli.rest.navmodel.NavCollection.getNodes(NavCollection.java:1191)\n\tat com.ibm.tivoli.rest.RestProvidersURI.getDatasourceDatasetItems(RestProvidersURI.java:2287)\n\t... 77 more\nCaused by: KFWITM454E Request failed due to offline managed system(s).\n\tat com.ibm.TEPS.CTQuery.QueryModelManager.executeRequest(QueryModelManager.java:438)\n\tat candle.fw.model.PBasedRequest.execute(PBasedRequest.java:894)\n\tat com.ibm.tivoli.monitoring.provider.navmodel.ITMNavReportCollection.getResult(ITMNavReportCollection.java:854)\n\t... 82 more\nCaused by: exception candle.fw.corba.CTProperty.PropertyBasedException {\ncandle.fw.corba.CTProperty.Property[] errorProperties={struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-1020\",\norg.omg.CORBA.Any value=\"autoNT_Processor\"\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2101a\",\norg.omg.CORBA.Any value=701\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2102\",\norg.omg.CORBA.Any value=\"Query node(s) offline, report id = \'autoNT_Processor\'.\"\n},structfile://'autoNT_Processor/'./%22/n%7d,struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2105\",\norg.omg.CORBA.Any value=\"REPT101\"\n},struct candle.fw.corba.CTProperty.Property {\njava.lang.String key=\"-2108\",\norg.omg.CORBA.Any value=true\n}}\n}\n\tat candle.fw.corba.CTProperty.PropertyBasedExceptionHelper.read(PropertyBasedExceptionHelper.java:27)\n\tat candle.fw.corba.CTQuery._EvaluatorStub.executeRequest(_EvaluatorStub.java:82)\n\tat com.ibm.TEPS.CTQuery.CTQueryBrokerImpl.executeRequest(CTQueryBrokerImpl.java:150)\n\tat com.ibm.TEPS.CTQuery.QueryModelManager.executeRequest(QueryModelManager.java:373)\n\t... 84 more\n","msgSeverity":"error","msgText":"ATKRST100E An unexpected error occured. The error message is as follows: 'KFWITM454E Request failed due to offline managed system(s).'."}

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHubhttps://github.com/rafal-szypulka/grafana-ibm-apm/issues/20, or mute the threadhttps://github.com/notifications/unsubscribe-auth/AdsZinaIwypebF2KrXhT2kznvcqRqxaAks5uWMT0gaJpZM4WUmmT.

CONFIDENTIALITY NOTICE: The information contained in this email and attached document(s) may contain confidential information that is intended only for the addressee(s). If you are not the intended recipient, you are hereby advised that any disclosure, copying, distribution or the taking of any action in reliance upon the information is prohibited. If you have received this email in error, please immediately notify the sender and delete it from your system.

tysonrm commented 5 years ago

This appears to have been a functional issue with our code where we have 2 template variables, where the 1 depends on the other, and both use different datasources. There are issues open in grafana like this, but none seem to match exactly. We used a cors proxy to get around this problem. Anyway, closing this issue.