Closed glassfishrobot closed 15 years ago
glassfishrobot
commented
6 years ago glassfishrobot
commented
15 years ago @glassfishrobot Commented kmudupa said: Created an attachment (id=2852) A project which can be used to reproduce this issue.
glassfishrobot
commented
15 years ago @glassfishrobot Commented kmudupa said: Re-assigning to module owner
glassfishrobot
commented
15 years ago @glassfishrobot Commented jfarcand said: I don't think this is an issue with GlassFish as it's your application that lock all threads. By default, Grizlzy will kill those threads after 15 minutes. You can reduce that number by adding:
-Dcom.sun.grizzly.idleThreadTimeout= time-in-mili
I'm closing this issue as workform. Let me know what you think.
Thanks.
glassfishrobot
commented
15 years ago @glassfishrobot Commented sdo said: One note – the bug is filed against 2.1.1, and the feature Jeanfrancois mentions is only in V3. So we could also consider this fixed in V3 rather than worksforme.
Also, it's quite a bad idea in principle to run the HTTP client with no connection timeout anyway. At the OS level, it will in fact eventually timeout anyway, and the better solution is to have the program operate reasonably in the first place.
glassfishrobot
commented
15 years ago @glassfishrobot Commented kmudupa said: Please note that the issue occurs when there are not enough request processing threads in the system. Also the issue is reproducible only when there is a loopback call to the server from the servlet deployed in same server.
If we have N+1 request processing threads then the application works fine without hang. i.e. If there are N concurrent clients hitting the server, having N+1 request processing threads in the http service everything works fine.
<request-processing header-buffer-length-in-bytes="8192" initial-thread-count="2" request- timeout-in-seconds="30" thread-count="5" thread-increment="1"/>
If thread-count is 5 and 5 concurrent clients accessing application A, then glassfish uses 5 threads to delegate the call to servlet A. Servlet A in turn invokes application B using HTTP Client API. Since there is no free request processing thread in the system , glassfish is not able to delegate the call to Application B. The server hangs forever without raising a timeout. Note that the call never landed in Application B, so i dont think the Hang is due to an application. Its due to glassfish not raising a timeout if there are not enough request processing thread.
My understanding was that the value specified in request-timeout-in-seconds will be used for this purpose. i.e. glassfish should raise a timeout exception when there are not enough requesting process thread.
The bug is easily reproducible using the sample i have provided. So I am re-opening this bug.
glassfishrobot
commented
15 years ago @glassfishrobot Commented sdo said: The case described is well understood, and it is fixed in V3 using the property Jeanfrancois describes. So I am again closing the bug.
glassfishrobot
commented
15 years ago @glassfishrobot Commented File: to_reproduce.zip Attached By: kmudupa
glassfishrobot
commented
15 years ago @glassfishrobot Commented Was assigned to sdo
glassfishrobot
commented
7 years ago @glassfishrobot Commented This issue was imported from java.net JIRA GLASSFISH-8479
glassfishrobot
commented
15 years ago @glassfishrobot Commented Reported by kmudupa
glassfishrobot
commented
15 years ago @glassfishrobot Commented Marked as fixed on Tuesday, June 9th 2009, 12:18:23 am
We have a 2 applications, in which application A is going to call Application B using Http Client mechanism. A stand alone Java test client with X number of threads calls ApplicationAServlet, ApplicationAServlet uses HttpClient to call ApplicationBServlet. Both ApplicationAServlet and ApplicationBServlet are deployed to the same GF instance. ApplicationBServlet then uses HttpClient to call http://en.wikipedia.org/wiki/Phoenix,_Arizona and returns the response as String.
Here is what I see happening: (Running a test with 5 request processing threads, 10 test clients threads, and no CONNECTION_TIMEOUT)
1) When the system hangs all 5 request processing threads are stuck in ApplicationAServlet, and have opened a socket connection attempting to make a call to ApplicationBServlet. 2) There are no request processing threads left so ApplicationAServlet keeps trying. 3) Given that CONNECTION_TIMEOUT is infinite HTTPClient continues to wait for a connection to ApplicationBServlet and actively keeps this socket connection active.
These threads remains hung until the instance is rebooted or the number of request processing threads are increased. Note that other HTTP services (81, 4848 admin portal ) and daemon thread function properly.
Please have look on thread dump here. If application source code is required I can send that across.
asadmin> generate-jvm-report --type thread
Thread "RMI TCP Connection(322)129.158.192.136" thread-id 2,827 thread stateTIMED_WAITINGWaiting on lock: com.sun.jmx.remote.internal.ArrayNotificationBuffer@67ab4bd1 at: java.lang.Object.wait(Native Method) at: com.sun.jmx.remote.internal.ArrayNotificationBuffer.fetchNotifications(ArrayNotificationBuffer.java:417) at: com.sun.jmx.remote.internal.ArrayNotificationBuffer$ShareBuffer.fetchNotifications(ArrayNotificationBu ffer.java:209) at: com.sun.jmx.remote.internal.ServerNotifForwarder.fetchNotifs(ServerNotifForwarder.java:258) at: javax.management.remote.rmi.RMIConnectionImpl$2.run(RMIConnectionImpl.java:1227) at: javax.management.remote.rmi.RMIConnectionImpl$2.run(RMIConnectionImpl.java:1225) at: javax.management.remote.rmi.RMIConnectionImpl.fetchNotifications(RMIConnectionImpl.java:1231) at: sun.reflect.GeneratedMethodAccessor77.invoke(Unknown Source) at: sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at: java.lang.reflect.Method.invoke(Method.java:597) at: sun.rmi.server.UnicastServerRef.dispatch(UnicastServerRef.java:305) at: sun.rmi.transport.Transport$1.run(Transport.java:159) at: java.security.AccessController.doPrivileged(Native Method) at: sun.rmi.transport.Transport.serviceCall(Transport.java:155) at: sun.rmi.transport.tcp.TCPTransport.handleMessages(TCPTransport.java:535) at: sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run0(TCPTransport.java:790) at: sun.rmi.transport.tcp.TCPTransport$ConnectionHandler.run(TCPTransport.java:649) at: java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) at: java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at: java.lang.Thread.run(Thread.java:637)
Thread "RMI TCP Connection(idle)" thread-id 2,579 thread-stateTIMED_WAITINGWaiting on lock: java.util.concurrent.SynchronousQueue$TransferStack@1efebb83 at: sun.misc.Unsafe.park(Native Method) at: java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) at: java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:424) at: java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:323) at: java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:874) at: java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:944) at: java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906) at: java.lang.Thread.run(Thread.java:637)
Thread "httpSSLWorkerThread-8080-4" thread-id 102 thread-stateRUNNABLERunning in native at: java.net.SocketInputStream.socketRead0(Native Method) at: java.net.SocketInputStream.read(SocketInputStream.java:129) at: java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at: java.io.BufferedInputStream.read(BufferedInputStream.java:237) at: org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78) at: org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106) at: org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116) at: org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973) at: org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735) at: org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098) at: org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at: org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at: com.sun.cds.example.common.utils.CommonHttpClientUtil.getConnectToURL(CommonHttpClientUtil.ja va:33) at: com.sun.cds.example.first.application.ApplicationAServlet.processRequest(ApplicationAServlet.java:47) at: com.sun.cds.example.first.application.ApplicationAServlet.doPost(ApplicationAServlet.java:82) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:738) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:831) at: org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:411) at: org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:290) at: org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:271) at: org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:202) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: com.sun.enterprise.web.WebPipeline.invoke(WebPipeline.java:94) at: org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:206) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:150) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:272) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.invokeAdapter(DefaultProcessorTask.ja va:637) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.doProcess(DefaultProcessorTask.java:5 68) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.process(DefaultProcessorTask.java:813 ) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.executeProcessorTask(DefaultReadTask.jav a:341) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:263) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:214) at: com.sun.enterprise.web.portunif.PortUnificationPipeline$PUTask.doTask(PortUnificationPipeline.java:38 0) at: com.sun.enterprise.web.connector.grizzly.TaskBase.run(TaskBase.java:265) at: com.sun.enterprise.web.connector.grizzly.ssl.SSLWorkerThread.run(SSLWorkerThread.java:106)
Thread "httpSSLWorkerThread-8080-3" thread-id 101 thread-stateRUNNABLERunning in native at: java.net.SocketInputStream.socketRead0(Native Method) at: java.net.SocketInputStream.read(SocketInputStream.java:129) at: java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at: java.io.BufferedInputStream.read(BufferedInputStream.java:237) at: org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78) at: org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106) at: org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116) at: org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973) at: org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735) at: org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098) at: org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at: org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at: com.sun.cds.example.common.utils.CommonHttpClientUtil.getConnectToURL(CommonHttpClientUtil.ja va:33) at: com.sun.cds.example.first.application.ApplicationAServlet.processRequest(ApplicationAServlet.java:47) at: com.sun.cds.example.first.application.ApplicationAServlet.doPost(ApplicationAServlet.java:82) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:738) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:831) at: org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:411) at: org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:290) at: org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:271) at: org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:202) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: com.sun.enterprise.web.WebPipeline.invoke(WebPipeline.java:94) at: org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:206) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:150) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:272) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.invokeAdapter(DefaultProcessorTask.ja va:637) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.doProcess(DefaultProcessorTask.java:5 68) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.process(DefaultProcessorTask.java:813 ) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.executeProcessorTask(DefaultReadTask.jav a:341) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:263) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:214) at: com.sun.enterprise.web.portunif.PortUnificationPipeline$PUTask.doTask(PortUnificationPipeline.java:38 0) at: com.sun.enterprise.web.connector.grizzly.TaskBase.run(TaskBase.java:265) at: com.sun.enterprise.web.connector.grizzly.ssl.SSLWorkerThread.run(SSLWorkerThread.java:106)
Thread "httpSSLWorkerThread-8080-2" thread-id 100 thread-stateRUNNABLERunning in native at: java.net.SocketInputStream.socketRead0(Native Method) at: java.net.SocketInputStream.read(SocketInputStream.java:129) at: java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at: java.io.BufferedInputStream.read(BufferedInputStream.java:237) at: org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78) at: org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106) at: org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116) at: org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973) at: org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735) at: org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098) at: org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at: org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at: com.sun.cds.example.common.utils.CommonHttpClientUtil.getConnectToURL(CommonHttpClientUtil.ja va:33) at: com.sun.cds.example.first.application.ApplicationAServlet.processRequest(ApplicationAServlet.java:47) at: com.sun.cds.example.first.application.ApplicationAServlet.doPost(ApplicationAServlet.java:82) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:738) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:831) at: org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:411) at: org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:290) at: org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:271) at: org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:202) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: com.sun.enterprise.web.WebPipeline.invoke(WebPipeline.java:94) at: org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:206) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:150) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:272) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.invokeAdapter(DefaultProcessorTask.ja va:637) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.doProcess(DefaultProcessorTask.java:5 68) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.process(DefaultProcessorTask.java:813 ) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.executeProcessorTask(DefaultReadTask.jav a:341) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:263) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:214) at: com.sun.enterprise.web.portunif.PortUnificationPipeline$PUTask.doTask(PortUnificationPipeline.java:38 0) at: com.sun.enterprise.web.connector.grizzly.TaskBase.run(TaskBase.java:265) at: com.sun.enterprise.web.connector.grizzly.ssl.SSLWorkerThread.run(SSLWorkerThread.java:106)
Thread "JMX server connection timeout 97" thread-id 97 thread-stateTIMED_WAITINGWaiting on lock: [I@65c8a55a at: java.lang.Object.wait(Native Method) at: com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java: 150) at: java.lang.Thread.run(Thread.java:637)
Thread "JMX server connection timeout 88" thread-id 88 thread-stateTIMED_WAITINGWaiting on lock: [I@57dfebea at: java.lang.Object.wait(Native Method) at: com.sun.jmx.remote.internal.ServerCommunicatorAdmin$Timeout.run(ServerCommunicatorAdmin.java: 150) at: java.lang.Thread.run(Thread.java:637)
Thread "Thread-28" thread-id 86 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: com.sun.enterprise.admin.jmx.remote.server.notification.ServerNotificationManager.run(ServerNotificati onManager.java:228) at: java.lang.Thread.run(Thread.java:637)
Thread "DestroyJavaVM" thread-id 85 thread-stateRUNNABLE
Thread "Timer-6" thread-id 84 thread-stateTIMED_WAITINGWaiting on lock: java.util.TaskQueue@2df97cb8 at: java.lang.Object.wait(Native Method) at: java.util.TimerThread.mainLoop(Timer.java:509) at: java.util.TimerThread.run(Timer.java:462)
Thread "Timer-5" thread-id 83 thread-stateTIMED_WAITINGWaiting on lock: java.util.TaskQueue@566b2b9c at: java.lang.Object.wait(Native Method) at: java.util.TimerThread.mainLoop(Timer.java:509) at: java.util.TimerThread.run(Timer.java:462)
Thread "ContainerBackgroundProcessor[StandardEngine[com.sun.appserv]]" thread-id 80 thread- stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1800) at: java.lang.Thread.run(Thread.java:637)
Thread "ContainerBackgroundProcessor[StandardEngine[com.sun.appserv].StandardHost[__asadmin].StandardC ontext[/web1]]" thread-id 79 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1800) at: java.lang.Thread.run(Thread.java:637)
Thread "ContainerBackgroundProcessor[StandardEngine[com.sun.appserv].StandardHost[server].StandardConte xt[/GlassFishHangingScenarioAppA]]" thread-id 78 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1800) at: java.lang.Thread.run(Thread.java:637)
Thread "ContainerBackgroundProcessor[StandardEngine[com.sun.appserv].StandardHost[__asadmin].StandardC ontext[]]" thread-id 77 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1800) at: java.lang.Thread.run(Thread.java:637)
Thread "ContainerBackgroundProcessor[StandardEngine[com.sun.appserv].StandardHost[server].StandardConte xt[/GlassFishHangingScenarioAppB]]" thread-id 76 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1800) at: java.lang.Thread.run(Thread.java:637)
Thread "ContainerBackgroundProcessor[StandardEngine[com.sun.appserv].StandardHost[server].StandardConte xt[/__wstx-services]]" thread-id 75 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1800) at: java.lang.Thread.run(Thread.java:637)
Thread "ContainerBackgroundProcessor[StandardEngine[com.sun.appserv].StandardHost[server].StandardConte xt[/__JWSappclients]]" thread-id 74 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1800) at: java.lang.Thread.run(Thread.java:637)
Thread "ContainerBackgroundProcessor[StandardEngine[com.sun.appserv].StandardHost[server].StandardConte xt[]]" thread-id 73 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1800) at: java.lang.Thread.run(Thread.java:637)
Thread "httpWorkerThread-4848-1" thread-id 71 thread-stateRUNNABLE at: sun.management.ThreadImpl.getThreadInfo0(Native Method) at: sun.management.ThreadImpl.getThreadInfo(ThreadImpl.java:145) at: sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at: sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at: sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at: java.lang.reflect.Method.invoke(Method.java:597) at: com.sun.jmx.mbeanserver.ConvertingMethod.invokeWithOpenReturn(ConvertingMethod.java:167) at: com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:96) at: com.sun.jmx.mbeanserver.MXBeanIntrospector.invokeM2(MXBeanIntrospector.java:33) at: com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208) at: com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120) at: com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262) at: javax.management.StandardMBean.invoke(StandardMBean.java:391) at: com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836 ) at: com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761) at: com.sun.enterprise.interceptor.DynamicInterceptor.invoke(DynamicInterceptor.java:178) at: com.sun.jmx.mbeanserver.MXBeanProxy$InvokeHandler.invoke(MXBeanProxy.java:134) at: com.sun.jmx.mbeanserver.MXBeanProxy.invoke(MXBeanProxy.java:148) at: javax.management.MBeanServerInvocationHandler.invoke(MBeanServerInvocationHandler.java:248) at: $Proxy29.getThreadInfo(Unknown Source) at: com.sun.enterprise.admin.mbeans.jvm.ThreadMonitor.getThreadDump(ThreadMonitor.java:75) at: com.sun.enterprise.admin.mbeans.jvm.JVMInformation.getThreadDump(JVMInformation.java:61) at: sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at: sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at: sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at: java.lang.reflect.Method.invoke(Method.java:597) at: com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93) at: com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27) at: com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208) at: com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120) at: com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262) at: com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836 ) at: com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761) at: sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source) at: sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at: java.lang.reflect.Method.invoke(Method.java:597) at: com.sun.enterprise.admin.util.proxy.ProxyClass.invoke(ProxyClass.java:90) at: $Proxy1.invoke(Unknown Source) at: com.sun.enterprise.admin.server.core.jmx.SunoneInterceptor.invoke(SunoneInterceptor.java:304) at: com.sun.enterprise.interceptor.DynamicInterceptor.invoke(DynamicInterceptor.java:174) at: com.sun.enterprise.admin.mbeans.jvm.JVMInformationCollector.invokeMBean(JVMInformationCollector.j ava:127) at: com.sun.enterprise.admin.mbeans.jvm.JVMInformationCollector.getThreadDump(JVMInformationCollect or.java:75) at: sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at: sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at: sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at: java.lang.reflect.Method.invoke(Method.java:597) at: com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:93) at: com.sun.jmx.mbeanserver.StandardMBeanIntrospector.invokeM2(StandardMBeanIntrospector.java:27) at: com.sun.jmx.mbeanserver.MBeanIntrospector.invokeM(MBeanIntrospector.java:208) at: com.sun.jmx.mbeanserver.PerInterface.invoke(PerInterface.java:120) at: com.sun.jmx.mbeanserver.MBeanSupport.invoke(MBeanSupport.java:262) at: javax.management.StandardMBean.invoke(StandardMBean.java:391) at: com.sun.jmx.interceptor.DefaultMBeanServerInterceptor.invoke(DefaultMBeanServerInterceptor.java:836 ) at: com.sun.jmx.mbeanserver.JmxMBeanServer.invoke(JmxMBeanServer.java:761) at: sun.reflect.GeneratedMethodAccessor13.invoke(Unknown Source) at: sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at: java.lang.reflect.Method.invoke(Method.java:597) at: com.sun.enterprise.admin.util.proxy.ProxyClass.invoke(ProxyClass.java:90) at: $Proxy1.invoke(Unknown Source) at: com.sun.enterprise.admin.server.core.jmx.SunoneInterceptor.invoke(SunoneInterceptor.java:304) at: com.sun.enterprise.interceptor.DynamicInterceptor.invoke(DynamicInterceptor.java:174) at: com.sun.enterprise.admin.jmx.remote.server.callers.InvokeCaller.call(InvokeCaller.java:69) at: com.sun.enterprise.admin.jmx.remote.server.MBeanServerRequestHandler.handle(MBeanServerRequest Handler.java:155) at: com.sun.enterprise.admin.jmx.remote.server.servlet.RemoteJmxConnectorServlet.processRequest(Remo teJmxConnectorServlet.java:122) at: com.sun.enterprise.admin.jmx.remote.server.servlet.RemoteJmxConnectorServlet.doPost(RemoteJmxCo nnectorServlet.java:193) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:738) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:831) at: org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:411) at: org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:290) at: org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:271) at: org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:202) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: com.sun.enterprise.web.WebPipeline.invoke(WebPipeline.java:94) at: org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:206) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:150) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:272) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.invokeAdapter(DefaultProcessorTask.ja va:637) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.doProcess(DefaultProcessorTask.java:5 68) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.process(DefaultProcessorTask.java:813 ) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.executeProcessorTask(DefaultReadTask.jav a:341) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:263) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:214) at: com.sun.enterprise.web.connector.grizzly.TaskBase.run(TaskBase.java:265) at: com.sun.enterprise.web.connector.grizzly.WorkerThreadImpl.run(WorkerThreadImpl.java:116)
Thread "httpWorkerThread-4848-0" thread-id 70 thread-stateWAITINGWaiting on lock: com.sun.enterprise.web.connector.grizzly.LinkedListPipeline@15fc3b17 at: java.lang.Object.wait(Native Method) at: java.lang.Object.wait(Object.java:485) at: com.sun.enterprise.web.connector.grizzly.LinkedListPipeline.getTask(LinkedListPipeline.java:291) at: com.sun.enterprise.web.connector.grizzly.WorkerThreadImpl.run(WorkerThreadImpl.java:114)
Thread "httpSSLWorkerThread-8181-1" thread-id 68 thread-stateWAITINGWaiting on lock: com.sun.enterprise.web.connector.grizzly.ssl.SSLPipeline@628b6e47 at: java.lang.Object.wait(Native Method) at: java.lang.Object.wait(Object.java:485) at: com.sun.enterprise.web.connector.grizzly.LinkedListPipeline.getTask(LinkedListPipeline.java:291) at: com.sun.enterprise.web.connector.grizzly.ssl.SSLWorkerThread.run(SSLWorkerThread.java:104)
Thread "SelectorThread-4848" thread-id 69 thread-stateRUNNABLERunning in native at: sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at: sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) at: sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) at: sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) at: sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.doSelect(SelectorThread.java:1337) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.startListener(SelectorThread.java:1284) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.startEndpoint(SelectorThread.java:1247) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.run(SelectorThread.java:1223)
Thread "httpSSLWorkerThread-8181-0" thread-id 67 thread-stateWAITINGWaiting on lock: com.sun.enterprise.web.connector.grizzly.ssl.SSLPipeline@628b6e47 at: java.lang.Object.wait(Native Method) at: java.lang.Object.wait(Object.java:485) at: com.sun.enterprise.web.connector.grizzly.LinkedListPipeline.getTask(LinkedListPipeline.java:291) at: com.sun.enterprise.web.connector.grizzly.ssl.SSLWorkerThread.run(SSLWorkerThread.java:104)
Thread "httpSSLWorkerThread-8080-1" thread-id 65 thread-stateRUNNABLERunning in native at: java.net.SocketInputStream.socketRead0(Native Method) at: java.net.SocketInputStream.read(SocketInputStream.java:129) at: java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at: java.io.BufferedInputStream.read(BufferedInputStream.java:237) at: org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78) at: org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106) at: org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116) at: org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973) at: org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735) at: org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098) at: org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at: org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at: com.sun.cds.example.common.utils.CommonHttpClientUtil.getConnectToURL(CommonHttpClientUtil.ja va:33) at: com.sun.cds.example.first.application.ApplicationAServlet.processRequest(ApplicationAServlet.java:47) at: com.sun.cds.example.first.application.ApplicationAServlet.doPost(ApplicationAServlet.java:82) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:738) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:831) at: org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:411) at: org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:290) at: org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:271) at: org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:202) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: com.sun.enterprise.web.WebPipeline.invoke(WebPipeline.java:94) at: org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:206) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:150) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:272) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.invokeAdapter(DefaultProcessorTask.ja va:637) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.doProcess(DefaultProcessorTask.java:5 68) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.process(DefaultProcessorTask.java:813 ) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.executeProcessorTask(DefaultReadTask.jav a:341) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:263) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:214) at: com.sun.enterprise.web.portunif.PortUnificationPipeline$PUTask.doTask(PortUnificationPipeline.java:38 0) at: com.sun.enterprise.web.connector.grizzly.TaskBase.run(TaskBase.java:265) at: com.sun.enterprise.web.connector.grizzly.ssl.SSLWorkerThread.run(SSLWorkerThread.java:106)
Thread "SelectorThread-8181" thread-id 66 thread-stateRUNNABLERunning in native at: sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at: sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) at: sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) at: sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) at: sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.doSelect(SelectorThread.java:1337) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.startListener(SelectorThread.java:1284) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.startEndpoint(SelectorThread.java:1247) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.run(SelectorThread.java:1223)
Thread "httpSSLWorkerThread-8080-0" thread-id 64 thread-stateRUNNABLERunning in native at: java.net.SocketInputStream.socketRead0(Native Method) at: java.net.SocketInputStream.read(SocketInputStream.java:129) at: java.io.BufferedInputStream.fill(BufferedInputStream.java:218) at: java.io.BufferedInputStream.read(BufferedInputStream.java:237) at: org.apache.commons.httpclient.HttpParser.readRawLine(HttpParser.java:78) at: org.apache.commons.httpclient.HttpParser.readLine(HttpParser.java:106) at: org.apache.commons.httpclient.HttpConnection.readLine(HttpConnection.java:1116) at: org.apache.commons.httpclient.HttpMethodBase.readStatusLine(HttpMethodBase.java:1973) at: org.apache.commons.httpclient.HttpMethodBase.readResponse(HttpMethodBase.java:1735) at: org.apache.commons.httpclient.HttpMethodBase.execute(HttpMethodBase.java:1098) at: org.apache.commons.httpclient.HttpMethodDirector.executeWithRetry(HttpMethodDirector.java:398) at: org.apache.commons.httpclient.HttpMethodDirector.executeMethod(HttpMethodDirector.java:171) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:397) at: org.apache.commons.httpclient.HttpClient.executeMethod(HttpClient.java:323) at: com.sun.cds.example.common.utils.CommonHttpClientUtil.getConnectToURL(CommonHttpClientUtil.ja va:33) at: com.sun.cds.example.first.application.ApplicationAServlet.processRequest(ApplicationAServlet.java:47) at: com.sun.cds.example.first.application.ApplicationAServlet.doPost(ApplicationAServlet.java:82) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:738) at: javax.servlet.http.HttpServlet.service(HttpServlet.java:831) at: org.apache.catalina.core.ApplicationFilterChain.servletService(ApplicationFilterChain.java:411) at: org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:290) at: org.apache.catalina.core.StandardContextValve.invokeInternal(StandardContextValve.java:271) at: org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:202) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: com.sun.enterprise.web.WebPipeline.invoke(WebPipeline.java:94) at: org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:206) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:150) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:632) at: org.apache.catalina.core.StandardPipeline.doInvoke(StandardPipeline.java:577) at: org.apache.catalina.core.StandardPipeline.invoke(StandardPipeline.java:571) at: org.apache.catalina.core.ContainerBase.invoke(ContainerBase.java:1080) at: org.apache.coyote.tomcat5.CoyoteAdapter.service(CoyoteAdapter.java:272) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.invokeAdapter(DefaultProcessorTask.ja va:637) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.doProcess(DefaultProcessorTask.java:5 68) at: com.sun.enterprise.web.connector.grizzly.DefaultProcessorTask.process(DefaultProcessorTask.java:813 ) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.executeProcessorTask(DefaultReadTask.jav a:341) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:263) at: com.sun.enterprise.web.connector.grizzly.DefaultReadTask.doTask(DefaultReadTask.java:214) at: com.sun.enterprise.web.portunif.PortUnificationPipeline$PUTask.doTask(PortUnificationPipeline.java:38 0) at: com.sun.enterprise.web.connector.grizzly.TaskBase.run(TaskBase.java:265) at: com.sun.enterprise.web.connector.grizzly.ssl.SSLWorkerThread.run(SSLWorkerThread.java:106)
Thread "SelectorThread-8080" thread-id 63 thread-stateRUNNABLERunning in native at: sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at: sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) at: sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) at: sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) at: sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.doSelect(SelectorThread.java:1337) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.startListener(SelectorThread.java:1284) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.startEndpoint(SelectorThread.java:1247) at: com.sun.enterprise.web.connector.grizzly.SelectorThread.run(SelectorThread.java:1223)
Thread "ClusterServiceListener" thread-id 59 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: java.net.ServerSocket.accept(ServerSocket.java:421) at: com.sun.messaging.jmq.jmsserver.multibroker.fullyconnected.ClusterServiceListener.run(ClusterImpl.ja va:1786)
Thread "MessageBusCallbackDispatcher" thread-id 58 thread-stateWAITINGWaiting on lock: java.util.LinkedList@88f431d at: java.lang.Object.wait(Native Method) at: java.lang.Object.wait(Object.java:485) at: com.sun.messaging.jmq.jmsserver.multibroker.CallbackDispatcher.run(CallbackDispatcher.java:330)
Thread "jms_ACCEPT" thread-id 57 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: java.net.ServerSocket.accept(ServerSocket.java:421) at: com.sun.messaging.jmq.jmsserver.net.tcp.TcpProtocol.accept(TcpProtocol.java:281) at: com.sun.messaging.jmq.jmsserver.service.imq.IMQIPService.run(IMQIPService.java:574) at: java.lang.Thread.run(Thread.java:637)
Thread "admin_ACCEPT" thread-id 56 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: java.net.ServerSocket.accept(ServerSocket.java:421) at: com.sun.messaging.jmq.jmsserver.net.tcp.TcpProtocol.accept(TcpProtocol.java:281) at: com.sun.messaging.jmq.jmsserver.service.imq.IMQIPService.run(IMQIPService.java:574) at: java.lang.Thread.run(Thread.java:637)
Thread "RMI RenewClean-[129.158.192.136:52453]" thread-id 54 thread-stateTIMED_WAITINGWaiting on lock: java.lang.ref.ReferenceQueue$Lock@757f294e at: java.lang.Object.wait(Native Method) at: java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) at: sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516) at: java.lang.Thread.run(Thread.java:637)
Thread "RMI TCP Accept-0" thread-id 53 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: java.net.ServerSocket.accept(ServerSocket.java:421) at: sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369) at: sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341) at: java.lang.Thread.run(Thread.java:637)
Thread "ClusterDiscoveryService" thread-id 52 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: java.net.ServerSocket.accept(ServerSocket.java:421) at: com.sun.messaging.jmq.jmsserver.service.ClusterDiscoveryService.run(ClusterDiscoveryService.java:318 ) at: java.lang.Thread.run(Thread.java:637)
Thread "Broker Monitor" thread-id 51 thread-stateWAITINGWaiting on lock: java.util.Collections$SynchronizedSet@6f70fc25 at: java.lang.Object.wait(Native Method) at: java.lang.Object.wait(Object.java:485) at: com.sun.messaging.jmq.jmsserver.core.cluster.BrokerConsumers.run(MultibrokerRouter.java:1342) at: java.lang.Thread.run(Thread.java:637)
Thread "JMQPortMapper" thread-id 50 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: java.net.ServerSocket.accept(ServerSocket.java:421) at: com.sun.messaging.jmq.jmsserver.service.PortMapper.run(PortMapper.java:485) at: java.lang.Thread.run(Thread.java:637)
Thread "MQTimer-Thread" thread-id 49 thread-stateTIMED_WAITINGWaiting on lock: java.util.TaskQueue@62ba1a4b at: java.lang.Object.wait(Native Method) at: java.util.TimerThread.mainLoop(Timer.java:509) at: java.util.TimerThread.run(Timer.java:462)
Thread "RMI RenewClean-[129.158.192.136:52447]" thread-id 42 thread-stateTIMED_WAITINGWaiting on lock: java.lang.ref.ReferenceQueue$Lock@28146490 at: java.lang.Object.wait(Native Method) at: java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) at: sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516) at: java.lang.Thread.run(Thread.java:637)
Thread "RMI TCP Accept-0" thread-id 39 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: java.net.ServerSocket.accept(ServerSocket.java:421) at: sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369) at: sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341) at: java.lang.Thread.run(Thread.java:637)
Thread "RMI TCP Accept-8686" thread-id 38 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: java.net.ServerSocket.accept(ServerSocket.java:421) at: sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369) at: sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341) at: java.lang.Thread.run(Thread.java:637)
Thread "Thread-12" thread-id 35 thread-stateWAITINGWaiting on lock: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@52d63e7e at: sun.misc.Unsafe.park(Native Method) at: java.util.concurrent.locks.LockSupport.park(LockSupport.java:158) at: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchron izer.java:1925) at: java.util.concurrent.ArrayBlockingQueue.take(ArrayBlockingQueue.java:317) at: com.sun.enterprise.management.support.LoaderRegThread.process(LoaderRegThread.java:243) at: com.sun.enterprise.management.support.LoaderRegThread.run(LoaderRegThread.java:154)
Thread "Thread-11" thread-id 34 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: com.sun.enterprise.management.support.LoaderBase.mySleep(LoaderBase.java:241) at: com.sun.enterprise.management.support.Loader$DeferredRegistrationThread.run(Loader.java:389)
Thread "Thread-9" thread-id 32 thread-stateWAITINGWaiting on lock: com.sun.corba.ee.impl.javax.rmi.CORBA.KeepAlive@6fa0ecae at: java.lang.Object.wait(Native Method) at: java.lang.Object.wait(Object.java:485) at: com.sun.corba.ee.impl.javax.rmi.CORBA.KeepAlive.run(Util.java:857)
Thread "p: thread-pool-1; w: 2" thread-id 31 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: com.sun.net.ssl.internal.ssl.SSLServerSocketImpl.accept(SSLServerSocketImpl.java:259) at: com.sun.corba.ee.impl.transport.SocketOrChannelAcceptorImpl.accept(SocketOrChannelAcceptorImpl.j ava:250) at: com.sun.corba.ee.impl.transport.ListenerThreadImpl.doWork(ListenerThreadImpl.java:107) at: com.sun.corba.ee.impl.orbutil.threadpool.ThreadPoolImpl$WorkerThread.run(ThreadPoolImpl.java:555)
Thread "p: thread-pool-1; w: 1" thread-id 30 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: com.sun.net.ssl.internal.ssl.SSLServerSocketImpl.accept(SSLServerSocketImpl.java:259) at: com.sun.corba.ee.impl.transport.SocketOrChannelAcceptorImpl.accept(SocketOrChannelAcceptorImpl.j ava:250) at: com.sun.corba.ee.impl.transport.ListenerThreadImpl.doWork(ListenerThreadImpl.java:107) at: com.sun.corba.ee.impl.orbutil.threadpool.ThreadPoolImpl$WorkerThread.run(ThreadPoolImpl.java:555)
Thread "SelectorThread" thread-id 29 thread-stateRUNNABLERunning in native at: sun.nio.ch.KQueueArrayWrapper.kevent0(Native Method) at: sun.nio.ch.KQueueArrayWrapper.poll(KQueueArrayWrapper.java:136) at: sun.nio.ch.KQueueSelectorImpl.doSelect(KQueueSelectorImpl.java:69) at: sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69) at: sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80) at: com.sun.corba.ee.impl.transport.SelectorImpl.run(SelectorImpl.java:283)
Thread "Timer-3" thread-id 28 thread-stateWAITINGWaiting on lock: java.util.TaskQueue@2e12ccc3 at: java.lang.Object.wait(Native Method) at: java.lang.Object.wait(Object.java:485) at: java.util.TimerThread.mainLoop(Timer.java:483) at: java.util.TimerThread.run(Timer.java:462)
Thread "Timer-2" thread-id 27 thread-stateTIMED_WAITINGWaiting on lock: java.util.TaskQueue@54412dd6 at: java.lang.Object.wait(Native Method) at: java.util.TimerThread.mainLoop(Timer.java:509) at: java.util.TimerThread.run(Timer.java:462)
Thread "Timer-1" thread-id 26 thread-stateTIMED_WAITINGWaiting on lock: java.util.TaskQueue@32867d1 at: java.lang.Object.wait(Native Method) at: java.util.TimerThread.mainLoop(Timer.java:509) at: java.util.TimerThread.run(Timer.java:462)
Thread "Thread-4" thread-id 25 thread-stateTIMED_WAITING at: java.lang.Thread.sleep(Native Method) at: com.sun.enterprise.admin.server.core.channel.RMIClient.run(RMIClient.java:151) at: java.lang.Thread.run(Thread.java:637)
Thread "RMI RenewClean- [129.158.192.136:52441,com.sun.enterprise.admin.server.core.channel.LocalRMIClientSocketFactory@ 79f361e5]" thread-id 23 thread-stateTIMED_WAITINGWaiting on lock: java.lang.ref.ReferenceQueue$Lock@51b7cbf5 at: java.lang.Object.wait(Native Method) at: java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) at: sun.rmi.transport.DGCClient$EndpointEntry$RenewCleanThread.run(DGCClient.java:516) at: java.lang.Thread.run(Thread.java:637)
Thread "Timer-0" thread-id 22 thread-stateWAITINGWaiting on lock: java.util.TaskQueue@79af6bbc at: java.lang.Object.wait(Native Method) at: java.lang.Object.wait(Object.java:485) at: java.util.TimerThread.mainLoop(Timer.java:483) at: java.util.TimerThread.run(Timer.java:462)
Thread "RMI Scheduler(0)" thread-id 21 thread-stateTIMED_WAITINGWaiting on lock: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject@6bca420d at: sun.misc.Unsafe.park(Native Method) at: java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:198) at: java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSy nchronizer.java:1963) at: java.util.concurrent.DelayQueue.take(DelayQueue.java:164) at: java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecu tor.java:582) at: java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecu tor.java:575) at: java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:946) at: java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:906) at: java.lang.Thread.run(Thread.java:637)
Thread "GC Daemon" thread-id 19 thread-stateTIMED_WAITINGWaiting on lock: sun.misc.GC$LatencyLock@2bb69ac4 at: java.lang.Object.wait(Native Method) at: sun.misc.GC$Daemon.run(GC.java:100)
Thread "RMI Reaper" thread-id 18 thread-stateWAITINGWaiting on lock: java.lang.ref.ReferenceQueue$Lock@616ad047 at: java.lang.Object.wait(Native Method) at: java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) at: java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132) at: sun.rmi.transport.ObjectTable$Reaper.run(ObjectTable.java:333) at: java.lang.Thread.run(Thread.java:637)
Thread "RMI TCP Accept-0" thread-id 17 thread-stateRUNNABLERunning in native at: java.net.PlainSocketImpl.socketAccept(Native Method) at: java.net.PlainSocketImpl.accept(PlainSocketImpl.java:384) at: java.net.ServerSocket.implAccept(ServerSocket.java:453) at: java.net.ServerSocket.accept(ServerSocket.java:421) at: sun.rmi.transport.tcp.TCPTransport$AcceptLoop.executeAcceptLoop(TCPTransport.java:369) at: sun.rmi.transport.tcp.TCPTransport$AcceptLoop.run(TCPTransport.java:341) at: java.lang.Thread.run(Thread.java:637)
Thread "Signal Dispatcher" thread-id 4 thread-stateRUNNABLE
Thread "Finalizer" thread-id 3 thread-stateWAITINGWaiting on lock: java.lang.ref.ReferenceQueue$Lock@2b901748 at: java.lang.Object.wait(Native Method) at: java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:116) at: java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:132) at: java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)
Thread "Reference Handler" thread-id 2 thread-stateWAITINGWaiting on lock: java.lang.ref.Reference$Lock@e88e50 at: java.lang.Object.wait(Native Method) at: java.lang.Object.wait(Object.java:485) at: java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
No deadlock found
Command generate-jvm-report executed successfully.
Environment
Operating System: All Platform: Sun
Affected Versions
[v2.1.1]