The details are a bit vague, but my node has stopped responding. It seems to still be accepting data, but all threads seem to be deadlocked; nothing is coming back out.
"XNIO-1 task-19" #1943 prio=5 os_prio=0 tid=0x00007f936402ebd0 nid=0x967 waiting on condition [0x00007f93407ad000]
java.lang.Thread.State: WAITING (parking)
at sun.misc.Unsafe.park(Native Method)
- parking to wait for <0x00000006c4d592e0> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
at java.util.concurrent.locks.LockSupport.park(LockSupport.java:175)
at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039)
at java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442)
at java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
at java.lang.Thread.run(Thread.java:748)
The details are a bit vague, but my node has stopped responding. It seems to still be accepting data, but all threads seem to be deadlocked; nothing is coming back out.
I don't have jstack, and did not launch with debug enabled. Here is the output of
kill -3 7655
threads.txt
They seem to all be in the same state: