search

quarkusio / quarkus

Quarkus: Supersonic Subatomic Java.
https://quarkus.io
Apache License 2.0
13.78k stars 2.68k forks source link

Quarkus Dev Mode Hangs on stop #33896

Closed phillip-kruger closed 2 months ago

phillip-kruger commented 1 year ago

Describe the bug

I have this issue with the latest released (3.1.1) and main (999-SNAPSHOT) versions of Quarkus that I start an app in dev mode, then stop it (using ctl-c) but that does not stop quarkus and I have to do a kill -9 to stop the process. After killing the process, the app can not start up properly anymore and I have to restart my laptop to get it to start.

Now, this is probably just on my laptop and something weird with my environment, but I thought I'll log the bug and see if anyone can help me. It seems connected to the docker instance started by Testing (Keycloak in this case), but I'll investigate further. To recreate, create an app from code.quarkus.io with oidc, resteasy reactive and smallrye open api, start the app and then stop it.

I am using podman version 4.5.1

Expected behavior

The app stop and can be started again

Actual behavior

The app hangs on stop and needs to be killed

How to Reproduce?

code-with-quarkus(12).zip

Use above app, start it, go to dev ui, stop it, see if it hand for you.

Output of uname -a or ver

Linux pkruger-laptop 6.3.5-200.fc38.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 30 15:44:17 UTC 2023 x86_64 GNU/Linux

Output of java -version

openjdk version "17.0.7" 2023-04-18 OpenJDK Runtime Environment (Red_Hat-17.0.7.0.7-4.fc38) (build 17.0.7+7) OpenJDK 64-Bit Server VM (Red_Hat-17.0.7.0.7-4.fc38) (build 17.0.7+7, mixed mode, sharing)

GraalVM version (if different from Java)

No response

Quarkus version or git rev

3.1.1 or 999-SNAPSHOT

Build tool (ie. output of mvnw --version or gradlew --version)

Apache Maven 3.9.1 (2e178502fcdbffc201671fb2537d0cb4b4cc58f8)

Additional information

No response

gsmet commented 1 year ago

When the process hangs, use kill -3 <pid> to get the stacktrace. That would help narrow down the issue.

phillip-kruger commented 1 year ago

Thanks @gsmet . This is the output:

2023-06-09 11:54:47
Full thread dump OpenJDK 64-Bit Server VM (17.0.7+7 mixed mode, emulated-client, sharing):

Threads class SMR info:
_java_thread_list=0x00007fd2cc005a50, length=32, elements={
0x00007fd4141dc820, 0x00007fd4141ddc00, 0x00007fd4141e32c0, 0x00007fd4141e46e0,
0x00007fd4141e5af0, 0x00007fd4141e7060, 0x00007fd4141f04b0, 0x00007fd4141fbc00,
0x00007fd4146bc8c0, 0x00007fd4146c0060, 0x00007fd4146c1050, 0x00007fd2a8057600,
0x00007fd294085190, 0x00007fd2a81d9830, 0x00007fd2a8299680, 0x00007fd37809e5c0,
0x00007fd37c03e290, 0x00007fd37c3eccf0, 0x00007fd2a4002640, 0x00007fd2a401b1a0,
0x00007fd290002e40, 0x00007fd2c00085a0, 0x00007fd2d8007b60, 0x00007fd2b00029c0,
0x00007fd29c00f780, 0x00007fd298020d50, 0x00007fd314006fc0, 0x00007fd300008770,
0x00007fd414028b50, 0x00007fd264002d10, 0x00007fd274004210, 0x00007fd274009c10
}

"Reference Handler" #2 daemon prio=10 os_prio=0 cpu=4.89ms elapsed=235.19s tid=0x00007fd4141dc820 nid=0x12623 waiting on condition  [0x00007fd3d7646000]
   java.lang.Thread.State: RUNNABLE
        at java.lang.ref.Reference.waitForReferencePendingList(java.base@17.0.7/Native Method)
        at java.lang.ref.Reference.processPendingReferences(java.base@17.0.7/Reference.java:253)
        at java.lang.ref.Reference$ReferenceHandler.run(java.base@17.0.7/Reference.java:215)

"Finalizer" #3 daemon prio=8 os_prio=0 cpu=1.09ms elapsed=235.19s tid=0x00007fd4141ddc00 nid=0x12624 in Object.wait()  [0x00007fd3d7546000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(java.base@17.0.7/Native Method)
        - waiting on <0x0000000417b36390> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(java.base@17.0.7/ReferenceQueue.java:155)
        - locked <0x0000000417b36390> (a java.lang.ref.ReferenceQueue$Lock)
        at java.lang.ref.ReferenceQueue.remove(java.base@17.0.7/ReferenceQueue.java:176)
        at java.lang.ref.Finalizer$FinalizerThread.run(java.base@17.0.7/Finalizer.java:172)

"Signal Dispatcher" #4 daemon prio=9 os_prio=0 cpu=0.19ms elapsed=235.19s tid=0x00007fd4141e32c0 nid=0x12625 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Service Thread" #5 daemon prio=9 os_prio=0 cpu=3.71ms elapsed=235.19s tid=0x00007fd4141e46e0 nid=0x12626 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Monitor Deflation Thread" #6 daemon prio=9 os_prio=0 cpu=5.91ms elapsed=235.19s tid=0x00007fd4141e5af0 nid=0x12627 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"C1 CompilerThread0" #7 daemon prio=9 os_prio=0 cpu=590.00ms elapsed=235.19s tid=0x00007fd4141e7060 nid=0x12628 waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE
   No compile task

"Sweeper thread" #11 daemon prio=9 os_prio=0 cpu=27.92ms elapsed=235.19s tid=0x00007fd4141f04b0 nid=0x12629 runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Common-Cleaner" #12 daemon prio=8 os_prio=0 cpu=5.29ms elapsed=235.18s tid=0x00007fd4141fbc00 nid=0x1262a in Object.wait()  [0x00007fd3d6f46000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(java.base@17.0.7/Native Method)
        - waiting on <no object reference available>
        at java.lang.ref.ReferenceQueue.remove(java.base@17.0.7/ReferenceQueue.java:155)
        - locked <0x0000000417b883c0> (a java.lang.ref.ReferenceQueue$Lock)
        at jdk.internal.ref.CleanerImpl.run(java.base@17.0.7/CleanerImpl.java:140)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)
        at jdk.internal.misc.InnocuousThread.run(java.base@17.0.7/InnocuousThread.java:162)

"JDWP Transport Listener: dt_socket" #13 daemon prio=10 os_prio=0 cpu=0.10ms elapsed=235.13s tid=0x00007fd4146bc8c0 nid=0x1262c runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"JDWP Event Helper Thread" #14 daemon prio=10 os_prio=0 cpu=0.07ms elapsed=235.13s tid=0x00007fd4146c0060 nid=0x1262d runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Notification Thread" #15 daemon prio=9 os_prio=0 cpu=0.06ms elapsed=235.13s tid=0x00007fd4146c1050 nid=0x1262e runnable  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"vertx-blocked-thread-checker" #86 daemon prio=5 os_prio=0 cpu=23.55ms elapsed=233.91s tid=0x00007fd2a8057600 nid=0x1268b in Object.wait()  [0x00007fd3ac4fe000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(java.base@17.0.7/Native Method)
        - waiting on <no object reference available>
        at java.util.TimerThread.mainLoop(java.base@17.0.7/Timer.java:563)
        - locked <0x0000000419af96f8> (a java.util.TaskQueue)
        at java.util.TimerThread.run(java.base@17.0.7/Timer.java:516)

"JGit-WorkQueue" #88 daemon prio=5 os_prio=0 cpu=0.17ms elapsed=233.90s tid=0x00007fd294085190 nid=0x1268d waiting on condition  [0x00007fd257efe000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x0000000419ad5520> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.parkNanos(java.base@17.0.7/LockSupport.java:252)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(java.base@17.0.7/AbstractQueuedSynchronizer.java:1672)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@17.0.7/ScheduledThreadPoolExecutor.java:1182)
        at java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(java.base@17.0.7/ScheduledThreadPoolExecutor.java:899)
        at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@17.0.7/ThreadPoolExecutor.java:1062)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@17.0.7/ThreadPoolExecutor.java:1122)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@17.0.7/ThreadPoolExecutor.java:635)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"vert.x-eventloop-thread-0" #93 prio=5 os_prio=0 cpu=1.97ms elapsed=225.01s tid=0x00007fd2a81d9830 nid=0x128fc runnable  [0x00007fd257dfe000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPoll.wait(java.base@17.0.7/Native Method)
        at sun.nio.ch.EPollSelectorImpl.doSelect(java.base@17.0.7/EPollSelectorImpl.java:118)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@17.0.7/SelectorImpl.java:129)
        - locked <0x0000000419b8b1d8> (a io.netty.channel.nio.SelectedSelectionKeySet)
        - locked <0x0000000419b8b188> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(java.base@17.0.7/SelectorImpl.java:146)
        at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
        at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879)
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526)
        at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
        at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"vert.x-internal-blocking-0" #94 prio=5 os_prio=0 cpu=0.84ms elapsed=224.94s tid=0x00007fd2a8299680 nid=0x128fd waiting on condition  [0x00007fd257cfe000]
   java.lang.Thread.State: WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x0000000419af9a60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(java.base@17.0.7/LockSupport.java:341)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(java.base@17.0.7/AbstractQueuedSynchronizer.java:506)
        at java.util.concurrent.ForkJoinPool.unmanagedBlock(java.base@17.0.7/ForkJoinPool.java:3463)
        at java.util.concurrent.ForkJoinPool.managedBlock(java.base@17.0.7/ForkJoinPool.java:3434)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@17.0.7/AbstractQueuedSynchronizer.java:1623)
        at java.util.concurrent.LinkedBlockingQueue.take(java.base@17.0.7/LinkedBlockingQueue.java:435)
        at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@17.0.7/ThreadPoolExecutor.java:1062)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@17.0.7/ThreadPoolExecutor.java:1122)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@17.0.7/ThreadPoolExecutor.java:635)
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"vert.x-eventloop-thread-1" #95 prio=5 os_prio=0 cpu=115.31ms elapsed=224.94s tid=0x00007fd37809e5c0 nid=0x128fe runnable  [0x00007fd3d6e46000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPoll.wait(java.base@17.0.7/Native Method)
        at sun.nio.ch.EPollSelectorImpl.doSelect(java.base@17.0.7/EPollSelectorImpl.java:118)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@17.0.7/SelectorImpl.java:129)
        - locked <0x0000000419b66c98> (a io.netty.channel.nio.SelectedSelectionKeySet)
        - locked <0x0000000419b66c48> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(java.base@17.0.7/SelectorImpl.java:146)
        at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
        at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879)
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526)
        at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
        at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"vert.x-internal-blocking-1" #96 prio=5 os_prio=0 cpu=0.42ms elapsed=224.94s tid=0x00007fd37c03e290 nid=0x128ff waiting on condition  [0x00007fd3d6779000]
   java.lang.Thread.State: WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x0000000419af9a60> (a java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
        at java.util.concurrent.locks.LockSupport.park(java.base@17.0.7/LockSupport.java:341)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionNode.block(java.base@17.0.7/AbstractQueuedSynchronizer.java:506)
        at java.util.concurrent.ForkJoinPool.unmanagedBlock(java.base@17.0.7/ForkJoinPool.java:3463)
        at java.util.concurrent.ForkJoinPool.managedBlock(java.base@17.0.7/ForkJoinPool.java:3434)
        at java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(java.base@17.0.7/AbstractQueuedSynchronizer.java:1623)
        at java.util.concurrent.LinkedBlockingQueue.take(java.base@17.0.7/LinkedBlockingQueue.java:435)
        at java.util.concurrent.ThreadPoolExecutor.getTask(java.base@17.0.7/ThreadPoolExecutor.java:1062)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(java.base@17.0.7/ThreadPoolExecutor.java:1122)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(java.base@17.0.7/ThreadPoolExecutor.java:635)
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"vert.x-acceptor-thread-0" #97 prio=5 os_prio=0 cpu=0.20ms elapsed=223.92s tid=0x00007fd37c3eccf0 nid=0x12903 runnable  [0x00007fd2576fd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPoll.wait(java.base@17.0.7/Native Method)
        at sun.nio.ch.EPollSelectorImpl.doSelect(java.base@17.0.7/EPollSelectorImpl.java:118)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@17.0.7/SelectorImpl.java:129)
        - locked <0x0000000419b42698> (a io.netty.channel.nio.SelectedSelectionKeySet)
        - locked <0x0000000419b42648> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(java.base@17.0.7/SelectorImpl.java:146)
        at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
        at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879)
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526)
        at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
        at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"vertx-blocked-thread-checker" #133 daemon prio=5 os_prio=0 cpu=21.74ms elapsed=223.57s tid=0x00007fd2a4002640 nid=0x12928 in Object.wait()  [0x00007fd2551fd000]
   java.lang.Thread.State: TIMED_WAITING (on object monitor)
        at java.lang.Object.wait(java.base@17.0.7/Native Method)
        - waiting on <no object reference available>
        at java.util.TimerThread.mainLoop(java.base@17.0.7/Timer.java:563)
        - locked <0x000000041cb5f0c8> (a java.util.TaskQueue)
        at java.util.TimerThread.run(java.base@17.0.7/Timer.java:516)

"[DevConsole]vert.x-eventloop-thread-0" #134 prio=5 os_prio=0 cpu=1.30ms elapsed=223.57s tid=0x00007fd2a401b1a0 nid=0x12929 runnable  [0x00007fd2550fd000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.EPoll.wait(java.base@17.0.7/Native Method)
        at sun.nio.ch.EPollSelectorImpl.doSelect(java.base@17.0.7/EPollSelectorImpl.java:118)
        at sun.nio.ch.SelectorImpl.lockAndDoSelect(java.base@17.0.7/SelectorImpl.java:129)
        - locked <0x000000041cbc12f8> (a io.netty.channel.nio.SelectedSelectionKeySet)
        - locked <0x000000041cbc12a8> (a sun.nio.ch.EPollSelectorImpl)
        at sun.nio.ch.SelectorImpl.select(java.base@17.0.7/SelectorImpl.java:146)
        at io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:68)
        at io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:879)
        at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526)
        at io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997)
        at io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74)
        at io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"ForkJoinPool.commonPool-worker-4" #137 daemon prio=5 os_prio=0 cpu=0.37ms elapsed=223.38s tid=0x00007fd290002e40 nid=0x1292f waiting on condition  [0x00007fd3ae1fe000]
   java.lang.Thread.State: TIMED_WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x000000041842e578> (a java.util.concurrent.ForkJoinPool)
        at java.util.concurrent.locks.LockSupport.parkUntil(java.base@17.0.7/LockSupport.java:410)
        at java.util.concurrent.ForkJoinPool.awaitWork(java.base@17.0.7/ForkJoinPool.java:1726)
        at java.util.concurrent.ForkJoinPool.runWorker(java.base@17.0.7/ForkJoinPool.java:1623)
        at java.util.concurrent.ForkJoinWorkerThread.run(java.base@17.0.7/ForkJoinWorkerThread.java:165)

"ForkJoinPool.commonPool-worker-5" #138 daemon prio=5 os_prio=0 cpu=0.26ms elapsed=223.38s tid=0x00007fd2c00085a0 nid=0x12930 waiting on condition  [0x00007fd3ac9fe000]
   java.lang.Thread.State: WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x000000041842e578> (a java.util.concurrent.ForkJoinPool)
        at java.util.concurrent.locks.LockSupport.park(java.base@17.0.7/LockSupport.java:341)
        at java.util.concurrent.ForkJoinPool.awaitWork(java.base@17.0.7/ForkJoinPool.java:1724)
        at java.util.concurrent.ForkJoinPool.runWorker(java.base@17.0.7/ForkJoinPool.java:1623)
        at java.util.concurrent.ForkJoinWorkerThread.run(java.base@17.0.7/ForkJoinWorkerThread.java:165)

"ForkJoinPool.commonPool-worker-6" #139 daemon prio=5 os_prio=0 cpu=0.20ms elapsed=223.38s tid=0x00007fd2d8007b60 nid=0x12931 waiting on condition  [0x00007fd3ae7fe000]
   java.lang.Thread.State: WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x000000041842e578> (a java.util.concurrent.ForkJoinPool)
        at java.util.concurrent.locks.LockSupport.park(java.base@17.0.7/LockSupport.java:341)
        at java.util.concurrent.ForkJoinPool.awaitWork(java.base@17.0.7/ForkJoinPool.java:1724)
        at java.util.concurrent.ForkJoinPool.runWorker(java.base@17.0.7/ForkJoinPool.java:1623)
        at java.util.concurrent.ForkJoinWorkerThread.run(java.base@17.0.7/ForkJoinWorkerThread.java:165)

"ForkJoinPool.commonPool-worker-7" #140 daemon prio=5 os_prio=0 cpu=0.20ms elapsed=223.38s tid=0x00007fd2b00029c0 nid=0x12932 waiting on condition  [0x00007fd256dfd000]
   java.lang.Thread.State: WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x000000041842e578> (a java.util.concurrent.ForkJoinPool)
        at java.util.concurrent.locks.LockSupport.park(java.base@17.0.7/LockSupport.java:341)
        at java.util.concurrent.ForkJoinPool.awaitWork(java.base@17.0.7/ForkJoinPool.java:1724)
        at java.util.concurrent.ForkJoinPool.runWorker(java.base@17.0.7/ForkJoinPool.java:1623)
        at java.util.concurrent.ForkJoinWorkerThread.run(java.base@17.0.7/ForkJoinWorkerThread.java:165)

"ForkJoinPool.commonPool-worker-8" #141 daemon prio=5 os_prio=0 cpu=0.22ms elapsed=223.38s tid=0x00007fd29c00f780 nid=0x12933 waiting on condition  [0x00007fd2574fd000]
   java.lang.Thread.State: WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x000000041842e578> (a java.util.concurrent.ForkJoinPool)
        at java.util.concurrent.locks.LockSupport.park(java.base@17.0.7/LockSupport.java:341)
        at java.util.concurrent.ForkJoinPool.awaitWork(java.base@17.0.7/ForkJoinPool.java:1724)
        at java.util.concurrent.ForkJoinPool.runWorker(java.base@17.0.7/ForkJoinPool.java:1623)
        at java.util.concurrent.ForkJoinWorkerThread.run(java.base@17.0.7/ForkJoinWorkerThread.java:165)

"ForkJoinPool.commonPool-worker-9" #142 daemon prio=5 os_prio=0 cpu=0.21ms elapsed=223.38s tid=0x00007fd298020d50 nid=0x12934 waiting on condition  [0x00007fd3ad7fe000]
   java.lang.Thread.State: WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x000000041842e578> (a java.util.concurrent.ForkJoinPool)
        at java.util.concurrent.locks.LockSupport.park(java.base@17.0.7/LockSupport.java:341)
        at java.util.concurrent.ForkJoinPool.awaitWork(java.base@17.0.7/ForkJoinPool.java:1724)
        at java.util.concurrent.ForkJoinPool.runWorker(java.base@17.0.7/ForkJoinPool.java:1623)
        at java.util.concurrent.ForkJoinWorkerThread.run(java.base@17.0.7/ForkJoinWorkerThread.java:165)

"ForkJoinPool.commonPool-worker-10" #143 daemon prio=5 os_prio=0 cpu=0.23ms elapsed=223.38s tid=0x00007fd314006fc0 nid=0x12935 waiting on condition  [0x00007fd3acbfe000]
   java.lang.Thread.State: WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x000000041842e578> (a java.util.concurrent.ForkJoinPool)
        at java.util.concurrent.locks.LockSupport.park(java.base@17.0.7/LockSupport.java:341)
        at java.util.concurrent.ForkJoinPool.awaitWork(java.base@17.0.7/ForkJoinPool.java:1724)
        at java.util.concurrent.ForkJoinPool.runWorker(java.base@17.0.7/ForkJoinPool.java:1623)
        at java.util.concurrent.ForkJoinWorkerThread.run(java.base@17.0.7/ForkJoinWorkerThread.java:165)

"ForkJoinPool.commonPool-worker-11" #144 daemon prio=5 os_prio=0 cpu=0.19ms elapsed=223.38s tid=0x00007fd300008770 nid=0x12936 waiting on condition  [0x00007fd3d4c3d000]
   java.lang.Thread.State: WAITING (parking)
        at jdk.internal.misc.Unsafe.park(java.base@17.0.7/Native Method)
        - parking to wait for  <0x000000041842e578> (a java.util.concurrent.ForkJoinPool)
        at java.util.concurrent.locks.LockSupport.park(java.base@17.0.7/LockSupport.java:341)
        at java.util.concurrent.ForkJoinPool.awaitWork(java.base@17.0.7/ForkJoinPool.java:1724)
        at java.util.concurrent.ForkJoinPool.runWorker(java.base@17.0.7/ForkJoinPool.java:1623)
        at java.util.concurrent.ForkJoinWorkerThread.run(java.base@17.0.7/ForkJoinWorkerThread.java:165)

"DestroyJavaVM" #160 prio=5 os_prio=0 cpu=1034.80ms elapsed=222.65s tid=0x00007fd414028b50 nid=0x1261b waiting on condition  [0x0000000000000000]
   java.lang.Thread.State: RUNNABLE

"Thread-103" #161 daemon prio=5 os_prio=0 cpu=1.90ms elapsed=200.25s tid=0x00007fd264002d10 nid=0x12a66 in Object.wait()  [0x00007fd257ffe000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(java.base@17.0.7/Native Method)
        - waiting on <0x00000004251211e0> (a java.lang.Thread)
        at java.lang.Thread.join(java.base@17.0.7/Thread.java:1304)
        - locked <0x00000004251211e0> (a java.lang.Thread)
        at java.lang.Thread.join(java.base@17.0.7/Thread.java:1372)
        at java.lang.ApplicationShutdownHooks.runHooks(java.base@17.0.7/ApplicationShutdownHooks.java:107)
        at java.lang.ApplicationShutdownHooks$1.run(java.base@17.0.7/ApplicationShutdownHooks.java:46)
        at java.lang.Shutdown.runHooks(java.base@17.0.7/Shutdown.java:130)
        at java.lang.Shutdown.exit(java.base@17.0.7/Shutdown.java:173)
        - locked <0x00000007ff7020b8> (a java.lang.Class for java.lang.Shutdown)
        at java.lang.Runtime.exit(java.base@17.0.7/Runtime.java:115)
        at java.lang.System.exit(java.base@17.0.7/System.java:1860)
        at io.quarkus.deployment.console.AeshConsole$3.run(AeshConsole.java:221)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"Quarkus Shutdown Thread" #159 prio=5 os_prio=0 cpu=11.98ms elapsed=200.25s tid=0x00007fd274004210 nid=0x12a67 runnable  [0x00007fd3d6677000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.SocketDispatcher.read0(java.base@17.0.7/Native Method)
        at sun.nio.ch.SocketDispatcher.read(java.base@17.0.7/SocketDispatcher.java:47)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(java.base@17.0.7/IOUtil.java:330)
        at sun.nio.ch.IOUtil.read(java.base@17.0.7/IOUtil.java:296)
        at sun.nio.ch.IOUtil.read(java.base@17.0.7/IOUtil.java:259)
        at sun.nio.ch.SocketChannelImpl.read(java.base@17.0.7/SocketChannelImpl.java:417)
        at sun.nio.ch.ChannelInputStream.read(java.base@17.0.7/ChannelInputStream.java:59)
        - locked <0x0000000424b95888> (a java.lang.Object)
        at sun.nio.ch.ChannelInputStream.read(java.base@17.0.7/ChannelInputStream.java:107)
        at sun.nio.ch.ChannelInputStream.read(java.base@17.0.7/ChannelInputStream.java:101)
        - locked <0x0000000424b95e68> (a sun.nio.ch.ChannelInputStream)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:149)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:241)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:53)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:187)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.HttpRequestExecutor.execute(HttpRequestExecutor.java:175)
        at com.github.dockerjava.zerodep.HijackingHttpRequestExecutor.execute(HijackingHttpRequestExecutor.java:50)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.HttpRequestExecutor.execute(HttpRequestExecutor.java:218)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager$InternalConnectionEndpoint.execute(PoolingHttpClientConnectionManager.java:596)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.InternalExecRuntime.execute(InternalExecRuntime.java:215)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.MainClientExec.execute(MainClientExec.java:107)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ConnectExec.execute(ConnectExec.java:181)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ProtocolExec.execute(ProtocolExec.java:172)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.HttpRequestRetryExec.execute(HttpRequestRetryExec.java:93)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ContentCompressionExec.execute(ContentCompressionExec.java:128)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.RedirectExec.execute(RedirectExec.java:116)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.InternalHttpClient.doExecute(InternalHttpClient.java:178)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.CloseableHttpClient.execute(CloseableHttpClient.java:67)
        at com.github.dockerjava.zerodep.ApacheDockerHttpClientImpl.execute(ApacheDockerHttpClientImpl.java:191)
        at com.github.dockerjava.zerodep.ZerodepDockerHttpClient.execute(ZerodepDockerHttpClient.java:8)
        at org.testcontainers.dockerclient.HeadersAddingDockerHttpClient.execute(HeadersAddingDockerHttpClient.java:23)
        at org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.execute(DefaultInvocationBuilder.java:228)
        at org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.get(DefaultInvocationBuilder.java:202)
        at org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.get(DefaultInvocationBuilder.java:74)
        at org.testcontainers.shaded.com.github.dockerjava.core.exec.InspectContainerCmdExec.execute(InspectContainerCmdExec.java:31)
        at org.testcontainers.shaded.com.github.dockerjava.core.exec.InspectContainerCmdExec.execute(InspectContainerCmdExec.java:13)
        at org.testcontainers.shaded.com.github.dockerjava.core.exec.AbstrSyncDockerCmdExec.exec(AbstrSyncDockerCmdExec.java:21)
        at org.testcontainers.shaded.com.github.dockerjava.core.command.AbstrDockerCmd.exec(AbstrDockerCmd.java:35)
        at org.testcontainers.shaded.com.github.dockerjava.core.command.InspectContainerCmdImpl.exec(InspectContainerCmdImpl.java:52)
        at org.testcontainers.utility.ResourceReaper.removeContainer(ResourceReaper.java:181)
        at org.testcontainers.utility.ResourceReaper.stopAndRemoveContainer(ResourceReaper.java:173)
        at org.testcontainers.containers.GenericContainer.stop(GenericContainer.java:648)
        at org.testcontainers.lifecycle.Startable.close(Startable.java:17)
        at io.quarkus.oidc.deployment.devservices.keycloak.KeycloakDevServicesProcessor$$Lambda$1395/0x000000080168d960.close(Unknown Source)
        at io.quarkus.deployment.builditem.DevServicesResultBuildItem$RunningDevService.close(DevServicesResultBuildItem.java:90)
        at io.quarkus.oidc.deployment.devservices.keycloak.KeycloakDevServicesProcessor$1.run(KeycloakDevServicesProcessor.java:217)
        at io.quarkus.deployment.builditem.CuratedApplicationShutdownBuildItem$1.run(CuratedApplicationShutdownBuildItem.java:48)
        at io.quarkus.bootstrap.classloading.QuarkusClassLoader.close(QuarkusClassLoader.java:617)
        at io.quarkus.bootstrap.app.CuratedApplication.close(CuratedApplication.java:407)
        at io.quarkus.deployment.dev.IsolatedDevModeMain.close(IsolatedDevModeMain.java:332)
        at io.quarkus.deployment.dev.IsolatedDevModeMain$6.run(IsolatedDevModeMain.java:442)
        - locked <0x0000000425262ca0> (a java.lang.Class for io.quarkus.deployment.dev.DevModeMain)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"Thread-63" #90 prio=5 os_prio=0 cpu=14.00ms elapsed=200.25s tid=0x00007fd274009c10 nid=0x12a6e runnable  [0x00007fd3d503b000]
   java.lang.Thread.State: RUNNABLE
        at sun.nio.ch.SocketDispatcher.read0(java.base@17.0.7/Native Method)
        at sun.nio.ch.SocketDispatcher.read(java.base@17.0.7/SocketDispatcher.java:47)
        at sun.nio.ch.IOUtil.readIntoNativeBuffer(java.base@17.0.7/IOUtil.java:330)
        at sun.nio.ch.IOUtil.read(java.base@17.0.7/IOUtil.java:296)
        at sun.nio.ch.IOUtil.read(java.base@17.0.7/IOUtil.java:259)
        at sun.nio.ch.SocketChannelImpl.read(java.base@17.0.7/SocketChannelImpl.java:417)
        at sun.nio.ch.ChannelInputStream.read(java.base@17.0.7/ChannelInputStream.java:59)
        - locked <0x0000000425390e50> (a java.lang.Object)
        at sun.nio.ch.ChannelInputStream.read(java.base@17.0.7/ChannelInputStream.java:107)
        at sun.nio.ch.ChannelInputStream.read(java.base@17.0.7/ChannelInputStream.java:101)
        - locked <0x0000000425391918> (a sun.nio.ch.ChannelInputStream)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.SessionInputBufferImpl.fillBuffer(SessionInputBufferImpl.java:149)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.SessionInputBufferImpl.readLine(SessionInputBufferImpl.java:280)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:241)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.AbstractMessageParser.parse(AbstractMessageParser.java:53)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.DefaultBHttpClientConnection.receiveResponseHeader(DefaultBHttpClientConnection.java:187)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.HttpRequestExecutor.execute(HttpRequestExecutor.java:175)
        at com.github.dockerjava.zerodep.HijackingHttpRequestExecutor.execute(HijackingHttpRequestExecutor.java:50)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.core5.http.impl.io.HttpRequestExecutor.execute(HttpRequestExecutor.java:218)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.io.PoolingHttpClientConnectionManager$InternalConnectionEndpoint.execute(PoolingHttpClientConnectionManager.java:596)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.InternalExecRuntime.execute(InternalExecRuntime.java:215)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.MainClientExec.execute(MainClientExec.java:107)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ConnectExec.execute(ConnectExec.java:181)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ProtocolExec.execute(ProtocolExec.java:172)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.HttpRequestRetryExec.execute(HttpRequestRetryExec.java:93)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ContentCompressionExec.execute(ContentCompressionExec.java:128)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement$1.proceed(ExecChainElement.java:57)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.RedirectExec.execute(RedirectExec.java:116)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.ExecChainElement.execute(ExecChainElement.java:51)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.InternalHttpClient.doExecute(InternalHttpClient.java:178)
        at com.github.dockerjava.zerodep.shaded.org.apache.hc.client5.http.impl.classic.CloseableHttpClient.execute(CloseableHttpClient.java:67)
        at com.github.dockerjava.zerodep.ApacheDockerHttpClientImpl.execute(ApacheDockerHttpClientImpl.java:191)
        at com.github.dockerjava.zerodep.ZerodepDockerHttpClient.execute(ZerodepDockerHttpClient.java:8)
        at org.testcontainers.dockerclient.HeadersAddingDockerHttpClient.execute(HeadersAddingDockerHttpClient.java:23)
        at org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.execute(DefaultInvocationBuilder.java:228)
        at org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.get(DefaultInvocationBuilder.java:202)
        at org.testcontainers.shaded.com.github.dockerjava.core.DefaultInvocationBuilder.get(DefaultInvocationBuilder.java:74)
        at org.testcontainers.shaded.com.github.dockerjava.core.exec.ListContainersCmdExec.execute(ListContainersCmdExec.java:44)
        at org.testcontainers.shaded.com.github.dockerjava.core.exec.ListContainersCmdExec.execute(ListContainersCmdExec.java:15)
        at org.testcontainers.shaded.com.github.dockerjava.core.exec.AbstrSyncDockerCmdExec.exec(AbstrSyncDockerCmdExec.java:21)
        at org.testcontainers.shaded.com.github.dockerjava.core.command.AbstrDockerCmd.exec(AbstrDockerCmd.java:35)
        at org.testcontainers.utility.JVMHookResourceReaper.prune(JVMHookResourceReaper.java:45)
        at org.testcontainers.utility.JVMHookResourceReaper.lambda$performCleanup$0(JVMHookResourceReaper.java:25)
        at org.testcontainers.utility.JVMHookResourceReaper$$Lambda$2071/0x000000080180e388.accept(Unknown Source)
        at java.util.ArrayList.forEach(java.base@17.0.7/ArrayList.java:1511)
        at org.testcontainers.utility.JVMHookResourceReaper.performCleanup(JVMHookResourceReaper.java:25)
        - locked <0x00000004196d2d68> (a java.util.ArrayList)
        - locked <0x000000041ac06a10> (a org.testcontainers.utility.JVMHookResourceReaper)
        at org.testcontainers.utility.ResourceReaper$$Lambda$1033/0x00000008015627d0.run(Unknown Source)
        at java.lang.Thread.run(java.base@17.0.7/Thread.java:833)

"VM Thread" os_prio=0 cpu=37.29ms elapsed=235.21s tid=0x00007fd4141d8760 nid=0x12622 runnable  

"GC Thread#0" os_prio=0 cpu=129.20ms elapsed=235.21s tid=0x00007fd414059260 nid=0x1261c runnable  

"GC Thread#1" os_prio=0 cpu=128.93ms elapsed=234.83s tid=0x00007fd3c4006630 nid=0x12632 runnable  

"GC Thread#2" os_prio=0 cpu=130.32ms elapsed=234.83s tid=0x00007fd3c4007060 nid=0x12633 runnable  

"GC Thread#3" os_prio=0 cpu=128.51ms elapsed=234.83s tid=0x00007fd3c4007a90 nid=0x12634 runnable  

"GC Thread#4" os_prio=0 cpu=129.53ms elapsed=234.83s tid=0x00007fd3c40084c0 nid=0x12635 runnable  

"GC Thread#5" os_prio=0 cpu=130.34ms elapsed=234.83s tid=0x00007fd3c4008ef0 nid=0x12636 runnable  

"GC Thread#6" os_prio=0 cpu=129.36ms elapsed=234.83s tid=0x00007fd3c4009920 nid=0x12637 runnable  

"GC Thread#7" os_prio=0 cpu=130.41ms elapsed=234.83s tid=0x00007fd3c400a740 nid=0x12638 runnable  

"GC Thread#8" os_prio=0 cpu=129.26ms elapsed=234.83s tid=0x00007fd3c400b560 nid=0x12639 runnable  

"GC Thread#9" os_prio=0 cpu=128.72ms elapsed=234.83s tid=0x00007fd3c400c3c0 nid=0x1263a runnable  

"G1 Main Marker" os_prio=0 cpu=1.31ms elapsed=235.21s tid=0x00007fd41406a2b0 nid=0x1261d runnable  

"G1 Conc#0" os_prio=0 cpu=109.14ms elapsed=235.21s tid=0x00007fd41406b210 nid=0x1261e runnable  

"G1 Conc#1" os_prio=0 cpu=105.48ms elapsed=233.99s tid=0x00007fd3d8000eb0 nid=0x12689 runnable  

"G1 Conc#2" os_prio=0 cpu=99.37ms elapsed=233.98s tid=0x00007fd3d80018f0 nid=0x1268a runnable  

"G1 Refine#0" os_prio=0 cpu=12.37ms elapsed=235.21s tid=0x00007fd4141a7a30 nid=0x12620 runnable  

"G1 Refine#1" os_prio=0 cpu=6.27ms elapsed=234.82s tid=0x00007fd3d0000eb0 nid=0x1263b runnable  

"G1 Refine#2" os_prio=0 cpu=5.70ms elapsed=234.82s tid=0x00007fd354000eb0 nid=0x1263c runnable  

"G1 Refine#3" os_prio=0 cpu=4.67ms elapsed=234.82s tid=0x00007fd348000eb0 nid=0x1263d runnable  

"G1 Refine#4" os_prio=0 cpu=2.40ms elapsed=234.82s tid=0x00007fd34c000eb0 nid=0x1263e runnable  

"G1 Refine#5" os_prio=0 cpu=2.24ms elapsed=234.82s tid=0x00007fd340000eb0 nid=0x1263f runnable  

"G1 Refine#6" os_prio=0 cpu=0.65ms elapsed=223.43s tid=0x00007fd344000eb0 nid=0x1292a runnable  

"G1 Refine#7" os_prio=0 cpu=0.70ms elapsed=223.43s tid=0x00007fd32801cec0 nid=0x1292b runnable  

"G1 Refine#8" os_prio=0 cpu=0.27ms elapsed=223.43s tid=0x00007fd334019820 nid=0x1292c runnable  

"G1 Service" os_prio=0 cpu=46.25ms elapsed=235.21s tid=0x00007fd4141a8920 nid=0x12621 runnable  

"VM Periodic Task Thread" os_prio=0 cpu=139.36ms elapsed=235.14s tid=0x00007fd41402b5b0 nid=0x1262f waiting on condition  

JNI global refs: 59, weak refs: 1

Heap
 garbage-first heap   total 278528K, used 135125K [0x0000000417000000, 0x0000000800000000)
  region size 8192K, 6 young (49152K), 1 survivors (8192K)
 Metaspace       used 73755K, committed 74432K, reserved 1114112K
  class space    used 10059K, committed 10368K, reserved 1048576K
phillip-kruger commented 1 year ago

I can't really find anything that allows me to fix this. What I (think) I know so far:

Does anyone else that use podman get this ?

stalep commented 1 year ago

After updating to Fedora 38 we have issues with Horreum (https://github.com/Hyperfoil/Horreum) test suite (Horreum is based on Quarkus using Keycloak). The test suite hangs and after I kill it I see two docker.io/testcontainers/ryuk:0.3.4 running and one docker.io/library/postgres:13 when using 'podman ps'.

I think it's related to the hanging postgres process. When I do a 'podman kill -a' I can start the test suite again and it will run a few tests before hanging. If I do not kill the podman processes the first test will never start as it will wait for testcontaines to start.

cgruver commented 1 year ago

I am seeing similar issues with Quarkus 3.3.2 in OpenShift Dev Spaces / Eclipse Che.

If I use a VS Code task to start live dev mode, it does not stop when I stop the task. I cannot restart dev mode at this point because the required ports are still bound by the previous process.

If I start dev mode from a terminal, it requires two CTRL+C combinations to stop it.

cgruver commented 1 year ago

The above might have been self inflicted... I can no longer reproduce it.