search

apache / rocketmq

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.
https://rocketmq.apache.org/
Apache License 2.0
21.13k stars 11.64k forks source link

[Bug] Bug title broker进程异常中止 #8752

Open llllllllu opened 5 days ago

llllllllu commented 5 days ago

Before Creating the Bug Report

Runtime platform environment

centos 7

RocketMQ version

5.3.0

JDK Version

1.8

Describe the Bug

应用总是收不到消息，检查rocketMQ·进程，发现nameSrv进程正常，但是broker进程不存在了，16:21:07显示broker注销了。日志如下： nameSrv日志： 2024-09-25 16:20:14 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:20:19 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:20:24 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:20:29 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:20:34 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:20:39 WARN NettyClientWorkerThread_3 - NETTY CLIENT PIPELINE: IDLE exception [10.169.133.146:9876] 2024-09-25 16:20:39 INFO NettyClientWorkerThread_3 - closeChannel: the channel[10.169.133.146:9876] was removed from channel table 2024-09-25 16:20:39 INFO NettyClientWorkerThread_3 - NETTY CLIENT PIPELINE: CLOSE 10.169.133.146:9876 2024-09-25 16:20:39 INFO NettyClientWorkerThread_3 - eventCloseChannel: the channel[null] has been removed from the channel table before 2024-09-25 16:20:39 INFO NettyClientSelector_1 - closeChannel: close the connection to remote address[10.169.133.146:9876] result: true 2024-09-25 16:20:39 INFO NettyClientWorkerThread_3 - NETTY CLIENT PIPELINE: channelInactive, the channel[10.169.133.146:9876] 2024-09-25 16:20:39 INFO NettyClientWorkerThread_3 - eventCloseChannel: the channel[null] has been removed from the channel table before 2024-09-25 16:20:39 INFO NettyServerCodecThread_2 - NETTY SERVER PIPELINE: channelInactive, the channel[10.169.133.146:38564] 2024-09-25 16:20:39 INFO NettyServerCodecThread_2 - NETTY SERVER PIPELINE: channelUnregistered, the channel[10.169.133.146:38564] 2024-09-25 16:20:39 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:20:40 INFO NettyClientScan_thread_2 - createChannel: begin to connect remote host[10.169.133.146:9876] asynchronously 2024-09-25 16:20:40 INFO NettyClientWorkerThread_4 - NETTY CLIENT PIPELINE: CONNECT UNKNOWN => 10.169.133.146:9876 2024-09-25 16:20:40 INFO NettyClientWorkerThread_4 - NETTY CLIENT PIPELINE: ACTIVE, 10.169.133.146:9876 2024-09-25 16:20:40 INFO NettyServerCodecThread_3 - NETTY SERVER PIPELINE: channelRegistered 10.169.133.146:38636 2024-09-25 16:20:40 INFO NettyServerCodecThread_3 - NETTY SERVER PIPELINE: channelActive, the channel[10.169.133.146:38636] 2024-09-25 16:20:44 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:20:49 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:20:54 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:20:59 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:21:04 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:21:07 INFO org.apache.rocketmq.namesrv.routeinfo.BatchUnregistrationService - unregisterBroker, remove from brokerLiveTable OK, BrokerIdentityInfo [clusterName=DefaultCluster, brokerAddr=10.169.133.146:10911] 2024-09-25 16:21:07 INFO org.apache.rocketmq.namesrv.routeinfo.BatchUnregistrationService - unregisterBroker, remove addr from brokerAddrTable OK, BrokerIdentityInfo [clusterName=DefaultCluster, brokerAddr=10.169.133.146:10911] 2024-09-25 16:21:07 INFO org.apache.rocketmq.namesrv.routeinfo.BatchUnregistrationService - unregisterBroker, remove name from brokerAddrTable OK, localhost.localdomain 2024-09-25 16:21:07 INFO org.apache.rocketmq.namesrv.routeinfo.BatchUnregistrationService - unregisterBroker, remove name from clusterAddrTable OK, localhost.localdomain 2024-09-25 16:21:07 INFO org.apache.rocketmq.namesrv.routeinfo.BatchUnregistrationService - unregisterBroker, remove cluster from clusterAddrTable DefaultCluster 2024-09-25 16:21:09 INFO NSScanScheduledThread - start scanNotActiveBroker 2024-09-25 16:21:14 INFO NSScanScheduledThread - start scanNotActiveBroker

broker日志： 2024-09-25 16:16:37 INFO BrokerControllerScheduledThread1 - Dispatch task fall behind commit log 0bytes 2024-09-25 16:16:37 INFO brokerOutApi_thread_3 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:17:07 INFO brokerOutApi_thread_4 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:17:37 INFO BrokerControllerScheduledThread1 - Dispatch task fall behind commit log 0bytes 2024-09-25 16:17:37 INFO brokerOutApi_thread_1 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:18:07 INFO brokerOutApi_thread_2 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:18:37 INFO BrokerControllerScheduledThread1 - Dispatch task fall behind commit log 0bytes 2024-09-25 16:18:37 INFO brokerOutApi_thread_3 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:19:07 INFO brokerOutApi_thread_4 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:19:37 INFO BrokerControllerScheduledThread1 - Dispatch task fall behind commit log 0bytes 2024-09-25 16:19:37 INFO brokerOutApi_thread_1 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:20:07 INFO brokerOutApi_thread_2 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:20:37 INFO BrokerControllerScheduledThread1 - Dispatch task fall behind commit log 0bytes 2024-09-25 16:20:37 INFO brokerOutApi_thread_3 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:21:07 INFO brokerOutApi_thread_4 - Registering current broker to name server completed. TargetHost=127.0.0.1:9876 2024-09-25 16:21:07 INFO Thread-19 - Shutdown hook was invoked, 1 2024-09-25 16:21:07 INFO Thread-19 - unregisterBroker OK, NamesrvAddr: 127.0.0.1:9876 2024-09-25 16:21:07 INFO Thread-19 - Try to shutdown service thread:NettyEventExecutor started:true lastThread:Thread[NettyEventExecutor,5,main] 2024-09-25 16:21:07 INFO Thread-19 - shutdown thread[NettyEventExecutor] interrupt=false 2024-09-25 16:21:07 INFO NettyEventExecutor - NETTY EVENT: remove channel[ClientChannelInfo [channel=[id: 0x02c787fe, L:/10.169.133.146:10911 ! R:/10.169.133.146:36282], clientId=10.169.133.146@86695#9574034400515375, language=JAVA, version=413, lastUpdateTimestamp=1727252450205]][10.169.133.146:36282] from ProducerManager groupChannelTable, producer group: CLIENT_INNER_PRODUCER 2024-09-25 16:21:07 WARN NettyEventExecutor - NETTY EVENT: remove not active channel[ClientChannelInfo [channel=[id: 0x02c787fe, L:/10.169.133.146:10911 ! R:/10.169.133.146:36282], clientId=10.169.133.146@86695#9574034400515375, language=JAVA, version=413, lastUpdateTimestamp=1727252450205]] from ConsumerGroupInfo groupChannelTable, consumer group: SMS_SEND_TOPIC_CONSUMER 2024-09-25 16:21:07 INFO NettyEventExecutor - unregister consumer ok, no any connection, and remove consumer group, SMS_SEND_TOPIC_CONSUMER 2024-09-25 16:21:07 INFO Thread-19 - join thread[NettyEventExecutor], elapsed time: 3ms, join time:90000ms 2024-09-25 16:21:07 INFO Thread-19 - Try to shutdown service thread:NettyEventExecutor started:true lastThread:Thread[NettyEventExecutor,5,main] 2024-09-25 16:21:07 INFO Thread-19 - shutdown thread[NettyEventExecutor] interrupt=false 2024-09-25 16:21:09 INFO Thread-19 - join thread[NettyEventExecutor], elapsed time: 1911ms, join time:90000ms 2024-09-25 16:21:09 INFO Thread-19 - Try to shutdown service thread:PullRequestHoldService started:true lastThread:Thread[PullRequestHoldService,5,main] 2024-09-25 16:21:09 INFO Thread-19 - shutdown thread[PullRequestHoldService] interrupt=false 2024-09-25 16:21:09 INFO PullRequestHoldService - PullRequestHoldService service end 2024-09-25 16:21:09 INFO Thread-19 - join thread[PullRequestHoldService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:09 INFO Thread-19 - Try to shutdown service thread:PopLongPollingService started:true lastThread:Thread[PopLongPollingService,5,main] 2024-09-25 16:21:09 INFO Thread-19 - shutdown thread[PopLongPollingService] interrupt=false 2024-09-25 16:21:09 INFO Thread-19 - join thread[PopLongPollingService], elapsed time: 2ms, join time:90000ms 2024-09-25 16:21:09 INFO Thread-19 - Try to shutdown service thread:QueueLockManager started:true lastThread:Thread[QueueLockManager,5,main] 2024-09-25 16:21:09 INFO Thread-19 - shutdown thread[QueueLockManager] interrupt=false 2024-09-25 16:21:09 INFO Thread-19 - join thread[QueueLockManager], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:09 INFO Thread-19 - Try to shutdown service thread:PopBufferMergeService started:true lastThread:Thread[PopBufferMergeService,5,main] 2024-09-25 16:21:09 INFO Thread-19 - shutdown thread[PopBufferMergeService] interrupt=false 2024-09-25 16:21:11 INFO Thread-19 - join thread[PopBufferMergeService], elapsed time: 2000ms, join time:90000ms 2024-09-25 16:21:11 INFO Thread-19 - Try to shutdown service thread:PopReviveService_0 started:true lastThread:Thread[PopReviveService_0,5,main] 2024-09-25 16:21:11 INFO Thread-19 - shutdown thread[PopReviveService_0] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[PopReviveService_0], elapsed time: 3343ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:PopReviveService_1 started:true lastThread:Thread[PopReviveService_1,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[PopReviveService_1] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[PopReviveService_1], elapsed time: 14ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:PopReviveService_2 started:true lastThread:Thread[PopReviveService_2,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[PopReviveService_2] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[PopReviveService_2], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:PopReviveService_3 started:true lastThread:Thread[PopReviveService_3,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[PopReviveService_3] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[PopReviveService_3], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:PopReviveService_4 started:true lastThread:Thread[PopReviveService_4,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[PopReviveService_4] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[PopReviveService_4], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:PopReviveService_5 started:true lastThread:Thread[PopReviveService_5,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[PopReviveService_5] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[PopReviveService_5], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:PopReviveService_6 started:true lastThread:Thread[PopReviveService_6,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[PopReviveService_6] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[PopReviveService_6], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:PopReviveService_7 started:true lastThread:Thread[PopReviveService_7,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[PopReviveService_7] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[PopReviveService_7], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TransactionalOpBatchService started:true lastThread:Thread[TransactionalOpBatchService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TransactionalOpBatchService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TransactionalOpBatchService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:PopLongPollingService started:true lastThread:Thread[PopLongPollingService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[PopLongPollingService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[PopLongPollingService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TopicQueueMappingCleanService started:true lastThread:Thread[TopicQueueMappingCleanService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TopicQueueMappingCleanService] interrupt=false 2024-09-25 16:21:15 INFO TopicQueueMappingCleanService - End topic queue mapping clean service thread! 2024-09-25 16:21:15 INFO Thread-19 - join thread[TopicQueueMappingCleanService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerFlushService started:true lastThread:Thread[TimerFlushService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerFlushService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerFlushService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerEnqueueGetService started:true lastThread:Thread[TimerEnqueueGetService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerEnqueueGetService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerEnqueueGetService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerEnqueuePutService started:true lastThread:Thread[TimerEnqueuePutService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerEnqueuePutService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerEnqueuePutService], elapsed time: 1ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerDequeueWarmService started:true lastThread:Thread[TimerDequeueWarmService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerDequeueWarmService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerDequeueWarmService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerDequeueGetService started:true lastThread:Thread[TimerDequeueGetService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerDequeueGetService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerDequeueGetService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerDequeueGetMessageService started:true lastThread:Thread[TimerDequeueGetMessageService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerDequeueGetMessageService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerDequeueGetMessageService], elapsed time: 62ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerDequeueGetMessageService started:true lastThread:Thread[TimerDequeueGetMessageService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerDequeueGetMessageService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerDequeueGetMessageService], elapsed time: 1ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerDequeueGetMessageService started:true lastThread:Thread[TimerDequeueGetMessageService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerDequeueGetMessageService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerDequeueGetMessageService], elapsed time: 100ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerDequeuePutMessageService started:true lastThread:Thread[TimerDequeuePutMessageService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerDequeuePutMessageService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerDequeuePutMessageService], elapsed time: 10ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerDequeuePutMessageService started:true lastThread:Thread[TimerDequeuePutMessageService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerDequeuePutMessageService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerDequeuePutMessageService], elapsed time: 10ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:TimerDequeuePutMessageService started:true lastThread:Thread[TimerDequeuePutMessageService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[TimerDequeuePutMessageService] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[TimerDequeuePutMessageService], elapsed time: 3ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:FileWatchService started:true lastThread:Thread[FileWatchService,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[FileWatchService] interrupt=false 2024-09-25 16:21:15 INFO FileWatchService - FileWatchService service end 2024-09-25 16:21:15 INFO Thread-19 - join thread[FileWatchService], elapsed time: 1ms, join time:90000ms 2024-09-25 16:21:15 INFO Thread-19 - Try to shutdown service thread:BroadcastOffsetManager started:true lastThread:Thread[BroadcastOffsetManager,5,main] 2024-09-25 16:21:15 INFO Thread-19 - shutdown thread[BroadcastOffsetManager] interrupt=false 2024-09-25 16:21:15 INFO Thread-19 - join thread[BroadcastOffsetManager], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:DefaultAcceptSocketService started:true lastThread:Thread[DefaultAcceptSocketService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[DefaultAcceptSocketService] interrupt=true 2024-09-25 16:21:18 INFO Thread-19 - join thread[DefaultAcceptSocketService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:GroupTransferService started:true lastThread:Thread[GroupTransferService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[GroupTransferService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[GroupTransferService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:HAConnectionStateNotificationService started:true lastThread:Thread[HAConnectionStateNotificationService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[HAConnectionStateNotificationService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[HAConnectionStateNotificationService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:StoreStatsService started:true lastThread:Thread[StoreStatsService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[StoreStatsService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[StoreStatsService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:FlushRealTimeService started:true lastThread:Thread[FlushRealTimeService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[FlushRealTimeService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[FlushRealTimeService], elapsed time: 121ms, join time:300000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:FlushDiskWatcher started:true lastThread:Thread[FlushDiskWatcher,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[FlushDiskWatcher] interrupt=true 2024-09-25 16:21:18 INFO Thread-19 - join thread[FlushDiskWatcher], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:ColdDataCheckService started:true lastThread:Thread[ColdDataCheckService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[ColdDataCheckService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[ColdDataCheckService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:ReputMessageService started:true lastThread:Thread[ReputMessageService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[ReputMessageService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[ReputMessageService], elapsed time: 1ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:FlushConsumeQueueService started:true lastThread:Thread[FlushConsumeQueueService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[FlushConsumeQueueService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[FlushConsumeQueueService], elapsed time: 1ms, join time:60000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:AllocateMappedFileService started:true lastThread:Thread[AllocateMappedFileService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[AllocateMappedFileService] interrupt=true 2024-09-25 16:21:18 INFO Thread-19 - join thread[AllocateMappedFileService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:org.apache.rocketmq.store.util.PerfCounter$Ticks started:true lastThread:Thread[org.apache.rocketmq.store.util.PerfCounter$Ticks,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[org.apache.rocketmq.store.util.PerfCounter$Ticks] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[org.apache.rocketmq.store.util.PerfCounter$Ticks], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:TransactionalMessageCheckService started:true lastThread:Thread[TransactionalMessageCheckService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[TransactionalMessageCheckService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[TransactionalMessageCheckService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:TransactionFlushService started:true lastThread:Thread[TransactionFlushService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[TransactionFlushService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[TransactionFlushService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:ColdDataPullRequestHoldService started:true lastThread:Thread[ColdDataPullRequestHoldService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[ColdDataPullRequestHoldService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[ColdDataPullRequestHoldService], elapsed time: 1ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:ColdDataCgCtrService started:true lastThread:Thread[ColdDataCgCtrService,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[ColdDataCgCtrService] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[ColdDataCgCtrService], elapsed time: 0ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Try to shutdown service thread:NettyEventExecutor started:true lastThread:Thread[NettyEventExecutor,5,main] 2024-09-25 16:21:18 INFO Thread-19 - shutdown thread[NettyEventExecutor] interrupt=false 2024-09-25 16:21:18 INFO Thread-19 - join thread[NettyEventExecutor], elapsed time: 164ms, join time:90000ms 2024-09-25 16:21:18 INFO Thread-19 - Shutdown hook over, consuming total time(ms): 10862

gc日志： 2024-09-25T16:09:37.106+0800: 13.040: Total time for which application threads were stopped: 0.0004507 seconds, Stopping threads took: 0.0001313 seconds 13.711: [G1Ergonomics (Concurrent Cycles) initiate concurrent cycle, reason: concurrent cycle initiation requested] 2024-09-25T16:09:37.777+0800: 13.711: [GC pause (G1 Evacuation Pause) (young) (initial-mark) 13.711: [G1Ergonomics (CSet Construction) start choosing CSet, _pending_cards: 0, predicted base time: 7.14 ms, remaining time: 192.86 ms, target pause time: 200.00 ms] 13.711: [G1Ergonomics (CSet Construction) add young regions to CSet, eden: 10 regions, survivors: 1 regions, predicted young region time: 189.04 ms] 13.711: [G1Ergonomics (CSet Construction) finish choosing CSet, eden: 10 regions, survivors: 1 regions, old: 0 regions, predicted pause time: 196.18 ms, target pause time: 200.00 ms] 13.722: [G1Ergonomics (Mixed GCs) do not start mixed GCs, reason: concurrent cycle is about to start] , 0.0115028 secs] [Parallel Time: 7.6 ms, GC Workers: 8] [GC Worker Start (ms): Min: 13711.1, Avg: 13711.2, Max: 13711.3, Diff: 0.2] [Ext Root Scanning (ms): Min: 1.7, Avg: 1.8, Max: 2.0, Diff: 0.3, Sum: 14.8] [Update RS (ms): Min: 0.0, Avg: 0.0, Max: 0.0, Diff: 0.0, Sum: 0.0] [Processed Buffers: Min: 0, Avg: 0.0, Max: 0, Diff: 0, Sum: 0] [Scan RS (ms): Min: 0.0, Avg: 0.0, Max: 0.0, Diff: 0.0, Sum: 0.0] [Code Root Scanning (ms): Min: 0.0, Avg: 0.6, Max: 3.2, Diff: 3.2, Sum: 4.7] [Object Copy (ms): Min: 2.2, Avg: 4.7, Max: 5.3, Diff: 3.2, Sum: 37.9] [Termination (ms): Min: 0.0, Avg: 0.0, Max: 0.0, Diff: 0.0, Sum: 0.1] [Termination Attempts: Min: 1, Avg: 4.0, Max: 7, Diff: 6, Sum: 32] [GC Worker Other (ms): Min: 0.0, Avg: 0.0, Max: 0.0, Diff: 0.0, Sum: 0.1] [GC Worker Total (ms): Min: 7.1, Avg: 7.2, Max: 7.3, Diff: 0.2, Sum: 57.6] [GC Worker End (ms): Min: 13718.4, Avg: 13718.4, Max: 13718.4, Diff: 0.0] [Code Root Fixup: 0.2 ms] [Code Root Purge: 0.0 ms] [Clear CT: 0.3 ms] [Other: 3.4 ms] [Choose CSet: 0.0 ms] [Ref Proc: 2.6 ms] [Ref Enq: 0.0 ms] [Redirty Cards: 0.3 ms] [Humongous Register: 0.0 ms] [Humongous Reclaim: 0.0 ms] [Free CSet: 0.2 ms] [Eden: 160.0M(160.0M)->0.0B(400.0M) Survivors: 16.0M->32.0M Heap: 172.4M(2048.0M)->22.8M(2048.0M)] [Times: user=0.05 sys=0.01, real=0.02 secs] 2024-09-25T16:09:37.789+0800: 13.722: [GC concurrent-root-region-scan-start] 2024-09-25T16:09:37.789+0800: 13.723: Total time for which application threads were stopped: 0.0123422 seconds, Stopping threads took: 0.0001235 seconds 2024-09-25T16:09:37.799+0800: 13.732: [GC concurrent-root-region-scan-end, 0.0099370 secs] 2024-09-25T16:09:37.799+0800: 13.732: [GC concurrent-mark-start] 2024-09-25T16:09:37.799+0800: 13.733: [GC concurrent-mark-end, 0.0001478 secs] 2024-09-25T16:09:37.799+0800: 13.733: [GC remark 2024-09-25T16:09:37.799+0800: 13.733: [Finalize Marking, 0.0004708 secs] 2024-09-25T16:09:37.800+0800: 13.734: [GC ref-proc, 0.0002201 secs] 2024-09-25T16:09:37.800+0800: 13.734: [Unloading, 0.0034795 secs], 0.0045603 secs] [Times: user=0.03 sys=0.00, real=0.00 secs] 2024-09-25T16:09:37.804+0800: 13.738: Total time for which application threads were stopped: 0.0051231 seconds, Stopping threads took: 0.0001155 seconds 2024-09-25T16:09:37.804+0800: 13.738: [GC cleanup 26M->26M(2048M), 0.0013726 secs] [Times: user=0.00 sys=0.00, real=0.00 secs] 2024-09-25T16:09:37.806+0800: 13.740: Total time for which application threads were stopped: 0.0017175 seconds, Stopping threads took: 0.0000814 seconds 2024-09-25T16:09:38.807+0800: 14.740: Total time for which application threads were stopped: 0.0004718 seconds, Stopping threads took: 0.0001128 seconds 2024-09-25T16:09:39.807+0800: 15.741: Total time for which application threads were stopped: 0.0003867 seconds, Stopping threads took: 0.0001028 seconds 2024-09-25T16:09:40.808+0800: 16.741: Total time for which application threads were stopped: 0.0004698 seconds, Stopping threads took: 0.0000996 seconds 2024-09-25T16:09:41.808+0800: 17.742: Total time for which application threads were stopped: 0.0004894 seconds, Stopping threads took: 0.0001394 seconds 2024-09-25T16:09:42.809+0800: 18.743: Total time for which application threads were stopped: 0.0004188 seconds, Stopping threads took: 0.0001071 seconds 2024-09-25T16:09:43.809+0800: 19.743: Total time for which application threads were stopped: 0.0004412 seconds, Stopping threads took: 0.0001138 seconds 2024-09-25T16:09:44.810+0800: 20.744: Total time for which application threads were stopped: 0.0006978 seconds, Stopping threads took: 0.0003175 seconds 2024-09-25T16:09:45.811+0800: 21.745: Total time for which application threads were stopped: 0.0004225 seconds, Stopping threads took: 0.0001097 seconds 2024-09-25T16:09:46.812+0800: 22.745: Total time for which application threads were stopped: 0.0004342 seconds, Stopping threads took: 0.0001056 seconds 2024-09-25T16:09:47.812+0800: 23.746: Total time for which application threads were stopped: 0.0004122 seconds, Stopping threads took: 0.0001053 seconds 2024-09-25T16:09:48.813+0800: 24.746: Total time for which application threads were stopped: 0.0004833 seconds, Stopping threads took: 0.0001174 seconds 2024-09-25T16:09:49.825+0800: 25.758: Total time for which application threads were stopped: 0.0117823 seconds, Stopping threads took: 0.0114330 seconds 2024-09-25T16:09:50.825+0800: 26.759: Total time for which application threads were stopped: 0.0006030 seconds, Stopping threads took: 0.0001410 seconds 2024-09-25T16:09:51.826+0800: 27.760: Total time for which application threads were stopped: 0.0003998 seconds, Stopping threads took: 0.0000990 seconds 2024-09-25T16:09:52.827+0800: 28.760: Total time for which application threads were stopped: 0.0005512 seconds, Stopping threads took: 0.0001182 seconds 2024-09-25T16:09:53.827+0800: 29.761: Total time for which application threads were stopped: 0.0005645 seconds, Stopping threads took: 0.0001158 seconds 2024-09-25T16:09:54.828+0800: 30.761: Total time for which application threads were stopped: 0.0003920 seconds, Stopping threads took: 0.0001052 seconds 2024-09-25T16:09:55.828+0800: 31.762: Total time for which application threads were stopped: 0.0004738 seconds, Stopping threads took: 0.0001020 seconds 2024-09-25T16:09:56.829+0800: 32.763: Total time for which application threads were stopped: 0.0004382 seconds, Stopping threads took: 0.0001317 seconds 2024-09-25T16:09:57.830+0800: 33.763: Total time for which application threads were stopped: 0.0005180 seconds, Stopping threads took: 0.0001452 seconds 2024-09-25T16:09:58.830+0800: 34.764: Total time for which application threads were stopped: 0.0004999 seconds, Stopping threads took: 0.0001056 seconds 2024-09-25T16:10:00.831+0800: 36.765: Total time for which application threads were stopped: 0.0004531 seconds, Stopping threads took: 0.0001017 seconds 2024-09-25T16:10:02.832+0800: 38.765: Total time for which application threads were stopped: 0.0004141 seconds, Stopping threads took: 0.0001065 seconds 2024-09-25T16:10:06.833+0800: 42.766: Total time for which application threads were stopped: 0.0004556 seconds, Stopping threads took: 0.0001193 seconds 2024-09-25T16:10:07.833+0800: 43.767: Total time for which application threads were stopped: 0.0004969 seconds, Stopping threads took: 0.0001047 seconds 2024-09-25T16:10:08.834+0800: 44.768: Total time for which application threads were stopped: 0.0005421 seconds, Stopping threads took: 0.0001353 seconds 2024-09-25T16:10:09.835+0800: 45.768: Total time for which application threads were stopped: 0.0004716 seconds, Stopping threads took: 0.0001556 seconds 2024-09-25T16:10:12.836+0800: 48.769: Total time for which application threads were stopped: 0.0005442 seconds, Stopping threads took: 0.0001142 seconds 2024-09-25T16:10:14.836+0800: 50.770: Total time for which application threads were stopped: 0.0004672 seconds, Stopping threads took: 0.0001022 seconds 2024-09-25T16:10:15.837+0800: 51.771: Total time for which application threads were stopped: 0.0004728 seconds, Stopping threads took: 0.0001050 seconds 2024-09-25T16:10:16.838+0800: 52.771: Total time for which application threads were stopped: 0.0004266 seconds, Stopping threads took: 0.0001159 seconds 2024-09-25T16:10:17.838+0800: 53.772: Total time for which application threads were stopped: 0.0005036 seconds, Stopping threads took: 0.0001380 seconds 2024-09-25T16:10:20.839+0800: 56.773: Total time for which application threads were stopped: 0.0004727 seconds, Stopping threads took: 0.0001101 seconds 2024-09-25T16:10:21.840+0800: 57.773: Total time for which application threads were stopped: 0.0004430 seconds, Stopping threads took: 0.0001135 seconds 2024-09-25T16:10:22.840+0800: 58.774: Total time for which application threads were stopped: 0.0005732 seconds, Stopping threads took: 0.0001358 seconds 2024-09-25T16:10:25.841+0800: 61.775: Total time for which application threads were stopped: 0.0004717 seconds, Stopping threads took: 0.0001421 seconds 2024-09-25T16:10:30.842+0800: 66.776: Total time for which application threads were stopped: 0.0004996 seconds, Stopping threads took: 0.0001686 seconds 2024-09-25T16:10:31.843+0800: 67.777: Total time for which application threads were stopped: 0.0004919 seconds, Stopping threads took: 0.0001552 seconds 2024-09-25T16:10:32.844+0800: 68.777: Total time for which application threads were stopped: 0.0005098 seconds, Stopping threads took: 0.0001096 seconds 2024-09-25T16:10:34.865+0800: 70.798: Total time for which application threads were stopped: 0.0205805 seconds, Stopping threads took: 0.0201368 seconds 2024-09-25T16:10:35.865+0800: 71.799: Total time for which application threads were stopped: 0.0003842 seconds, Stopping threads took: 0.0000822 seconds 2024-09-25T16:10:36.866+0800: 72.799: Total time for which application threads were stopped: 0.0005070 seconds, Stopping threads took: 0.0001754 seconds 2024-09-25T16:10:37.866+0800: 73.800: Total time for which application threads were stopped: 0.0005175 seconds, Stopping threads took: 0.0001167 seconds 2024-09-25T16:10:45.868+0800: 81.802: Total time for which application threads were stopped: 0.0004222 seconds, Stopping threads took: 0.0001170 seconds 2024-09-25T16:10:52.869+0800: 88.803: Total time for which application threads were stopped: 0.0004884 seconds, Stopping threads took: 0.0001356 seconds 2024-09-25T16:10:53.870+0800: 89.804: Total time for which application threads were stopped: 0.0004213 seconds, Stopping threads took: 0.0001078 seconds 2024-09-25T16:10:54.870+0800: 90.804: Total time for which application threads were stopped: 0.0004726 seconds, Stopping threads took: 0.0001097 seconds 2024-09-25T16:10:55.871+0800: 91.805: Total time for which application threads were stopped: 0.0004145 seconds, Stopping threads took: 0.0001139 seconds 2024-09-25T16:10:56.872+0800: 92.805: Total time for which application threads were stopped: 0.0005365 seconds, Stopping threads took: 0.0001605 seconds 2024-09-25T16:10:57.907+0800: 93.840: Total time for which application threads were stopped: 0.0347212 seconds, Stopping threads took: 0.0343057 seconds 2024-09-25T16:10:58.907+0800: 94.841: Total time for which application threads were stopped: 0.0004520 seconds, Stopping threads took: 0.0001168 seconds 2024-09-25T16:11:00.908+0800: 96.842: Total time for which application threads were stopped: 0.0004630 seconds, Stopping threads took: 0.0001222 seconds 2024-09-25T16:11:02.909+0800: 98.842: Total time for which application threads were stopped: 0.0004513 seconds, Stopping threads took: 0.0001266 seconds 2024-09-25T16:11:04.909+0800: 100.843: Total time for which application threads were stopped: 0.0004855 seconds, Stopping threads took: 0.0001058 seconds 2024-09-25T16:11:05.910+0800: 101.844: Total time for which application threads were stopped: 0.0004642 seconds, Stopping threads took: 0.0001075 seconds 2024-09-25T16:11:12.911+0800: 108.845: Total time for which application threads were stopped: 0.0006114 seconds, Stopping threads took: 0.0001321 seconds 2024-09-25T16:11:14.912+0800: 110.846: Total time for which application threads were stopped: 0.0005088 seconds, Stopping threads took: 0.0001248 seconds 2024-09-25T16:11:15.913+0800: 111.846: Total time for which application threads were stopped: 0.0004187 seconds, Stopping threads took: 0.0001044 seconds 2024-09-25T16:11:16.913+0800: 112.847: Total time for which application threads were stopped: 0.0004909 seconds, Stopping threads took: 0.0001195 seconds 2024-09-25T16:11:19.914+0800: 115.848: Total time for which application threads were stopped: 0.0005921 seconds, Stopping threads took: 0.0001443 seconds 2024-09-25T16:11:21.915+0800: 117.849: Total time for which application threads were stopped: 0.0004891 seconds, Stopping threads took: 0.0001197 seconds 2024-09-25T16:11:23.916+0800: 119.849: Total time for which application threads were stopped: 0.0003861 seconds, Stopping threads took: 0.0000950 seconds 2024-09-25T16:11:25.917+0800: 121.850: Total time for which application threads were stopped: 0.0004515 seconds, Stopping threads took: 0.0001282 seconds 2024-09-25T16:11:26.917+0800: 122.851: Total time for which application threads were stopped: 0.0004954 seconds, Stopping threads took: 0.0001292 seconds 2024-09-25T16:11:27.918+0800: 123.852: Total time for which application threads were stopped: 0.0005689 seconds, Stopping threads took: 0.0001589 seconds 2024-09-25T16:11:28.919+0800: 124.852: Total time for which application threads were stopped: 0.0004808 seconds, Stopping threads took: 0.0001127 seconds 2024-09-25T16:11:32.920+0800: 128.853: Total time for which application threads were stopped: 0.0004765 seconds, Stopping threads took: 0.0001118 seconds 2024-09-25T16:11:33.920+0800: 129.854: Total time for which application threads were stopped: 0.0004717 seconds, Stopping threads took: 0.0001216 seconds 2024-09-25T16:11:34.921+0800: 130.855: Total time for which application threads were stopped: 0.0007119 seconds, Stopping threads took: 0.0001908 seconds 2024-09-25T16:11:35.922+0800: 131.855: Total time for which application threads were stopped: 0.0005246 seconds, Stopping threads took: 0.0001252 seconds 2024-09-25T16:11:37.922+0800: 133.856: Total time for which application threads were stopped: 0.0005518 seconds, Stopping threads took: 0.0001393 seconds 2024-09-25T16:11:40.923+0800: 136.857: Total time for which application threads were stopped: 0.0004221 seconds, Stopping threads took: 0.0001231 seconds 2024-09-25T16:11:42.943+0800: 138.876: Total time for which application threads were stopped: 0.0191673 seconds, Stopping threads took: 0.0188045 seconds 2024-09-25T16:11:52.945+0800: 148.878: Total time for which application threads were stopped: 0.0004779 seconds, Stopping threads took: 0.0001022 seconds 2024-09-25T16:11:54.945+0800: 150.879: Total time for which application threads were stopped: 0.0003981 seconds, Stopping threads took: 0.0000960 seconds 2024-09-25T16:11:55.946+0800: 151.880: Total time for which application threads were stopped: 0.0005964 seconds, Stopping threads took: 0.0002107 seconds 2024-09-25T16:11:56.947+0800: 152.880: Total time for which application threads were stopped: 0.0005225 seconds, Stopping threads took: 0.0001353 seconds 2024-09-25T16:11:57.947+0800: 153.881: Total time for which application threads were stopped: 0.0005573 seconds, Stopping threads took: 0.0001488 seconds 2024-09-25T16:12:06.949+0800: 162.883: Total time for which application threads were stopped: 0.0005509 seconds, Stopping threads took: 0.0001168 seconds 2024-09-25T16:12:07.950+0800: 163.883: Total time for which application threads were stopped: 0.0005586 seconds, Stopping threads took: 0.0001818 seconds 2024-09-25T16:12:08.950+0800: 164.884: Total time for which application threads were stopped: 0.0004910 seconds, Stopping threads took: 0.0001091 seconds 2024-09-25T16:12:10.951+0800: 166.885: Total time for which application threads were stopped: 0.0004126 seconds, Stopping threads took: 0.0001028 seconds 2024-09-25T16:12:12.952+0800: 168.885: Total time for which application threads were stopped: 0.0004319 seconds, Stopping threads took: 0.0001056 seconds 2024-09-25T16:12:14.953+0800: 170.886: Total time for which application threads were stopped: 0.0004613 seconds, Stopping threads took: 0.0001055 seconds 2024-09-25T16:12:15.953+0800: 171.887: Total time for which application threads were stopped: 0.0004241 seconds, Stopping threads took: 0.0001054 seconds 2024-09-25T16:12:21.954+0800: 177.888: Total time for which application threads were stopped: 0.0005248 seconds, Stopping threads took: 0.0001036 seconds 2024-09-25T16:12:24.955+0800: 180.889: Total time for which application threads were stopped: 0.0004376 seconds, Stopping threads took: 0.0000921 seconds 2024-09-25T16:12:27.956+0800: 183.890: Total time for which application threads were stopped: 0.0005405 seconds, Stopping threads took: 0.0001122 seconds 2024-09-25T16:12:30.957+0800: 186.891: Total time for which application threads were stopped: 0.0004240 seconds, Stopping threads took: 0.0001137 seconds 2024-09-25T16:12:32.958+0800: 188.891: Total time for which application threads were stopped: 0.0004504 seconds, Stopping threads took: 0.0001183 seconds 2024-09-25T16:12:35.958+0800: 191.892: Total time for which application threads were stopped: 0.0004256 seconds, Stopping threads took: 0.0001147 seconds 2024-09-25T16:12:36.959+0800: 192.893: Total time for which application threads were stopped: 0.0005003 seconds, Stopping threads took: 0.0001052 seconds 2024-09-25T16:12:37.960+0800: 193.893: Total time for which application threads were stopped: 0.0004122 seconds, Stopping threads took: 0.0000809 seconds 2024-09-25T16:12:39.960+0800: 195.894: Total time for which application threads were stopped: 0.0004420 seconds, Stopping threads took: 0.0000977 seconds 2024-09-25T16:12:40.961+0800: 196.895: Total time for which application threads were stopped: 0.0003893 seconds, Stopping threads took: 0.0000939 seconds 2024-09-25T16:12:42.962+0800: 198.895: Total time for which application threads were stopped: 0.0004428 seconds, Stopping threads took: 0.0001190 seconds 2024-09-25T16:12:45.963+0800: 201.896: Total time for which application threads were stopped: 0.0004655 seconds, Stopping threads took: 0.0001201 seconds 2024-09-25T16:12:46.963+0800: 202.897: Total time for which application threads were stopped: 0.0004646 seconds, Stopping threads took: 0.0001092 seconds 2024-09-25T16:12:47.964+0800: 203.897: Total time for which application threads were stopped: 0.0004122 seconds, Stopping threads took: 0.0000973 seconds 2024-09-25T16:12:48.990+0800: 204.923: Total time for which application threads were stopped: 0.0257244 seconds, Stopping threads took: 0.0252877 seconds 2024-09-25T16:12:49.990+0800: 205.924: Total time for which application threads were stopped: 0.0004543 seconds, Stopping threads took: 0.0001098 seconds 2024-09-25T16:12:57.992+0800: 213.925: Total time for which application threads were stopped: 0.0004703 seconds, Stopping threads took: 0.0001293 seconds 2024-09-25T16:12:59.992+0800: 215.926: Total time for which application threads were stopped: 0.0003865 seconds, Stopping threads took: 0.0000983 seconds 2024-09-25T16:13:02.993+0800: 218.927: Total time for which application threads were stopped: 0.0004454 seconds, Stopping threads took: 0.0001252 seconds 2024-09-25T16:13:04.994+0800: 220.927: Total time for which application threads were stopped: 0.0003969 seconds, Stopping threads took: 0.0000993 seconds 2024-09-25T16:13:07.995+0800: 223.928: Total time for which application threads were stopped: 0.0005640 seconds, Stopping threads took: 0.0001907 seconds 2024-09-25T16:13:12.996+0800: 228.930: Total time for which application threads were stopped: 0.0005404 seconds, Stopping threads took: 0.0001194 seconds 2024-09-25T16:13:15.997+0800: 231.930: Total time for which application threads were stopped: 0.0004077 seconds, Stopping threads took: 0.0001081 seconds 2024-09-25T16:13:17.998+0800: 233.931: Total time for which application threads were stopped: 0.0004899 seconds, Stopping threads took: 0.0001091 seconds 2024-09-25T16:13:19.998+0800: 235.932: Total time for which application threads were stopped: 0.0004652 seconds, Stopping threads took: 0.0001042 seconds 2024-09-25T16:13:27.000+0800: 242.933: Total time for which application threads were stopped: 0.0005097 seconds, Stopping threads took: 0.0001571 seconds 2024-09-25T16:13:29.000+0800: 244.934: Total time for which application threads were stopped: 0.0005252 seconds, Stopping threads took: 0.0001428 seconds 2024-09-25T16:13:31.001+0800: 246.935: Total time for which application threads were stopped: 0.0004862 seconds, Stopping threads took: 0.0001056 seconds 2024-09-25T16:13:34.021+0800: 249.955: Total time for which application threads were stopped: 0.0191380 seconds, Stopping threads took: 0.0186906 seconds 2024-09-25T16:13:36.022+0800: 251.955: Total time for which application threads were stopped: 0.0005636 seconds, Stopping threads took: 0.0001427 seconds 2024-09-25T16:13:38.022+0800: 253.956: Total time for which application threads were stopped: 0.0004563 seconds, Stopping threads took: 0.0001200 seconds 2024-09-25T16:13:42.023+0800: 257.957: Total time for which application threads were stopped: 0.0004449 seconds, Stopping threads took: 0.0001071 seconds 2024-09-25T16:13:43.024+0800: 258.958: Total time for which application threads were stopped: 0.0005047 seconds, Stopping threads took: 0.0001812 seconds 2024-09-25T16:13:44.025+0800: 259.958: Total time for which application threads were stopped: 0.0004677 seconds, Stopping threads took: 0.0001054 seconds 2024-09-25T16:13:45.025+0800: 260.959: Total time for which application threads were stopped: 0.0004496 seconds, Stopping threads took: 0.0001217 seconds 2024-09-25T16:13:49.026+0800: 264.960: Total time for which application threads were stopped: 0.0004373 seconds, Stopping threads took: 0.0001088 seconds 2024-09-25T16:13:53.027+0800: 268.961: Total time for which application threads were stopped: 0.0005795 seconds, Stopping threads took: 0.0001327 seconds 2024-09-25T16:13:54.028+0800: 269.962: Total time for which application threads were stopped: 0.0004194 seconds, Stopping threads took: 0.0001119 seconds 2024-09-25T16:13:56.029+0800: 271.962: Total time for which application threads were stopped: 0.0005409 seconds, Stopping threads took: 0.0001445 seconds 2024-09-25T16:13:58.030+0800: 273.963: Total time for which application threads were stopped: 0.0005122 seconds, Stopping threads took: 0.0001187 seconds 2024-09-25T16:14:00.030+0800: 275.964: Total time for which application threads were stopped: 0.0005424 seconds, Stopping threads took: 0.0001425 seconds 2024-09-25T16:14:03.031+0800: 278.965: Total time for which application threads were stopped: 0.0004534 seconds, Stopping threads took: 0.0001202 seconds 2024-09-25T16:14:06.032+0800: 281.966: Total time for which application threads were stopped: 0.0004363 seconds, Stopping threads took: 0.0001132 seconds 2024-09-25T16:14:09.033+0800: 284.967: Total time for which application threads were stopped: 0.0004200 seconds, Stopping threads took: 0.0001067 seconds 2024-09-25T16:14:10.034+0800: 285.967: Total time for which application threads were stopped: 0.0004696 seconds, Stopping threads took: 0.0001039 seconds 2024-09-25T16:14:11.034+0800: 286.968: Total time for which application threads were stopped: 0.0005643 seconds, Stopping threads took: 0.0001918 seconds 2024-09-25T16:14:19.036+0800: 294.969: Total time for which application threads were stopped: 0.0004857 seconds, Stopping threads took: 0.0001062 seconds 2024-09-25T16:14:25.037+0800: 300.971: Total time for which application threads were stopped: 0.0005158 seconds, Stopping threads took: 0.0001201 seconds 2024-09-25T16:14:27.038+0800: 302.971: Total time for which application threads were stopped: 0.0004156 seconds, Stopping threads took: 0.0001052 seconds 2024-09-25T16:14:33.039+0800: 308.973: Total time for which application threads were stopped: 0.0005765 seconds, Stopping threads took: 0.0001364 seconds 2024-09-25T16:14:36.040+0800: 311.974: Total time for which application threads were stopped: 0.0004498 seconds, Stopping threads took: 0.0001059 seconds 2024-09-25T16:14:53.043+0800: 328.977: Total time for which application threads were stopped: 0.0004458 seconds, Stopping threads took: 0.0001094 seconds 2024-09-25T16:15:07.045+0800: 342.979: Total time for which application threads were stopped: 0.0005385 seconds, Stopping threads took: 0.0001451 seconds 2024-09-25T16:15:08.046+0800: 343.980: Total time for which application threads were stopped: 0.0004540 seconds, Stopping threads took: 0.0001233 seconds 2024-09-25T16:15:10.047+0800: 345.980: Total time for which application threads were stopped: 0.0004462 seconds, Stopping threads took: 0.0001139 seconds 2024-09-25T16:15:13.047+0800: 348.981: Total time for which application threads were stopped: 0.0004913 seconds, Stopping threads took: 0.0001512 seconds 2024-09-25T16:15:15.048+0800: 350.982: Total time for which application threads were stopped: 0.0004531 seconds, Stopping threads took: 0.0001165 seconds 2024-09-25T16:15:16.049+0800: 351.982: Total time for which application threads were stopped: 0.0004223 seconds, Stopping threads took: 0.0000990 seconds 2024-09-25T16:15:27.051+0800: 362.984: Total time for which application threads were stopped: 0.0004903 seconds, Stopping threads took: 0.0001101 seconds 2024-09-25T16:15:32.052+0800: 367.985: Total time for which application threads were stopped: 0.0004683 seconds, Stopping threads took: 0.0001618 seconds 2024-09-25T16:15:33.052+0800: 368.986: Total time for which application threads were stopped: 0.0005855 seconds, Stopping threads took: 0.0002388 seconds 2024-09-25T16:15:43.054+0800: 378.988: Total time for which application threads were stopped: 0.0004627 seconds, Stopping threads took: 0.0001028 seconds 2024-09-25T16:15:48.055+0800: 383.989: Total time for which application threads were stopped: 0.0005295 seconds, Stopping threads took: 0.0001594 seconds 2024-09-25T16:15:53.057+0800: 388.990: Total time for which application threads were stopped: 0.0005161 seconds, Stopping threads took: 0.0001172 seconds 2024-09-25T16:16:00.058+0800: 395.992: Total time for which application threads were stopped: 0.0005462 seconds, Stopping threads took: 0.0001841 seconds 2024-09-25T16:16:04.059+0800: 399.993: Total time for which application threads were stopped: 0.0004573 seconds, Stopping threads took: 0.0001282 seconds 2024-09-25T16:16:09.060+0800: 404.994: Total time for which application threads were stopped: 0.0004521 seconds, Stopping threads took: 0.0001368 seconds 2024-09-25T16:16:19.062+0800: 414.996: Total time for which application threads were stopped: 0.0004617 seconds, Stopping threads took: 0.0001141 seconds 2024-09-25T16:16:48.066+0800: 444.000: Total time for which application threads were stopped: 0.0004602 seconds, Stopping threads took: 0.0001406 seconds 2024-09-25T16:16:49.067+0800: 445.000: Total time for which application threads were stopped: 0.0005378 seconds, Stopping threads took: 0.0001172 seconds 2024-09-25T16:16:53.068+0800: 449.001: Total time for which application threads were stopped: 0.0004760 seconds, Stopping threads took: 0.0001030 seconds 2024-09-25T16:16:56.069+0800: 452.002: Total time for which application threads were stopped: 0.0005563 seconds, Stopping threads took: 0.0001232 seconds 2024-09-25T16:16:58.070+0800: 454.003: Total time for which application threads were stopped: 0.0005088 seconds, Stopping threads took: 0.0001495 seconds 2024-09-25T16:17:01.070+0800: 457.004: Total time for which application threads were stopped: 0.0004672 seconds, Stopping threads took: 0.0001222 seconds 2024-09-25T16:17:04.071+0800: 460.005: Total time for which application threads were stopped: 0.0004570 seconds, Stopping threads took: 0.0001131 seconds 2024-09-25T16:17:08.072+0800: 464.006: Total time for which application threads were stopped: 0.0004503 seconds, Stopping threads took: 0.0001051 seconds 2024-09-25T16:17:09.073+0800: 465.007: Total time for which application threads were stopped: 0.0005686 seconds, Stopping threads took: 0.0001883 seconds 2024-09-25T16:17:10.074+0800: 466.007: Total time for which application threads were stopped: 0.0005144 seconds, Stopping threads took: 0.0001240 seconds 2024-09-25T16:17:13.075+0800: 469.008: Total time for which application threads were stopped: 0.0005312 seconds, Stopping threads took: 0.0001149 seconds 2024-09-25T16:17:14.075+0800: 470.009: Total time for which application threads were stopped: 0.0004265 seconds, Stopping threads took: 0.0001142 seconds 2024-09-25T16:17:19.076+0800: 475.010: Total time for which application threads were stopped: 0.0004531 seconds, Stopping threads took: 0.0001102 seconds 2024-09-25T16:17:21.077+0800: 477.011: Total time for which application threads were stopped: 0.0005127 seconds, Stopping threads took: 0.0001359 seconds 2024-09-25T16:17:22.078+0800: 478.012: Total time for which application threads were stopped: 0.0005503 seconds, Stopping threads took: 0.0001745 seconds 2024-09-25T16:17:25.079+0800: 481.013: Total time for which application threads were stopped: 0.0005891 seconds, Stopping threads took: 0.0001463 seconds 2024-09-25T16:17:28.080+0800: 484.014: Total time for which application threads were stopped: 0.0005816 seconds, Stopping threads took: 0.0001322 seconds 2024-09-25T16:17:38.082+0800: 494.015: Total time for which application threads were stopped: 0.0004289 seconds, Stopping threads took: 0.0001052 seconds 2024-09-25T16:17:46.083+0800: 502.017: Total time for which application threads were stopped: 0.0004776 seconds, Stopping threads took: 0.0001056 seconds 2024-09-25T16:18:05.086+0800: 521.020: Total time for which application threads were stopped: 0.0006433 seconds, Stopping threads took: 0.0001178 seconds 2024-09-25T16:18:06.087+0800: 522.021: Total time for which application threads were stopped: 0.0004307 seconds, Stopping threads took: 0.0001106 seconds 2024-09-25T16:18:08.088+0800: 524.021: Total time for which application threads were stopped: 0.0005016 seconds, Stopping threads took: 0.0001280 seconds 2024-09-25T16:18:15.089+0800: 531.023: Total time for which application threads were stopped: 0.0004522 seconds, Stopping threads took: 0.0001099 seconds 2024-09-25T16:18:16.090+0800: 532.023: Total time for which application threads were stopped: 0.0004678 seconds, Stopping threads took: 0.0001237 seconds 2024-09-25T16:18:23.091+0800: 539.025: Total time for which application threads were stopped: 0.0005267 seconds, Stopping threads took: 0.0001276 seconds 2024-09-25T16:18:25.092+0800: 541.026: Total time for which application threads were stopped: 0.0004544 seconds, Stopping threads took: 0.0001069 seconds 2024-09-25T16:18:27.093+0800: 543.026: Total time for which application threads were stopped: 0.0004446 seconds, Stopping threads took: 0.0001133 seconds 2024-09-25T16:18:28.093+0800: 544.027: Total time for which application threads were stopped: 0.0005256 seconds, Stopping threads took: 0.0001476 seconds 2024-09-25T16:18:30.094+0800: 546.028: Total time for which application threads were stopped: 0.0005257 seconds, Stopping threads took: 0.0001204 seconds 2024-09-25T16:18:36.095+0800: 552.029: Total time for which application threads were stopped: 0.0005222 seconds, Stopping threads took: 0.0001591 seconds 2024-09-25T16:18:38.096+0800: 554.030: Total time for which application threads were stopped: 0.0004742 seconds, Stopping threads took: 0.0001073 seconds 2024-09-25T16:18:40.097+0800: 556.031: Total time for which application threads were stopped: 0.0004407 seconds, Stopping threads took: 0.0001165 seconds 2024-09-25T16:18:48.099+0800: 564.032: Total time for which application threads were stopped: 0.0006445 seconds, Stopping threads took: 0.0001960 seconds 2024-09-25T16:18:50.100+0800: 566.033: Total time for which application threads were stopped: 0.0006837 seconds, Stopping threads took: 0.0002827 seconds 2024-09-25T16:18:53.101+0800: 569.034: Total time for which application threads were stopped: 0.0005561 seconds, Stopping threads took: 0.0001682 seconds 2024-09-25T16:18:56.101+0800: 572.035: Total time for which application threads were stopped: 0.0004679 seconds, Stopping threads took: 0.0001244 seconds 2024-09-25T16:19:09.104+0800: 585.037: Total time for which application threads were stopped: 0.0004423 seconds, Stopping threads took: 0.0001012 seconds 2024-09-25T16:19:13.105+0800: 589.039: Total time for which application threads were stopped: 0.0006362 seconds, Stopping threads took: 0.0001209 seconds 2024-09-25T16:19:15.106+0800: 591.039: Total time for which application threads were stopped: 0.0006236 seconds, Stopping threads took: 0.0001573 seconds 2024-09-25T16:19:25.108+0800: 601.041: Total time for which application threads were stopped: 0.0004897 seconds, Stopping threads took: 0.0001334 seconds 2024-09-25T16:19:28.109+0800: 604.042: Total time for which application threads were stopped: 0.0005225 seconds, Stopping threads took: 0.0001289 seconds 2024-09-25T16:19:29.132+0800: 605.066: Total time for which application threads were stopped: 0.0234231 seconds, Stopping threads took: 0.0229965 seconds 2024-09-25T16:19:34.133+0800: 610.067: Total time for which application threads were stopped: 0.0004912 seconds, Stopping threads took: 0.0001120 seconds 2024-09-25T16:19:41.135+0800: 617.068: Total time for which application threads were stopped: 0.0004914 seconds, Stopping threads took: 0.0001179 seconds 2024-09-25T16:19:48.136+0800: 624.070: Total time for which application threads were stopped: 0.0004434 seconds, Stopping threads took: 0.0001012 seconds 2024-09-25T16:20:06.139+0800: 642.073: Total time for which application threads were stopped: 0.0005751 seconds, Stopping threads took: 0.0001378 seconds 2024-09-25T16:20:12.140+0800: 648.074: Total time for which application threads were stopped: 0.0005792 seconds, Stopping threads took: 0.0001221 seconds 2024-09-25T16:20:16.142+0800: 652.075: Total time for which application threads were stopped: 0.0005886 seconds, Stopping threads took: 0.0001516 seconds 2024-09-25T16:20:28.144+0800: 664.077: Total time for which application threads were stopped: 0.0005391 seconds, Stopping threads took: 0.0001620 seconds 2024-09-25T16:21:03.149+0800: 699.083: Total time for which application threads were stopped: 0.0005240 seconds, Stopping threads took: 0.0001157 seconds 2024-09-25T16:21:04.150+0800: 700.083: Total time for which application threads were stopped: 0.0005576 seconds, Stopping threads took: 0.0001700 seconds 2024-09-25T16:21:08.151+0800: 704.084: Total time for which application threads were stopped: 0.0004784 seconds, Stopping threads took: 0.0001176 seconds 2024-09-25T16:21:09.151+0800: 705.085: Total time for which application threads were stopped: 0.0004661 seconds, Stopping threads took: 0.0001237 seconds 2024-09-25T16:21:10.152+0800: 706.086: Total time for which application threads were stopped: 0.0004846 seconds, Stopping threads took: 0.0001056 seconds 2024-09-25T16:21:11.152+0800: 707.086: Total time for which application threads were stopped: 0.0004387 seconds, Stopping threads took: 0.0001048 seconds 2024-09-25T16:21:12.153+0800: 708.087: Total time for which application threads were stopped: 0.0004621 seconds, Stopping threads took: 0.0001181 seconds 2024-09-25T16:21:13.154+0800: 709.087: Total time for which application threads were stopped: 0.0005034 seconds, Stopping threads took: 0.0001074 seconds 2024-09-25T16:21:15.154+0800: 711.088: Total time for which application threads were stopped: 0.0004101 seconds, Stopping threads took: 0.0000939 seconds 2024-09-25T16:21:18.155+0800: 714.089: Total time for which application threads were stopped: 0.0004346 seconds, Stopping threads took: 0.0000944 seconds Heap garbage-first heap total 2097152K, used 416539K [0x0000000080000000, 0x0000000081000400, 0x0000000100000000) region size 16384K, 27 young (442368K), 2 survivors (32768K) Metaspace used 30335K, capacity 31508K, committed 31616K, reserved 1077248K class space used 3376K, capacity 3684K, committed 3712K, reserved 1048576K

broker配置： brokerClusterName = DefaultCluster brokerName = broker-a brokerId = 0 deleteWhen = 04 fileReservedTime = 48 brokerRole = ASYNC_MASTER flushDiskType = ASYNC_FLUSH

当前broker监听的IP地址 多网卡的时候需要

brokerIP1 = 127.0.0.1

Broker 对外服务的监听端口

listenPort = 10911

主要用于slave同步master 默认listenPort - 2

fastListenPort = 10909

haService中使用 默认listenPort + 1

haListenPort = 10912

鉴权

aclEnable = true

nameServer地址，分号分割

namesrvAddr = 127.0.0.1:9876

是否允许 Broker 自动创建Topic，建议线下开启，线上关闭

autoCreateTopicEnable = true

是否允许 Broker 自动创建订阅组，建议线下开启，线上关闭

autoCreateSubscriptionGroup = true

在发送消息时，自动创建服务器不存在的topic，默认创建的队列数

defaultTopicQueueNums = 4

Steps to Reproduce

启动 broker后，过一段时间就会异常中止

What Did You Expect to See?

broker进程不被异常关闭

What Did You See Instead?

broker进程总是异常中止

Additional Context

No response