Closed freichelka closed 5 months ago
@freichelka,
Thank you for your request. Unfortunately, this issue is hard to reproduce. To simulate the behavior, we used the following emulator and subscribed the WS client to receive messages with different subscriptions:
docker run --network="host" -e SPARKPLUG_SERVER_URL='tcp://localhost:1883' -e SPARKPLUG_CLIENT_MQTT_USERNAME='tbmq_websockets_username' thingsboard/tb-sparkplug-emulator:latest
Using "#" subscription:
Using "spBv1.0/Sparkplug Group 1/DDATA/Sparkplug Node 1/#" subscription:
Could you please check the logs or include them here to check for potential issues?
@dmytro-landiak
The problem only belongs to DCMD messages from the Sparkplug Application to the Sparkplug Devices. DATA BIRTH and DEATH from Device to Application works fine. I think the general problem is the wildcard combined with the topic prefix.
I tested our implementation with the emulator. It shows the same behavior like our real devices. If there is a NCMD or DCMD Message from Application to Device, it does not arrive at the device. With some other broker (a free one in the internet) it works and i can see the DCMD arriving in the sparkplug emulator.
We can not see something interesing in our log. Maybe there is something for you:
TBMQ1
2024-06-04 15:18:03,686 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:18:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:18:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:18:26,333 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [11] successfulMsgs = [11] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-0] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-1] Average pack size - 1.0, pack processing time - 1.2751785, msg processing time - 0.599038 ms, counters stats: totalMsgs = [2] successfulMsgs = [2] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [2] failedIterations = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-2] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-3] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-0] Average pack size - 1.0, pack processing time - 1.159316 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [3] acceptedSubscriptions = [3] ignoredSubscriptions = [0] 2024-06-04 15:18:26,334 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:18:26,335 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [4] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [3] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [3] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:18:26,335 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [9 | 0.16555077777777777 | 0.573327] UNSUBSCRIBE_COMMAND_MSG = [0 | 0.0] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [0 | 0.0] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [1 | 0.513322] SUBSCRIPTION_CHANGED_EVENT_MSG = [3 | 0.2830543333333333] PUBREC_RESPONSE_MSG = [0 | 0.0] PUBACK_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [5 | 0.038643199999999996] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [0 | 0.0] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [0 | 0.0] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] SUBSCRIBE_COMMAND_MSG = [0 | 0.0] 2024-06-04 15:18:26,335 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [2 | 0.005642] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [2 | 0.004165] notPersistentMessagesProcessing = [2 | 0.387714] persistentMessagesProcessing = [0 | 0.0] delivery = [8 | 0.04928125] 2024-06-04 15:18:26,335 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: msg-all-producer = [0 | 0.0] persisted-downlink-msg-producer-tbmq1 = [0 | 0.0] retained-msg-producer = [0 | 0.0] disconnect-client-command-producer-tbmq1 = [0 | 0.0] historical-data-producer-tbmq1 = [3 | 0.043478333333333334] client-session-event-producer-tbmq1 = [0 | 0.0] application-shared-msg-producer-tbmq1 = [0 | 0.0] basic-downlink-msg-producer-tbmq1 = [2 | 0.0437605] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [1 | 0.082357] application-persisted-msg-producer-tbmq1 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:18:26,336 [TB-Scheduling-3] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq1-0 = [1 | 0.636939] client-session-event-consumer-tbmq1-0 = [1 | 0.661465] basic-downlink-msg-consumer-tbmq1-1 = [1 | 0.939392] device-persisted-msg-consumer-tbmq1-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-1 = [2 | 0.5147505] msg-all-consumer-tbmq1-2 = [0 | 0.0] msg-all-consumer-tbmq1-3 = [0 | 0.0] client-session-event-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-0 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-0 = [0 | 0.0] client-session-event-response-consumer-tbmq1 = [0 | 0.0] client-session-consumer-tbmq1 = [1 | 1.58629] persisted-downlink-msg-consumer-tbmq1-1 = [0 | 0.0] client-subscriptions-consumer-tbmq1 = [1 | 0.700239] disconnect-client-command-consumer-tbmq1 = [0 | 0.0] retained-msg-consumer-tbmq1 = [0 | 0.0] historical-data-consumer-tbmq1 = [2 | 1.5266965] 2024-06-04 15:19:03,686 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:19:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:19:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:19:17,771 [kafka-admin-client-thread | adminclient-1] INFO o.apache.kafka.clients.NetworkClient - [AdminClient clientId=adminclient-1] Node 0 disconnected. 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [11] successfulMsgs = [11] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [1] successfulMsgs = [1] failedMsgs = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-0] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:19:26,336 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-1] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-2] Average pack size - 1.0, pack processing time - 3.9228233333333336, msg processing time - 1.3559156666666667 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-3] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-0] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [0] acceptedSubscriptions = [0] ignoredSubscriptions = [0] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [3] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [3] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [3] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [12 | 3333.5315716666664 | 10000.29383] UNSUBSCRIBE_COMMAND_MSG = [0 | 0.0] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [4 | 0.02122575] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [0 | 0.0] SUBSCRIPTION_CHANGED_EVENT_MSG = [0 | 0.0] PUBREC_RESPONSE_MSG = [1 | 0.228878] PUBACK_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [5 | 0.034767599999999996] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [1 | 0.761199] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [1 | 0.100661] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] SUBSCRIBE_COMMAND_MSG = [0 | 0.0] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [6 | 0.011826] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [6 | 0.006717833333333333] notPersistentMessagesProcessing = [6 | 0.9122218333333334] persistentMessagesProcessing = [0 | 0.0] delivery = [40 | 0.05906] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: msg-all-producer = [1 | 0.100401] persisted-downlink-msg-producer-tbmq1 = [0 | 0.0] retained-msg-producer = [0 | 0.0] disconnect-client-command-producer-tbmq1 = [0 | 0.0] historical-data-producer-tbmq1 = [3 | 0.033229] client-session-event-producer-tbmq1 = [0 | 0.0] application-shared-msg-producer-tbmq1 = [0 | 0.0] basic-downlink-msg-producer-tbmq1 = [6 | 0.11573533333333333] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [0 | 0.0] application-persisted-msg-producer-tbmq1 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:19:26,337 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq1-0 = [6 | 0.8070903333333334] client-session-event-consumer-tbmq1-0 = [0 | 0.0] basic-downlink-msg-consumer-tbmq1-1 = [8 | 0.837236] device-persisted-msg-consumer-tbmq1-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-2 = [6 | 0.9054616666666666] msg-all-consumer-tbmq1-3 = [0 | 0.0] client-session-event-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-0 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-0 = [0 | 0.0] client-session-event-response-consumer-tbmq1 = [0 | 0.0] client-session-consumer-tbmq1 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-1 = [0 | 0.0] client-subscriptions-consumer-tbmq1 = [0 | 0.0] disconnect-client-command-consumer-tbmq1 = [0 | 0.0] retained-msg-consumer-tbmq1 = [0 | 0.0] historical-data-consumer-tbmq1 = [2 | 0.8848605] 2024-06-04 15:20:03,686 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:20:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:20:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:20:26,337 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:20:26,337 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:26,337 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:26,337 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:26,337 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [11] successfulMsgs = [11] failedMsgs = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [1] successfulMsgs = [1] failedMsgs = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-0] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-1] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-2] Average pack size - 1.0, pack processing time - 3.494493, msg processing time - 1.1508366666666667 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-3] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-0] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [0] acceptedSubscriptions = [0] ignoredSubscriptions = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [3] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [3] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [3] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [7 | 0.07976928571428571 | 0.156469] UNSUBSCRIBE_COMMAND_MSG = [0 | 0.0] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [0 | 0.0] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [0 | 0.0] SUBSCRIPTION_CHANGED_EVENT_MSG = [0 | 0.0] PUBREC_RESPONSE_MSG = [1 | 0.145848] PUBACK_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [4 | 0.0317865] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [1 | 0.589113] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [1 | 0.046826] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] SUBSCRIBE_COMMAND_MSG = [0 | 0.0] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [6 | 0.011572666666666667] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [6 | 0.015556166666666666] notPersistentMessagesProcessing = [6 | 0.7291405] persistentMessagesProcessing = [0 | 0.0] delivery = [40 | 0.0957253] 2024-06-04 15:20:26,338 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: msg-all-producer = [1 | 0.197624] persisted-downlink-msg-producer-tbmq1 = [0 | 0.0] retained-msg-producer = [0 | 0.0] disconnect-client-command-producer-tbmq1 = [0 | 0.0] historical-data-producer-tbmq1 = [3 | 0.03806866666666667] client-session-event-producer-tbmq1 = [0 | 0.0] application-shared-msg-producer-tbmq1 = [0 | 0.0] basic-downlink-msg-producer-tbmq1 = [6 | 0.0826825] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [0 | 0.0] application-persisted-msg-producer-tbmq1 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:20:26,339 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq1-0 = [6 | 0.8000398333333334] client-session-event-consumer-tbmq1-0 = [0 | 0.0] basic-downlink-msg-consumer-tbmq1-1 = [8 | 0.88459225] device-persisted-msg-consumer-tbmq1-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-2 = [6 | 1.0208931666666665] msg-all-consumer-tbmq1-3 = [0 | 0.0] client-session-event-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-0 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-0 = [0 | 0.0] client-session-event-response-consumer-tbmq1 = [0 | 0.0] client-session-consumer-tbmq1 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-1 = [0 | 0.0] client-subscriptions-consumer-tbmq1 = [0 | 0.0] disconnect-client-command-consumer-tbmq1 = [0 | 0.0] retained-msg-consumer-tbmq1 = [0 | 0.0] historical-data-consumer-tbmq1 = [2 | 0.976988] 2024-06-04 15:21:03,686 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:21:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:21:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:26,339 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [11] successfulMsgs = [11] failedMsgs = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-0] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-1] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-2] Average pack size - 1.0, pack processing time - 3.6988505, msg processing time - 1.299858 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-3] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-0] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [0] acceptedSubscriptions = [0] ignoredSubscriptions = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [3] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [3] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [3] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [5 | 0.0906928 | 0.125635] UNSUBSCRIBE_COMMAND_MSG = [0 | 0.0] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [0 | 0.0] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [0 | 0.0] SUBSCRIPTION_CHANGED_EVENT_MSG = [0 | 0.0] PUBREC_RESPONSE_MSG = [0 | 0.0] PUBACK_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [5 | 0.0434466] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [0 | 0.0] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [0 | 0.0] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] SUBSCRIBE_COMMAND_MSG = [0 | 0.0] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [6 | 0.011221333333333333] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [6 | 0.008935] notPersistentMessagesProcessing = [6 | 0.8703088333333334] persistentMessagesProcessing = [0 | 0.0] delivery = [38 | 0.06788723684210526] 2024-06-04 15:21:26,340 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: msg-all-producer = [0 | 0.0] persisted-downlink-msg-producer-tbmq1 = [0 | 0.0] retained-msg-producer = [0 | 0.0] disconnect-client-command-producer-tbmq1 = [0 | 0.0] historical-data-producer-tbmq1 = [3 | 0.03582933333333334] client-session-event-producer-tbmq1 = [0 | 0.0] application-shared-msg-producer-tbmq1 = [0 | 0.0] basic-downlink-msg-producer-tbmq1 = [6 | 0.1893155] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [0 | 0.0] application-persisted-msg-producer-tbmq1 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:21:26,341 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq1-0 = [6 | 0.860203] client-session-event-consumer-tbmq1-0 = [0 | 0.0] basic-downlink-msg-consumer-tbmq1-1 = [7 | 1.070166] device-persisted-msg-consumer-tbmq1-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-2 = [6 | 0.9143588333333333] msg-all-consumer-tbmq1-3 = [0 | 0.0] client-session-event-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-0 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-0 = [0 | 0.0] client-session-event-response-consumer-tbmq1 = [0 | 0.0] client-session-consumer-tbmq1 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-1 = [0 | 0.0] client-subscriptions-consumer-tbmq1 = [0 | 0.0] disconnect-client-command-consumer-tbmq1 = [0 | 0.0] retained-msg-consumer-tbmq1 = [0 | 0.0] historical-data-consumer-tbmq1 = [2 | 0.4728265] 2024-06-04 15:22:03,686 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:22:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:22:03,687 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:26,341 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [11] successfulMsgs = [11] failedMsgs = [0] 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-0] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-1] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-2] Average pack size - 1.0, pack processing time - 3.1553961666666663, msg processing time - 1.0241005 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-3] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-0] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [0] acceptedSubscriptions = [0] ignoredSubscriptions = [0] 2024-06-04 15:22:26,342 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:22:26,343 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [3] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [3] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [3] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:22:26,343 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [5 | 0.1887924 | 0.578228] UNSUBSCRIBE_COMMAND_MSG = [0 | 0.0] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [0 | 0.0] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [0 | 0.0] SUBSCRIPTION_CHANGED_EVENT_MSG = [0 | 0.0] PUBREC_RESPONSE_MSG = [0 | 0.0] PUBACK_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [5 | 0.039916400000000005] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [0 | 0.0] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [0 | 0.0] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] SUBSCRIBE_COMMAND_MSG = [0 | 0.0] 2024-06-04 15:22:26,343 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [6 | 0.04164333333333334] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [6 | 0.008109833333333333] notPersistentMessagesProcessing = [6 | 0.6518055] persistentMessagesProcessing = [0 | 0.0] delivery = [38 | 0.050581] 2024-06-04 15:22:26,343 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: msg-all-producer = [0 | 0.0] persisted-downlink-msg-producer-tbmq1 = [0 | 0.0] retained-msg-producer = [0 | 0.0] disconnect-client-command-producer-tbmq1 = [0 | 0.0] historical-data-producer-tbmq1 = [3 | 0.026918] client-session-event-producer-tbmq1 = [0 | 0.0] application-shared-msg-producer-tbmq1 = [0 | 0.0] basic-downlink-msg-producer-tbmq1 = [6 | 0.089583] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [0 | 0.0] application-persisted-msg-producer-tbmq1 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:22:26,343 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq1-0 = [6 | 1.4318671666666667] client-session-event-consumer-tbmq1-0 = [0 | 0.0] basic-downlink-msg-consumer-tbmq1-1 = [7 | 0.9457998571428572] device-persisted-msg-consumer-tbmq1-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-2 = [6 | 1.0675268333333332] msg-all-consumer-tbmq1-3 = [0 | 0.0] client-session-event-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-0 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-0 = [0 | 0.0] client-session-event-response-consumer-tbmq1 = [0 | 0.0] client-session-consumer-tbmq1 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-1 = [0 | 0.0] client-subscriptions-consumer-tbmq1 = [0 | 0.0] disconnect-client-command-consumer-tbmq1 = [0 | 0.0] retained-msg-consumer-tbmq1 = [0 | 0.0] historical-data-consumer-tbmq1 = [1 | 0.809542] 2024-06-04 15:23:03,686 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:23:03,686 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:23:03,686 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:23:26,343 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:23:26,343 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:26,343 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:26,343 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [11] successfulMsgs = [11] failedMsgs = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [1] successfulMsgs = [1] failedMsgs = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-0] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-1] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-2] Average pack size - 1.0, pack processing time - 4.620095166666667, msg processing time - 1.910908 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq1-3] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-0] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq1-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq1-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [0] acceptedSubscriptions = [0] ignoredSubscriptions = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:23:26,344 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [3] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [3] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [3] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:23:26,345 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [8 | 0.097901125 | 0.193735] UNSUBSCRIBE_COMMAND_MSG = [0 | 0.0] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [0 | 0.0] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [0 | 0.0] SUBSCRIPTION_CHANGED_EVENT_MSG = [0 | 0.0] PUBREC_RESPONSE_MSG = [1 | 0.234783] PUBACK_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [5 | 0.0419268] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [1 | 0.684201] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [1 | 0.073911] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] SUBSCRIBE_COMMAND_MSG = [0 | 0.0] 2024-06-04 15:23:26,345 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [6 | 0.011587833333333334] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [6 | 0.006862333333333333] notPersistentMessagesProcessing = [6 | 0.7941043333333334] persistentMessagesProcessing = [0 | 0.0] delivery = [38 | 0.08166007894736843] 2024-06-04 15:23:26,345 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: msg-all-producer = [1 | 0.16897] persisted-downlink-msg-producer-tbmq1 = [0 | 0.0] retained-msg-producer = [0 | 0.0] disconnect-client-command-producer-tbmq1 = [0 | 0.0] historical-data-producer-tbmq1 = [3 | 0.030041] client-session-event-producer-tbmq1 = [0 | 0.0] application-shared-msg-producer-tbmq1 = [0 | 0.0] basic-downlink-msg-producer-tbmq1 = [6 | 0.101654] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [0 | 0.0] application-persisted-msg-producer-tbmq1 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:23:26,345 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq1-0 = [6 | 0.822911] client-session-event-consumer-tbmq1-0 = [0 | 0.0] basic-downlink-msg-consumer-tbmq1-1 = [7 | 0.7645532857142857] device-persisted-msg-consumer-tbmq1-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-2 = [6 | 0.9802268333333334] msg-all-consumer-tbmq1-3 = [0 | 0.0] client-session-event-consumer-tbmq1-1 = [0 | 0.0] msg-all-consumer-tbmq1-0 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-0 = [0 | 0.0] client-session-event-response-consumer-tbmq1 = [0 | 0.0] client-session-consumer-tbmq1 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq1-1 = [0 | 0.0] client-subscriptions-consumer-tbmq1 = [0 | 0.0] disconnect-client-command-consumer-tbmq1 = [0 | 0.0] retained-msg-consumer-tbmq1 = [0 | 0.0] historical-data-consumer-tbmq1 = [2 | 0.7626725]
TBMQ2
2024-06-04 15:20:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:20:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:20:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [3] successfulMsgs = [3] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [2] successfulMsgs = [2] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [19] successfulMsgs = [19] failedMsgs = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-0] Average pack size - 1.0, pack processing time - 3.1493891666666665, msg processing time - 0.9251943333333333 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-1] Average pack size - 1.0, pack processing time - 5.97326, msg processing time - 2.004616 ms, counters stats: totalMsgs = [1] successfulMsgs = [1] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [1] failedIterations = [0] 2024-06-04 15:20:25,648 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-2] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:20:25,649 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-3] Average pack size - 1.0, pack processing time - 2.3125875714285713, msg processing time - 1.0324751428571428 ms, counters stats: totalMsgs = [7] successfulMsgs = [7] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [7] failedIterations = [0] 2024-06-04 15:20:25,649 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq2-0] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:20:25,649 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq2-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:20:25,649 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq2-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:20:25,649 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq2-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:20:25,649 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [0] acceptedSubscriptions = [0] ignoredSubscriptions = [0] 2024-06-04 15:20:25,649 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:20:25,650 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [4] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [4] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [2] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:20:25,650 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [23 | 0.16241752173913043 | 0.608679] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [0 | 0.0] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [0 | 0.0] SUBSCRIPTION_CHANGED_EVENT_MSG = [0 | 0.0] PUBACK_RESPONSE_MSG = [0 | 0.0] PUBREC_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [4 | 0.0310295] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [19 | 0.17280468421052633] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [0 | 0.0] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] 2024-06-04 15:20:25,650 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [14 | 0.013448714285714286] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [14 | 0.007755642857142857] notPersistentMessagesProcessing = [14 | 0.5831055] persistentMessagesProcessing = [0 | 0.0] delivery = [20 | 0.056849050000000005] 2024-06-04 15:20:25,650 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: application-shared-msg-producer-tbmq2 = [0 | 0.0] msg-all-producer = [19 | 0.052809210526315785] retained-msg-producer = [0 | 0.0] historical-data-producer-tbmq2 = [3 | 0.028157333333333333] client-session-event-producer-tbmq2 = [0 | 0.0] disconnect-client-command-producer-tbmq2 = [0 | 0.0] basic-downlink-msg-producer-tbmq2 = [28 | 0.036327571428571424] persisted-downlink-msg-producer-tbmq2 = [0 | 0.0] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [0 | 0.0] application-persisted-msg-producer-tbmq2 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:20:25,650 [TB-Scheduling-2] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq2-1 = [0 | 0.0] basic-downlink-msg-consumer-tbmq2-0 = [6 | 0.7716111666666666] device-persisted-msg-consumer-tbmq2-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-0 = [6 | 0.8734271666666666] persisted-downlink-msg-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-1 = [1 | 1.371112] msg-all-consumer-tbmq2-2 = [0 | 0.0] msg-all-consumer-tbmq2-3 = [7 | 0.8907874285714286] client-session-event-consumer-tbmq2-0 = [0 | 0.0] client-session-event-consumer-tbmq2-1 = [0 | 0.0] client-session-consumer-tbmq2 = [0 | 0.0] client-session-event-response-consumer-tbmq2 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq2-0 = [0 | 0.0] client-subscriptions-consumer-tbmq2 = [0 | 0.0] disconnect-client-command-consumer-tbmq2 = [0 | 0.0] retained-msg-consumer-tbmq2 = [0 | 0.0] historical-data-consumer-tbmq2 = [0 | 0.0] 2024-06-04 15:21:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:21:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:21:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [3] successfulMsgs = [3] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [2] successfulMsgs = [2] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [19] successfulMsgs = [19] failedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-0] Average pack size - 1.0, pack processing time - 3.9817026666666666, msg processing time - 1.0639035 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-1] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-2] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-3] Average pack size - 1.0, pack processing time - 2.9189301428571426, msg processing time - 1.2797567142857142 ms, counters stats: totalMsgs = [7] successfulMsgs = [7] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [7] failedIterations = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq2-0] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq2-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq2-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq2-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [0] acceptedSubscriptions = [0] ignoredSubscriptions = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [4] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [4] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [2] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [22 | 0.13496368181818183 | 0.452209] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [0 | 0.0] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [0 | 0.0] SUBSCRIPTION_CHANGED_EVENT_MSG = [0 | 0.0] PUBACK_RESPONSE_MSG = [0 | 0.0] PUBREC_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [3 | 0.024815666666666666] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [19 | 0.15126215789473685] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [0 | 0.0] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [13 | 0.01801453846153846] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [13 | 0.007531153846153845] notPersistentMessagesProcessing = [13 | 0.6992612307692307] persistentMessagesProcessing = [0 | 0.0] delivery = [19 | 0.06457673684210526] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: application-shared-msg-producer-tbmq2 = [0 | 0.0] msg-all-producer = [19 | 0.04615926315789474] retained-msg-producer = [0 | 0.0] historical-data-producer-tbmq2 = [3 | 0.016838] client-session-event-producer-tbmq2 = [0 | 0.0] disconnect-client-command-producer-tbmq2 = [0 | 0.0] basic-downlink-msg-producer-tbmq2 = [26 | 0.05023765384615384] persisted-downlink-msg-producer-tbmq2 = [0 | 0.0] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [0 | 0.0] application-persisted-msg-producer-tbmq2 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:21:25,651 [TB-Scheduling-1] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq2-1 = [0 | 0.0] basic-downlink-msg-consumer-tbmq2-0 = [6 | 3.0040298333333335] device-persisted-msg-consumer-tbmq2-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-0 = [6 | 1.2482291666666667] persisted-downlink-msg-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-2 = [0 | 0.0] msg-all-consumer-tbmq2-3 = [7 | 1.1110467142857143] client-session-event-consumer-tbmq2-0 = [0 | 0.0] client-session-event-consumer-tbmq2-1 = [0 | 0.0] client-session-consumer-tbmq2 = [0 | 0.0] client-session-event-response-consumer-tbmq2 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq2-0 = [0 | 0.0] client-subscriptions-consumer-tbmq2 = [0 | 0.0] disconnect-client-command-consumer-tbmq2 = [0 | 0.0] retained-msg-consumer-tbmq2 = [0 | 0.0] historical-data-consumer-tbmq2 = [0 | 0.0] 2024-06-04 15:22:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:22:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:22:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [3] successfulMsgs = [3] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [2] successfulMsgs = [2] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [19] successfulMsgs = [19] failedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-0] Average pack size - 1.0, pack processing time - 3.1282408333333334, msg processing time - 0.8891055 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-1] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-2] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-3] Average pack size - 1.0, pack processing time - 2.7387517142857143, msg processing time - 1.394491 ms, counters stats: totalMsgs = [7] successfulMsgs = [7] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [7] failedIterations = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq2-0] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq2-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq2-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq2-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [0] acceptedSubscriptions = [0] ignoredSubscriptions = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [4] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [4] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [2] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [22 | 0.18222404545454543 | 0.88759] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [0 | 0.0] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [0 | 0.0] SUBSCRIPTION_CHANGED_EVENT_MSG = [0 | 0.0] PUBACK_RESPONSE_MSG = [0 | 0.0] PUBREC_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [3 | 0.030471666666666668] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [19 | 0.14459136842105264] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [0 | 0.0] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [13 | 0.009776384615384616] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [13 | 0.007805] notPersistentMessagesProcessing = [13 | 0.7302637692307693] persistentMessagesProcessing = [0 | 0.0] delivery = [19 | 0.038856736842105256] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: application-shared-msg-producer-tbmq2 = [0 | 0.0] msg-all-producer = [19 | 0.046649947368421055] retained-msg-producer = [0 | 0.0] historical-data-producer-tbmq2 = [3 | 0.020990333333333333] client-session-event-producer-tbmq2 = [0 | 0.0] disconnect-client-command-producer-tbmq2 = [0 | 0.0] basic-downlink-msg-producer-tbmq2 = [26 | 0.038515653846153845] persisted-downlink-msg-producer-tbmq2 = [0 | 0.0] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [0 | 0.0] application-persisted-msg-producer-tbmq2 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:22:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq2-1 = [0 | 0.0] basic-downlink-msg-consumer-tbmq2-0 = [6 | 0.8701235] device-persisted-msg-consumer-tbmq2-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-0 = [6 | 1.0947813333333332] persisted-downlink-msg-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-2 = [0 | 0.0] msg-all-consumer-tbmq2-3 = [7 | 0.9989968571428571] client-session-event-consumer-tbmq2-0 = [0 | 0.0] client-session-event-consumer-tbmq2-1 = [0 | 0.0] client-session-consumer-tbmq2 = [0 | 0.0] client-session-event-response-consumer-tbmq2 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq2-0 = [0 | 0.0] client-subscriptions-consumer-tbmq2 = [0 | 0.0] disconnect-client-command-consumer-tbmq2 = [0 | 0.0] retained-msg-consumer-tbmq2 = [0 | 0.0] historical-data-consumer-tbmq2 = [0 | 0.0] 2024-06-04 15:23:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [packetIdAndSerialNumber]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:23:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [mqttClientCredentials]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:23:03,981 [redis-cache-stats-33-thread-1] INFO o.t.m.b.cache.TbRedisStatsLogger - Redis [basicCredentialsPassword]: hit rate [1.0] hits [0] misses [0] puts [0] deletes [0] 2024-06-04 15:23:25,652 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - ---------------------------------------------------------------- 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.UpdatePacketTypeQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_0] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.DeletePacketQueue_queueIndex_2] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_0] Stats: totalMsgs = [3] successfulMsgs = [3] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_1] Stats: totalMsgs = [0] successfulMsgs = [0] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [sqlQueue.TimeseriesQueue_queueIndex_2] Stats: totalMsgs = [2] successfulMsgs = [2] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.published] Stats: totalMsgs = [18] successfulMsgs = [18] failedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-0] Average pack size - 1.0, pack processing time - 4.493502, msg processing time - 1.3640155 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-1] Average pack size - 1.0, pack processing time - 4.763114, msg processing time - 1.565435 ms, counters stats: totalMsgs = [1] successfulMsgs = [1] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [1] failedIterations = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-2] Average pack size - NaN, pack processing time - 0.0, msg processing time - 0.0 ms, counters stats: totalMsgs = [0] successfulMsgs = [0] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [incomingPublishMsg.consumed][tbmq2-3] Average pack size - 1.0, pack processing time - 2.5292543333333333, msg processing time - 1.3381155 ms, counters stats: totalMsgs = [6] successfulMsgs = [6] timeoutMsgs = [0] failedMsgs = [0] tmpTimeout = [0] tmpFailed = [0] successfulIterations = [6] failedIterations = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq2-0] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSessionEvent][tbmq2-1] Average pack size - NaN, pack processing time - 0.0 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq2-0] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [deviceProcessor][tbmq2-1] Stats: successfulMsgs = [0] failedMsgs = [0] tmpFailed = [0] successfulIterations = [0] failedIterations = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [clientSubscriptionsConsumer] Stats: totalSubscriptions = [0] acceptedSubscriptions = [0] ignoredSubscriptions = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - [retainedMsgConsumer] Stats: totalRetainedMsgs = [0] newRetainedMsgs = [0] clearedRetainedMsgs = [0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Gauges Stats: runningActors = [4] subscriptionTopicTrieSize = [22] subscriptionTrieNodes = [31] connectedSessions = [4] activeAppProcessors = [0] activeSharedAppProcessors = [0] retainMsgTrieSize = [2] retainMsgTrieNodes = [3] lastWillClients = [2] allClientSessions = [7] clientSubscriptions = [7] retainedMessages = [2] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Client Actor Average Stats: msgInQueueTime = [23 | 0.24483808695652173 | 1.127327] SESSION_DISCONNECTED_MSG = [0 | 0.0] STOP_ACTOR_COMMAND_MSG = [0 | 0.0] MQTT_PUBACK_MSG = [0 | 0.0] CLEAR_SESSION_MSG = [0 | 0.0] CONNECTION_REQUEST_MSG = [0 | 0.0] SUBSCRIPTION_CHANGED_EVENT_MSG = [0 | 0.0] PUBACK_RESPONSE_MSG = [0 | 0.0] PUBREC_RESPONSE_MSG = [0 | 0.0] MQTT_CONNECT_MSG = [0 | 0.0] MQTT_PING_MSG = [5 | 0.0332856] MQTT_PUBREC_MSG = [0 | 0.0] SESSION_INIT_MSG = [0 | 0.0] MQTT_PUBLISH_MSG = [18 | 0.2128186111111111] DISCONNECT_MSG = [0 | 0.0] MQTT_PUBCOMP_MSG = [0 | 0.0] MQTT_PUBREL_MSG = [0 | 0.0] CONNECTION_ACCEPTED_MSG = [0 | 0.0] MQTT_SUBSCRIBE_MSG = [0 | 0.0] MQTT_UNSUBSCRIBE_MSG = [0 | 0.0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Timer Average Stats: subscriptionLookup = [13 | 0.019447846153846152] retainedMsgLookup = [0 | 0.0] clientSessionsLookup = [13 | 0.009588] notPersistentMessagesProcessing = [13 | 0.8258063076923078] persistentMessagesProcessing = [0 | 0.0] delivery = [19 | 0.08543552631578948] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Producer Send Time Average Stats: application-shared-msg-producer-tbmq2 = [0 | 0.0] msg-all-producer = [18 | 0.05534072222222222] retained-msg-producer = [0 | 0.0] historical-data-producer-tbmq2 = [3 | 0.033112] client-session-event-producer-tbmq2 = [0 | 0.0] disconnect-client-command-producer-tbmq2 = [0 | 0.0] basic-downlink-msg-producer-tbmq2 = [26 | 0.05094373076923077] persisted-downlink-msg-producer-tbmq2 = [0 | 0.0] device-persisted-msg-producer = [0 | 0.0] client-session-producer = [0 | 0.0] application-persisted-msg-producer-tbmq2 = [0 | 0.0] client-subscriptions-producer = [0 | 0.0] 2024-06-04 15:23:25,653 [TB-Scheduling-4] INFO o.t.m.b.s.stats.StatsManagerImpl - Queue Consumer Commit Time Average Stats: basic-downlink-msg-consumer-tbmq2-1 = [0 | 0.0] basic-downlink-msg-consumer-tbmq2-0 = [6 | 0.8896461666666666] device-persisted-msg-consumer-tbmq2-0 = [0 | 0.0] device-persisted-msg-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-0 = [6 | 1.1660031666666668] persisted-downlink-msg-consumer-tbmq2-1 = [0 | 0.0] msg-all-consumer-tbmq2-1 = [1 | 0.912984] msg-all-consumer-tbmq2-2 = [0 | 0.0] msg-all-consumer-tbmq2-3 = [6 | 0.8796083333333333] client-session-event-consumer-tbmq2-0 = [0 | 0.0] client-session-event-consumer-tbmq2-1 = [0 | 0.0] client-session-consumer-tbmq2 = [0 | 0.0] client-session-event-response-consumer-tbmq2 = [0 | 0.0] persisted-downlink-msg-consumer-tbmq2-0 = [0 | 0.0] client-subscriptions-consumer-tbmq2 = [0 | 0.0] disconnect-client-command-consumer-tbmq2 = [0 | 0.0] retained-msg-consumer-tbmq2 = [0 | 0.0] historical-data-consumer-tbmq2 = [0 | 0.0]
@freichelka,
Thank you for the response. Indeed, nothing special can be seen in the logs.
is it a local deployment or a cloud one? Maybe I can receive access to the environment to investigate deeper?
Do you have similar problems with wildcard subscriptions with regular messages that are not Sparkplug-specific?
@dmytro-landiak
Both are in a Cloud. I could give You access to the server. How can we get in touch?
I tested a bit with some other topics. I subscribe e.g "Test/Topic/#". I receive messages from "Test/Topic/123" or "Test/Topic/456" but not from "Test/Topic". In my opinion the same behavior, only other names.
Then I tried the same thing like you with the websockets client, but with my tcp client. So I subsrcibed "spBv1.0/Sparkplug Group 1/NDATA/Sparkplug Node 1/#" and NDATA (replaced with my groud device name). I received DDATA, but no NDATA (maybe same issue like with NCMD).
Please note: I was not ablte to test it with the WS-client. All tests was done with MQTT-Explorer. We disabled WS in our deployments. Does it make sense to reactivate it just for testing?
Hey @freichelka!
Upon reviewing your latest message, I now fully understand the problem you've encountered. Somehow I misunderstood it at the beginning.
It appears there is indeed a bug in the subscription logic regarding the case you described. We appreciate you bringing this to our attention. We are currently working on a fix. The PR for the fix will be referencing this issue.
If you have any more questions, please let me know. Best regards!
@dmytro-landiak
Thanks, have a nice weekend!
Describe the bug We use TBMQ for connecting Sparkplug B devices in two different environments. The devices subscribe to retained and non-retained topics. The retained topics convey the status of the "Primary Application." The non-retained topics are used to send commands to the devices (NCMD). For example, the device subscribes to "spBv1.0/{group ID}/NCMD/{device ID}/#". All subscriptions are made with QoS 1.
The messages of the non-retained topics are not delivered to the device.
Using a test client, I tried to replicate what is happening at the MQTT level. There, I observed that when I subscribe to "#", the messages arrive at the client. When I subscribe to "spBv1.0/{group ID}/NCMD/{device ID}/#", nothing arrives. When I subscribe to "spBv1.0/{group ID}/NCMD/{device ID}", the messages arrive.
In my opinion, there is a bug here.
Your Server Environment
Your Client Environment
Your Device
To Reproduce see description