search

milvus-io / milvus

A cloud-native vector database, storage for next generation AI applications
https://milvus.io
Apache License 2.0
30.08k stars 2.88k forks source link

[Bug]: Milvus connection error #27297

Closed Alokcoder closed 11 months ago

Alokcoder commented 1 year ago

Is there an existing issue for this?

Environment

- Milvus version:2
- Deployment mode(standalone or cluster):
- MQ type(rocksmq, pulsar or kafka):    
- SDK version(e.g. pymilvus v2.0.0rc2):2
- OS(Ubuntu or CentOS): 
- CPU/Memory: 16gb
- GPU: 6gb
- Others:

Current Behavior

im not able to connect with Milvus

Expected Behavior

connection successful

Steps To Reproduce

No response

Milvus Log

2023-09-21 09:16:34 milvus-standalone | [2023/09/21 09:16:34.677 +00:00] [INFO] [datacoord/server.go:827] ["received datanode register"] [address=172.18.0.4:21124] [serverID=1] 2023-09-21 09:16:34 milvus-standalone | [2023/09/21 09:16:34.677 +00:00] [INFO] [datacoord/channel_manager.go:348] ["register node with no reassignment"] ["registered node"=1] 2023-09-21 09:16:34 milvus-standalone | [2023/09/21 09:16:34.678 +00:00] [WARN] [sessionutil/session_util.go:373] ["fail to get the session key from the etcd"] [] 2023-09-21 09:16:34 milvus-standalone | [2023/09/21 09:16:34.678 +00:00] [INFO] [datanode/service.go:198] ["DataNode gRPC services successfully started"] 2023-09-21 09:16:34 milvus-standalone | [2023/09/21 09:16:34.678 +00:00] [DEBUG] [components/data_node.go:56] ["Datanode successfully started"] 2023-09-21 09:16:34 milvus-standalone | [2023/09/21 09:16:34.682 +00:00] [INFO] [sessionutil/session_util.go:841] ["register session success"] [role=querycoord] [key=by-dev/meta/session/querycoord] 2023-09-21 09:16:34 milvus-standalone | [2023/09/21 09:16:34.682 +00:00] [INFO] [sessionutil/session_util.go:841] ["register session success"] [role=datanode] [key=by-dev/meta/session/datanode-1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.083 +00:00] [DEBUG] [sessionutil/session_util.go:559] ["SessionUtil GetSessions "] [prefix=querycoord] [key=querycoord] [address=172.18.0.4:19531] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.084 +00:00] [DEBUG] [proxy/service.go:593] ["Proxy wait for QueryCoord to be healthy done"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.084 +00:00] [DEBUG] [proxy/service.go:595] ["set QueryCoord client for Proxy"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.084 +00:00] [DEBUG] [proxy/service.go:597] ["set QueryCoord client for Proxy done"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.084 +00:00] [DEBUG] [proxy/service.go:599] ["update Proxy's state to Initializing"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.084 +00:00] [DEBUG] [proxy/service.go:602] ["init Proxy"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.084 +00:00] [INFO] [proxy/proxy.go:190] ["init session for Proxy"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.084 +00:00] [DEBUG] [sessionutil/session_util.go:225] ["Session try to connect to etcd"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.084 +00:00] [DEBUG] [sessionutil/session_util.go:240] ["Session connect to etcd success"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.087 +00:00] [DEBUG] [sessionutil/session_util.go:283] [getServerID] [reuse=true] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.087 +00:00] [INFO] [sessionutil/session_util.go:257] ["start server"] [name=proxy] [address=172.18.0.4:19529] [id=1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.087 +00:00] [INFO] [proxy/proxy.go:195] ["init session for Proxy done"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.087 +00:00] [INFO] [dependency/factory.go:83] ["try to init mq"] [standalone=true] [mqType=rocksmq] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.087 +00:00] [INFO] [msgstream/mq_factory.go:17] ["init rocksmq msgstream success"] [path=/var/lib/milvus/rdb_data] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.087 +00:00] [INFO] [accesslog/log_writer.go:74] ["Access log save to /tmp/milvus_accesslog"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.087 +00:00] [INFO] [accesslog/log_writer.go:260] ["start time rotating of access log"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [DEBUG] [proxy/proxy.go:200] ["init access log for Proxy done"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [INFO] [proxy/proxy.go:206] ["Proxy init rateCollector done"] [nodeID=1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [DEBUG] [proxy/proxy.go:216] ["create id allocator done"] [role=proxy] [ProxyID=1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [DEBUG] [proxy/proxy.go:226] ["create timestamp allocator done"] [role=proxy] [ProxyID=1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [DEBUG] [proxy/proxy.go:237] ["create segment id assigner done"] [role=proxy] [ProxyID=1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [DEBUG] [proxy/proxy.go:242] ["create channels manager done"] [role=proxy] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [DEBUG] [proxy/proxy.go:249] ["create task scheduler done"] [role=proxy] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [DEBUG] [proxy/proxy.go:253] ["create channels time ticker done"] [role=proxy] [syncTimeTickInterval=100ms] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [DEBUG] [proxy/proxy.go:256] ["create metrics cache manager done"] [role=proxy] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.088 +00:00] [DEBUG] [rootcoord/service.go:507] [PolicyList] [role=rootcoord] [in=] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [rootcoord/service.go:507] ["PolicyList success"] [role=rootcoord] [in=] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [INFO] [proxy/meta_cache.go:226] ["success to init meta cache"] [policy_infos="[\"{\\"PType\\":\\"p\\",\\"V0\\":\\"public\\",\\"V1\\":\\"Collection-.\\",\\"V2\\":\\"PrivilegeIndexDetail\\"}\",\"{\\"PType\\":\\"p\\",\\"V0\\":\\"public\\",\\"V1\\":\\"Global-.\\",\\"V2\\":\\"PrivilegeDescribeCollection\\"}\",\"{\\"PType\\":\\"p\\",\\"V0\\":\\"public\\",\\"V1\\":\\"Global-.\\",\\"V2\\":\\"PrivilegeShowCollections\\"}\"]"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [proxy/proxy.go:262] ["init meta cache done"] [role=proxy] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [proxy/service.go:607] ["init Proxy done"] 2023-09-21 09:16:35 milvus-standalone | ---Milvus Proxy successfully initialized and ready to serve!--- 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [proxy/service.go:359] ["init Proxy server done"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [proxy/service.go:361] ["start Proxy server"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [proxy/proxy.go:354] ["start task scheduler done"] [role=proxy] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [proxy/proxy.go:360] ["start id allocator done"] [role=proxy] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [proxy/proxy.go:366] ["start segment id assigner done"] [role=proxy] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [proxy/proxy.go:372] ["start channels time ticker done"] [role=proxy] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [proxy/proxy.go:381] ["update state code"] [role=proxy] [State=Healthy] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.090 +00:00] [DEBUG] [sessionutil/session_util.go:404] ["service begin to register to etcd"] [serverName=proxy] [ServerID=1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.095 +00:00] [INFO] [sessionutil/session_util.go:434] ["put session key into etcd"] [key=by-dev/meta/session/proxy-1] [value="{\"ServerID\":1,\"ServerName\":\"proxy\",\"Address\":\"172.18.0.4:19529\",\"TriggerKill\":true,\"Version\":\"2.3.0\"}"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.095 +00:00] [DEBUG] [rootcoord/proxy_manager.go:157] ["received proxy put event with session"] [session="Session:<ServerID: 1, ServerName: proxy, Version: 2.3.0>"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.095 +00:00] [INFO] [rootcoord/timeticksync.go:233] ["Add session for timeticksync"] [serverID=1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.095 +00:00] [INFO] [sessionutil/session_util.go:444] ["Service registered successfully"] [ServerName=proxy] [serverID=1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.095 +00:00] [INFO] [proxy/proxy.go:143] ["Proxy Register Finished"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.095 +00:00] [INFO] [rootcoord/proxy_client_manager.go:125] ["succeed to create proxy client"] [address=172.18.0.4:19529] [serverID=1] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.096 +00:00] [WARN] [sessionutil/session_util.go:373] ["fail to get the session key from the etcd"] [] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.096 +00:00] [INFO] [proxy/service.go:627] ["start Proxy http server"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.096 +00:00] [DEBUG] [proxy/service.go:366] ["start Proxy server done"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.096 +00:00] [INFO] [components/proxy.go:55] ["Proxy successfully started"] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.096 +00:00] [INFO] [logutil/logutil.go:163] ["Log directory"] [configDir=] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.096 +00:00] [INFO] [logutil/logutil.go:164] ["Set log file to "] [path=] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.096 +00:00] [INFO] [tracer/tracer.go:71] ["Init tracer finished"] [Exporter=stdout] 2023-09-21 09:16:35 milvus-standalone | [2023/09/21 09:16:35.188 +00:00] [INFO] [sessionutil/session_util.go:841] ["register session success"] [role=proxy] [key=by-dev/meta/session/proxy-1] 2023-09-21 09:16:37 milvus-standalone | [2023/09/21 09:16:37.518 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":187404288,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:16:39 milvus-standalone | [2023/09/21 09:16:39.912 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=100] ["heapuse "=30] ["total memory"=187] ["next GC"=43] ["new GOGC"=200] [gc-pause=48.852µs] [gc-pause-end=1695287799910569754] 2023-09-21 09:16:40 milvus-standalone | [2023/09/21 09:16:40.506 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":50,\"memory\":33632305152,\"memory_usage\":197586944,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:16:43 milvus-standalone | [2023/09/21 09:16:43.496 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":197746688,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:16:46 milvus-standalone | [2023/09/21 09:16:46.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":198139904,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:16:49 milvus-standalone | [2023/09/21 09:16:49.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":201449472,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:16:52 milvus-standalone | [2023/09/21 09:16:52.501 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":207024128,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:16:55 milvus-standalone | [2023/09/21 09:16:55.500 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":210403328,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:16:58 milvus-standalone | [2023/09/21 09:16:58.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":215912448,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:17:03 milvus-standalone | [2023/09/21 09:17:03.719 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:17:10 milvus-standalone | [2023/09/21 09:17:10.496 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":100,\"memory\":33632305152,\"memory_usage\":232329216,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:17:10 milvus-standalone | [2023/09/21 09:17:10.499 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=32] ["total memory"=226] ["next GC"=66] ["new GOGC"=200] [gc-pause=120.804µs] [gc-pause-end=1695287830497953888] 2023-09-21 09:17:19 milvus-standalone | [2023/09/21 09:17:19.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":237862912,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:17:28 milvus-standalone | [2023/09/21 09:17:28.498 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":4.5474735087653795e-9,\"memory\":33632305152,\"memory_usage\":238100480,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:17:33 milvus-standalone | [2023/09/21 09:17:33.917 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:17:33 milvus-standalone | [2023/09/21 09:17:33.917 +00:00] [INFO] [indexnode/indexnode.go:276] ["get IndexNode components states ..."] 2023-09-21 09:17:40 milvus-standalone | [2023/09/21 09:17:40.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":238239744,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:17:43 milvus-standalone | [2023/09/21 09:17:43.496 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=59] ["total memory"=228] ["next GC"=67] ["new GOGC"=200] [gc-pause=132.978µs] [gc-pause-end=1695287863495145964] 2023-09-21 09:17:49 milvus-standalone | [2023/09/21 09:17:49.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":239194112,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:17:58 milvus-standalone | [2023/09/21 09:17:58.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":239112192,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:18:04 milvus-standalone | [2023/09/21 09:18:04.053 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:18:04 milvus-standalone | [2023/09/21 09:18:04.053 +00:00] [INFO] [indexnode/indexnode.go:276] ["get IndexNode components states ..."] 2023-09-21 09:18:10 milvus-standalone | [2023/09/21 09:18:10.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":239161344,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:18:16 milvus-standalone | [2023/09/21 09:18:16.493 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=62] ["total memory"=230] ["next GC"=67] ["new GOGC"=200] [gc-pause=161.382µs] [gc-pause-end=1695287896492765697] 2023-09-21 09:18:19 milvus-standalone | [2023/09/21 09:18:19.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":241463296,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:18:28 milvus-standalone | [2023/09/21 09:18:28.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":241479680,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:18:34 milvus-standalone | [2023/09/21 09:18:34.154 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:18:34 milvus-standalone | [2023/09/21 09:18:34.154 +00:00] [INFO] [indexnode/indexnode.go:276] ["get IndexNode components states ..."] 2023-09-21 09:18:40 milvus-standalone | [2023/09/21 09:18:40.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":241418240,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:18:49 milvus-standalone | [2023/09/21 09:18:49.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":241459200,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:18:49 milvus-standalone | [2023/09/21 09:18:49.674 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=59] ["total memory"=230] ["next GC"=67] ["new GOGC"=200] [gc-pause=159.81µs] [gc-pause-end=1695287929673056703] 2023-09-21 09:18:58 milvus-standalone | [2023/09/21 09:18:58.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":242049024,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:19:04 milvus-standalone | [2023/09/21 09:19:04.243 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:19:04 milvus-standalone | [2023/09/21 09:19:04.243 +00:00] [INFO] [indexnode/indexnode.go:276] ["get IndexNode components states ..."] 2023-09-21 09:19:10 milvus-standalone | [2023/09/21 09:19:10.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":241938432,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:19:19 milvus-standalone | [2023/09/21 09:19:19.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":241704960,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:19:23 milvus-standalone | [2023/09/21 09:19:23.595 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=33] ["total memory"=236] ["next GC"=67] ["new GOGC"=200] [gc-pause=35.405µs] [gc-pause-end=1695287963592774919] 2023-09-21 09:19:28 milvus-standalone | [2023/09/21 09:19:28.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248098816,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:19:34 milvus-standalone | [2023/09/21 09:19:34.354 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:19:34 milvus-standalone | [2023/09/21 09:19:34.354 +00:00] [INFO] [indexnode/indexnode.go:276] ["get IndexNode components states ..."] 2023-09-21 09:19:40 milvus-standalone | [2023/09/21 09:19:40.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248111104,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:19:49 milvus-standalone | [2023/09/21 09:19:49.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248254464,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:19:55 milvus-standalone | [2023/09/21 09:19:55.906 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=60] ["total memory"=237] ["next GC"=67] ["new GOGC"=200] [gc-pause=55.904µs] [gc-pause-end=1695287995904943271] 2023-09-21 09:19:58 milvus-standalone | [2023/09/21 09:19:58.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248688640,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:20:04 milvus-standalone | [2023/09/21 09:20:04.445 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:20:04 milvus-standalone | [2023/09/21 09:20:04.445 +00:00] [INFO] [indexnode/indexnode.go:276] ["get IndexNode components states ..."] 2023-09-21 09:20:10 milvus-standalone | [2023/09/21 09:20:10.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248299520,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:20:19 milvus-standalone | [2023/09/21 09:20:19.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248229888,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:20:28 milvus-standalone | [2023/09/21 09:20:28.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":247975936,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:20:29 milvus-standalone | [2023/09/21 09:20:29.907 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=33] ["total memory"=236] ["next GC"=67] ["new GOGC"=200] [gc-pause=209.299µs] [gc-pause-end=1695288029904973595] 2023-09-21 09:20:34 milvus-standalone | [2023/09/21 09:20:34.564 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:20:34 milvus-standalone | [2023/09/21 09:20:34.564 +00:00] [INFO] [indexnode/indexnode.go:276] ["get IndexNode components states ..."] 2023-09-21 09:20:40 milvus-standalone | [2023/09/21 09:20:40.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248152064,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:20:49 milvus-standalone | [2023/09/21 09:20:49.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248037376,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:20:58 milvus-standalone | [2023/09/21 09:20:58.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248295424,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:21:03 milvus-standalone | [2023/09/21 09:21:03.906 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=62] ["total memory"=236] ["next GC"=67] ["new GOGC"=200] [gc-pause=62.796µs] [gc-pause-end=1695288063905177689] 2023-09-21 09:21:04 milvus-standalone | [2023/09/21 09:21:04.644 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:21:04 milvus-standalone | [2023/09/21 09:21:04.644 +00:00] [INFO] [indexnode/indexnode.go:276] ["get IndexNode components states ..."] 2023-09-21 09:21:10 milvus-standalone | [2023/09/21 09:21:10.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248311808,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:21:19 milvus-standalone | [2023/09/21 09:21:19.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248328192,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:21:28 milvus-standalone | [2023/09/21 09:21:28.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248352768,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:21:34 milvus-standalone | [2023/09/21 09:21:34.745 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:21:37 milvus-standalone | [2023/09/21 09:21:37.495 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=62] ["total memory"=237] ["next GC"=68] ["new GOGC"=200] [gc-pause=152.644µs] [gc-pause-end=1695288097493735690] 2023-09-21 09:21:40 milvus-standalone | [2023/09/21 09:21:40.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248438784,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:21:49 milvus-standalone | [2023/09/21 09:21:49.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248283136,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:21:58 milvus-standalone | [2023/09/21 09:21:58.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248819712,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:22:04 milvus-standalone | [2023/09/21 09:22:04.845 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:22:10 milvus-standalone | [2023/09/21 09:22:10.496 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248713216,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:22:10 milvus-standalone | [2023/09/21 09:22:10.498 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=61] ["total memory"=237] ["next GC"=67] ["new GOGC"=200] [gc-pause=78.897µs] [gc-pause-end=1695288130496438485] 2023-09-21 09:22:15 milvus-standalone | [GIN] 2023/09/21 - 09:22:15 | 404 | 2.625µs | 172.18.0.1 | GET "/" 2023-09-21 09:22:15 milvus-standalone | [GIN] 2023/09/21 - 09:22:15 | 404 | 3.106µs | 172.18.0.1 | GET "/favicon.ico" 2023-09-21 09:22:19 milvus-standalone | [2023/09/21 09:22:19.494 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248582144,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:22:28 milvus-standalone | [2023/09/21 09:22:28.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248352768,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:22:34 milvus-standalone | [2023/09/21 09:22:34.389 +00:00] [INFO] [datacoord/policy.go:586] ["node channel count is not much larger than average, skip reallocate"] [nodeID=1] [channelCount=0] [channelCountPerNode=0] 2023-09-21 09:22:34 milvus-standalone | [2023/09/21 09:22:34.389 +00:00] [INFO] [datacoord/policy.go:605] ["Channel Balancer got new reAllocations:"] [reAllocations="[]"] 2023-09-21 09:22:34 milvus-standalone | [2023/09/21 09:22:34.389 +00:00] [INFO] [datacoord/channel_manager.go:284] ["channel manager bg check balance"] [toReleases="[]"] 2023-09-21 09:22:34 milvus-standalone | [2023/09/21 09:22:34.945 +00:00] [INFO] [components/index_coord.go:51] ["IndexCoord is healthy"] 2023-09-21 09:22:40 milvus-standalone | [2023/09/21 09:22:40.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248483840,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"] 2023-09-21 09:22:43 milvus-standalone | [2023/09/21 09:22:43.497 +00:00] [INFO] [gc/gc_tuner.go:90] ["GC Tune done"] ["previous GOGC"=200] ["heapuse "=57] ["total memory"=236] ["next GC"=67] ["new GOGC"=200] [gc-pause=36.307µs] [gc-pause-end=1695288163496120010] 2023-09-21 09:22:49 milvus-standalone | [2023/09/21 09:22:49.495 +00:00] [INFO] [rootcoord/quota_center.go:416] ["QueryNodeMetrics when cool-off"] [metrics="{\"1\":{\"Hms\":{\"ip\":\"172.18.0.4:21123\",\"cpu_core_count\":16,\"cpu_core_usage\":0,\"memory\":33632305152,\"memory_usage\":248381440,\"disk\":104857600,\"disk_usage\":2097152},\"Rms\":[{\"Label\":\"NQPerSecond\",\"Rate\":0},{\"Label\":\"SearchThroughput\",\"Rate\":0},{\"Label\":\"InsertConsumeThroughput\",\"Rate\":0},{\"Label\":\"DeleteConsumeThroughput\",\"Rate\":0}],\"Fgm\":{\"MinFlowGraphChannel\":\"\",\"MinFlowGraphTt\":18446744073709551615,\"NumFlowGraph\":0},\"SearchQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"QueryQueue\":{\"UnsolvedQueue\":0,\"ReadyQueue\":0,\"ReceiveChan\":0,\"ExecuteChan\":0,\"AvgQueueDuration\":0},\"GrowingSegmentsSize\":0,\"Effect\":{\"NodeID\":1,\"CollectionIDs\":[]}}}"]

Anything else?

No response

yanliang567 commented 1 year ago

@Alokcoder 1. please specify which milvus version are you running. 2. please attach the full milvus logs, refer this doc to export the whole Milvus logs for investigation? For Milvus installed with docker-compose, you can use docker-compose logs > milvus.log to export the logs. 3. please share the reproduce code

/assign @Alokcoder /unassign

stale[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. Rotten issues close after 30d of inactivity. Reopen the issue with /reopen.