消息队列RocketMQ版客户端消耗的内存过多 - Githubissues

apache / rocketmq

Apache RocketMQ is a cloud native messaging and streaming platform, making it simple to build event-driven applications.

https://rocketmq.apache.org/

Apache License 2.0

21.19k stars 11.67k forks source link

消息队列RocketMQ版客户端消耗的内存过多 #5262

Closed zhouquanwei closed 2 years ago

zhouquanwei commented 2 years ago

Please describe the issue you observed:

What did you do (The steps to reproduce)? 在使用rocketmq 的过程中，发现当生产者发送过多消息，但是消费端消费过慢会出现消费端频繁gc，我认为是消费端缓存mq数量过多造成的
What is expected to see? 我想控制一下消费端缓存消息的数量
What did you see instead? 我看见阿里云上面有解决方案调整Consumer的maxCachedMessageSizeInMiB参数至合适的值，但是使用这个在master 直接查询，并没有查到这个变量控制消息缓存的大小 https://help.aliyun.com/document_detail/85936.html

不知道现在是没有，还是说，我的查询关键字有问题 client 4.4.0

nowinkeyy commented 2 years ago

I found some information In client/src/main/java/org/apache/rocketmq/client/consumer/DefaultMQPushConsumer.java .

In rocketmq 4.4

In rocketmq 5.0

1665400760107

lizhanhui commented 2 years ago

@aaron-ai We may make this value heuristic...that is, their default value may be calculated according to the heap size.

ni-ze commented 2 years ago

开源的和商业参数名称有一些不一样，但是都是可以通过参数控制，可以看看 @nowinkeyy 同学的回复。

KerryJava commented 2 years ago

默认值1000条消息，100M的缓存，貌似也不大啊，为何有GC问题？

zhouquanwei commented 2 years ago

默认值1000条消息，100M的缓存，貌似也不大啊，为何有GC问题？

阿里云上面说每个topic 有16个队列，每个队列1000条，这样就有点大了，我算了算要缓存1个g