alibaba / spring-cloud-alibaba

Spring Cloud Alibaba provides a one-stop solution for application development for the distributed solutions of Alibaba middleware.
https://sca.aliyun.com
Apache License 2.0
27.79k stars 8.3k forks source link

About Aliyun RocketMQ CustomizedTraceTopic #916

Open HallenW opened 5 years ago

HallenW commented 5 years ago

Which Component eg. Nacos Discovery, Sentinel RocketMQ

Describe what problem you have encountered A clear and concise description of what you want to do. 当我在同一个项目A同时使用生产者A和消费者B的时候,项目B使用一个生产者B,明明已经消费成功,阿里云的控制台上消费轨迹却显示尚未消费。 但是只在项目A只保留消费者B,项目B保留生产者B的时候,阿里云上的消费轨迹可以看到消费成功。 我已经查看过该问题,可以保证customizedTraceTopic是正确的,下面贴出我项目A和项目B的配置。 项目A: spring.cloud.stream.rocketmq.binder.name-server=127.0.0.1:9876 spring.cloud.stream.rocketmq.binder.access-key=YourAccessKey spring.cloud.stream.rocketmq.binder.secret-key=YourSecretKey spring.cloud.stream.rocketmq.binder.name-server=NameServerInMQ spring.cloud.stream.rocketmq.binder.customized-trace-topic=rmq_sys_TRACE_DATA_cn-qingdao-publictest

生产者A

spring.cloud.stream.bindings.output.destination=test-topic1 spring.cloud.stream.bindings.output.content-type=application/json spring.cloud.stream.rocketmq.bindings.output.producer.group=test-group1

消费者B

spring.cloud.stream.bindings.input1.destination=test-topic2 spring.cloud.stream.bindings.input1.content-type=application/json spring.cloud.stream.bindings.input1.group=test-group2

项目B:

生产者B

spring.cloud.stream.rocketmq.binder.name-server=127.0.0.1:9876 spring.cloud.stream.rocketmq.binder.access-key=YourAccessKey spring.cloud.stream.rocketmq.binder.secret-key=YourSecretKey spring.cloud.stream.rocketmq.binder.name-server=NameServerInMQ spring.cloud.stream.rocketmq.binder.customized-trace-topic=rmq_sys_TRACE_DATA_cn-qingdao-publictest

spring.cloud.stream.bindings.output1.destination=test-topic2 spring.cloud.stream.bindings.output1.content-type=application/json spring.cloud.stream.rocketmq.bindings.output1.producer.group=test-group2

请问我该如何解决这个问题,可以在同一个项目中同时使用生产者和消费者,并且可以追踪到阿里云的消息轨迹。 Describe what information you have read eg. I have read the reference doc of Sentinel 我已经看过相关文档 https://github.com/alibaba/spring-cloud-alibaba/wiki/RocketMQ#%E9%98%BF%E9%87%8C%E4%BA%91-mq-%E6%9C%8D%E5%8A%A1

Which Component eg. Nacos Discovery, Sentinel RocketMQ

Describe what problem you have encountered A clear and concise description of what you want to do. When I use both Producer A and Consumer B in the same project A, Producer B is used in Project B. It is clear that the consumption has been successful, but the consumption trajectory on Aliyun's console shows that it has not been consumed yet.

But only when item A only retains consumer B and item B retains producer B, the consumption trajectory on Aliyun can see the success of consumption.

[I've looked at it] (https://github.com/alibaba/spring-cloud-alibaba/issues/764) This question can ensure that customized TraceTopic is correct. The configuration of my project A and project 2 is posted below.

project A: spring.cloud.stream.rocketmq.binder.name-server=127.0.0.1:9876 spring.cloud.stream.rocketmq.binder.access-key=YourAccessKey spring.cloud.stream.rocketmq.binder.secret-key=YourSecretKey spring.cloud.stream.rocketmq.binder.name-server=NameServerInMQ spring.cloud.stream.rocketmq.binder.customized-trace-topic=rmq_sys_TRACE_DATA_cn-qingdao-publictest

spring.cloud.stream.bindings.output.destination=test-topic1 spring.cloud.stream.bindings.output.content-type=application/json spring.cloud.stream.rocketmq.bindings.output.producer.group=test-group1 spring.cloud.stream.bindings.input1.destination=test-topic2 spring.cloud.stream.bindings.input1.content-type=application/json spring.cloud.stream.bindings.input1.group=test-group2

project B: spring.cloud.stream.rocketmq.binder.name-server=127.0.0.1:9876 spring.cloud.stream.rocketmq.binder.access-key=YourAccessKey spring.cloud.stream.rocketmq.binder.secret-key=YourSecretKey spring.cloud.stream.rocketmq.binder.name-server=NameServerInMQ spring.cloud.stream.rocketmq.binder.customized-trace-topic=rmq_sys_TRACE_DATA_cn-qingdao-publictest

spring.cloud.stream.bindings.output1.destination=test-topic2 spring.cloud.stream.bindings.output1.content-type=application/json spring.cloud.stream.rocketmq.bindings.output1.producer.group=test-group2

How can I solve this problem? I can use both producers and consumers in the same project, and track Aliyun's message trajectory. Describe what information you have read eg. I have read the reference doc of Sentinel I've seen the relevant ### ### documents. https://github.com/alibaba/spring-cloud-alibaba/wiki/RocketMQ#%E9%98%BF%E9%87%8C%E4%BA%91-mq-%E6%9C%8D%E5%8A%A1

HallenW commented 5 years ago

最新发现是,当项目同时配置类@EnableBinding({Sink.class, Source.class}),阿里云的消费轨迹就会不起作用了,一直显示未消费... @fangjian0423 @lovepoem

fangjian0423 commented 5 years ago

Not familiar about the message trace of Aliware MQ.

加我钉钉号: coderjim 。 我尝试看看

HallenW commented 5 years ago

Not familiar about the message trace of Aliware MQ.

加我钉钉号: coderjim 。 我尝试看看

已添加 ,github HallenW

pcazheng commented 4 years ago

我的也不行 请问如何解决 springboot版本:2.1.4.RELEASE springcloud-alibaba版本:2.1.2.RELEASE. 配置如下:

spring.cloud.stream.bindings.subscribe.destination=MQ_INST_xxx_BbsuaiRE%test
spring.cloud.stream.bindings.subscribe.group=MQ_INST_xxx_BbsuaiRE%GID-app
spring.cloud.stream.bindings.sender.destination=MQ_INST_xxx_BbsuaiRE%test
spring.cloud.stream.rocketmq.binder.customizedTraceTopic=rmq_sys_TRACE_DATA_cn-hangzhou

接收/发送器

public interface MySource {
    @Output("sender")
    MessageChannel sender();
    @Input("subscribe")
    SubscribableChannel subscribe();
}

rocketmq_client.log日志(截取trace相关和部分异常信息)

2020-07-28 17:05:01,001 INFO RocketmqClient - receive broker's notification[100.100.45.12:8080], the consumer group: MQ_INST_xxx_BbsuaiRE%GID-app changed, rebalance immediately
2020-07-28 17:05:02,002 INFO RocketmqClient - the topic[rmq_sys_TRACE_DATA_cn-hangzhou] route info changed, old[null] ,new[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=mqtrace4hz-29, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-26, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-04, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-27, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-24, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-03, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-25, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-22, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-23, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-20, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-21, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-09, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-08, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-07, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-01, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-02, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-17, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-18, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-15, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-16, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-11, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-12, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-16, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-15, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-17, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-11, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-14, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-19, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-13, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=mqtrace4hz-29, brokerAddrs={0=100.100.19.30:8080}], BrokerData [brokerName=mqtrace4hz-26, brokerAddrs={0=100.100.110.34:8080}], BrokerData [brokerName=mqtrace4hz-04, brokerAddrs={0=100.100.17.27:8080}], BrokerData [brokerName=mqtrace4hz-27, brokerAddrs={0=100.100.17.26:8080}], BrokerData [brokerName=mqtrace4hz-24, brokerAddrs={0=100.100.110.29:8080}], BrokerData [brokerName=mqtrace4hz-03, brokerAddrs={0=100.100.17.29:8080}], BrokerData [brokerName=mqtrace4hz-25, brokerAddrs={0=100.100.110.31:8080}], BrokerData [brokerName=mqtrace4hz-22, brokerAddrs={0=100.100.110.32:8080}], BrokerData [brokerName=mqtrace4hz-23, brokerAddrs={0=100.100.110.30:8080}], BrokerData [brokerName=mqtrace4hz-20, brokerAddrs={0=100.100.45.83:8080}], BrokerData [brokerName=mqtrace4hz-21, brokerAddrs={0=100.100.110.33:8080}], BrokerData [brokerName=hzshare-09, brokerAddrs={0=100.100.17.22:8080, 1=100.100.45.105:8080}], BrokerData [brokerName=hzshare-08, brokerAddrs={0=100.100.19.26:8080, 1=100.100.110.10:8080}], BrokerData [brokerName=hzshare-07, brokerAddrs={0=100.100.19.25:8080, 1=100.100.32.30:8080}], BrokerData [brokerName=hzshare-01, brokerAddrs={0=100.100.17.24:8080}], BrokerData [brokerName=hzshare-02, brokerAddrs={0=100.100.17.17:8080}], BrokerData [brokerName=mqtrace4hz-17, brokerAddrs={0=100.100.45.92:8080}], BrokerData [brokerName=mqtrace4hz-18, brokerAddrs={0=100.100.45.79:8080}], BrokerData [brokerName=mqtrace4hz-15, brokerAddrs={0=100.100.45.60:8080}], BrokerData [brokerName=mqtrace4hz-16, brokerAddrs={0=100.100.45.65:8080}], BrokerData [brokerName=mqtrace4hz-11, brokerAddrs={0=100.100.45.64:8080}], BrokerData [brokerName=mqtrace4hz-12, brokerAddrs={0=100.100.45.62:8080}], BrokerData [brokerName=hzshare-16, brokerAddrs={0=100.100.32.104:8080, 1=100.100.32.108:8080}], BrokerData [brokerName=hzshare-15, brokerAddrs={0=100.100.32.88:8080, 1=100.100.32.97:8080}], BrokerData [brokerName=hzshare-17, brokerAddrs={0=100.100.32.117:8080, 1=100.100.32.109:8080}], BrokerData [brokerName=hzshare-11, brokerAddrs={0=100.100.19.45:8080, 1=100.100.45.108:8080}], BrokerData [brokerName=hzshare-14, brokerAddrs={0=100.100.17.37:8080, 1=100.100.45.103:8080}], BrokerData [brokerName=mqtrace4hz-19, brokerAddrs={0=100.100.45.93:8080}], BrokerData [brokerName=hzshare-13, brokerAddrs={0=100.100.17.38:8080, 1=100.100.45.104:8080}]], filterServerTable={}]]
2020-07-28 17:05:02,002 INFO RocketmqClient - updateTopicPublishInfo prev is not null, TopicPublishInfo [orderTopic=false, messageQueueList=[], sendWhichQueue=ThreadLocalIndex{threadLocalIndex=null}, haveTopicRouterInfo=false]
2020-07-28 17:05:02,002 INFO RocketmqClient - topicRouteTable.put. Topic = rmq_sys_TRACE_DATA_cn-hangzhou, TopicRouteData[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=mqtrace4hz-29, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-26, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-04, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-27, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-24, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-03, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-25, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-22, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-23, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-20, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-21, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-09, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-08, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-07, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-01, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-02, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-17, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-18, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-15, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-16, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-11, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-12, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-16, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-15, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-17, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-11, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-14, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-19, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-13, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=mqtrace4hz-29, brokerAddrs={0=100.100.19.30:8080}], BrokerData [brokerName=mqtrace4hz-26, brokerAddrs={0=100.100.110.34:8080}], BrokerData [brokerName=mqtrace4hz-04, brokerAddrs={0=100.100.17.27:8080}], BrokerData [brokerName=mqtrace4hz-27, brokerAddrs={0=100.100.17.26:8080}], BrokerData [brokerName=mqtrace4hz-24, brokerAddrs={0=100.100.110.29:8080}], BrokerData [brokerName=mqtrace4hz-03, brokerAddrs={0=100.100.17.29:8080}], BrokerData [brokerName=mqtrace4hz-25, brokerAddrs={0=100.100.110.31:8080}], BrokerData [brokerName=mqtrace4hz-22, brokerAddrs={0=100.100.110.32:8080}], BrokerData [brokerName=mqtrace4hz-23, brokerAddrs={0=100.100.110.30:8080}], BrokerData [brokerName=mqtrace4hz-20, brokerAddrs={0=100.100.45.83:8080}], BrokerData [brokerName=mqtrace4hz-21, brokerAddrs={0=100.100.110.33:8080}], BrokerData [brokerName=hzshare-09, brokerAddrs={0=100.100.17.22:8080, 1=100.100.45.105:8080}], BrokerData [brokerName=hzshare-08, brokerAddrs={0=100.100.19.26:8080, 1=100.100.110.10:8080}], BrokerData [brokerName=hzshare-07, brokerAddrs={0=100.100.19.25:8080, 1=100.100.32.30:8080}], BrokerData [brokerName=hzshare-01, brokerAddrs={0=100.100.17.24:8080}], BrokerData [brokerName=hzshare-02, brokerAddrs={0=100.100.17.17:8080}], BrokerData [brokerName=mqtrace4hz-17, brokerAddrs={0=100.100.45.92:8080}], BrokerData [brokerName=mqtrace4hz-18, brokerAddrs={0=100.100.45.79:8080}], BrokerData [brokerName=mqtrace4hz-15, brokerAddrs={0=100.100.45.60:8080}], BrokerData [brokerName=mqtrace4hz-16, brokerAddrs={0=100.100.45.65:8080}], BrokerData [brokerName=mqtrace4hz-11, brokerAddrs={0=100.100.45.64:8080}], BrokerData [brokerName=mqtrace4hz-12, brokerAddrs={0=100.100.45.62:8080}], BrokerData [brokerName=hzshare-16, brokerAddrs={0=100.100.32.104:8080, 1=100.100.32.108:8080}], BrokerData [brokerName=hzshare-15, brokerAddrs={0=100.100.32.88:8080, 1=100.100.32.97:8080}], BrokerData [brokerName=hzshare-17, brokerAddrs={0=100.100.32.117:8080, 1=100.100.32.109:8080}], BrokerData [brokerName=hzshare-11, brokerAddrs={0=100.100.19.45:8080, 1=100.100.45.108:8080}], BrokerData [brokerName=hzshare-14, brokerAddrs={0=100.100.17.37:8080, 1=100.100.45.103:8080}], BrokerData [brokerName=mqtrace4hz-19, brokerAddrs={0=100.100.45.93:8080}], BrokerData [brokerName=hzshare-13, brokerAddrs={0=100.100.17.38:8080, 1=100.100.45.104:8080}]], filterServerTable={}]]
2020-07-28 17:05:02,002 INFO RocketmqRemoting - createChannel: begin to connect remote host[100.100.17.27:8080] asynchronously
2020-07-28 17:05:02,002 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 100.100.17.27:8080
2020-07-28 17:05:02,002 INFO RocketmqRemoting - createChannel: connect remote host[100.100.17.27:8080] success, AbstractBootstrap$PendingRegistrationPromise@5ef381a9(success)
2020-07-28 17:04:40,040 WARN RocketmqClient - the producer group[_INNER_TRACE_PRODUCER] exist already.
2020-07-28 17:04:40,040 WARN RocketmqClient - trace dispatcher start failed 
org.apache.rocketmq.client.exception.MQClientException: The producer group[_INNER_TRACE_PRODUCER] has been created before, specify another name please.
See http://rocketmq.apache.org/docs/faq/ for further details.
    at org.apache.rocketmq.client.impl.producer.DefaultMQProducerImpl.start(DefaultMQProducerImpl.java:188)
    at org.apache.rocketmq.client.impl.producer.DefaultMQProducerImpl.start(DefaultMQProducerImpl.java:168)
    at org.apache.rocketmq.client.producer.DefaultMQProducer.start(DefaultMQProducer.java:231)
    at org.apache.rocketmq.client.trace.AsyncTraceDispatcher.start(AsyncTraceDispatcher.java:132)
    at org.apache.rocketmq.client.consumer.DefaultMQPushConsumer.start(DefaultMQPushConsumer.java:584)
    at com.alibaba.cloud.stream.binder.rocketmq.consuming.RocketMQListenerBindingContainer.start(RocketMQListenerBindingContainer.java:179)
    at com.alibaba.cloud.stream.binder.rocketmq.integration.RocketMQInboundChannelAdapter.doStart(RocketMQInboundChannelAdapter.java:109)
    at org.springframework.integration.endpoint.AbstractEndpoint.start(AbstractEndpoint.java:156)
    at org.springframework.cloud.stream.binder.AbstractMessageChannelBinder.doBindConsumer(AbstractMessageChannelBinder.java:361)
    at org.springframework.cloud.stream.binder.AbstractMessageChannelBinder.doBindConsumer(AbstractMessageChannelBinder.java:93)
    at org.springframework.cloud.stream.binder.AbstractBinder.bindConsumer(AbstractBinder.java:132)
    at org.springframework.cloud.stream.binding.BindingService.doBindConsumer(BindingService.java:140)
    at org.springframework.cloud.stream.binding.BindingService.bindConsumer(BindingService.java:121)
    at org.springframework.cloud.stream.binding.BindableProxyFactory.createAndBindInputs(BindableProxyFactory.java:234)
    at org.springframework.cloud.stream.binding.InputBindingLifecycle.doStartWithBindable(InputBindingLifecycle.java:54)
    at java.util.LinkedHashMap$LinkedValues.forEach(LinkedHashMap.java:608)
    at org.springframework.cloud.stream.binding.AbstractBindingLifecycle.start(AbstractBindingLifecycle.java:47)
    at org.springframework.cloud.stream.binding.InputBindingLifecycle.start(InputBindingLifecycle.java:33)
    at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182)
    at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53)
    at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360)
    at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158)
    at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:122)
    at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:893)
    at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.finishRefresh(ServletWebServerApplicationContext.java:163)
    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:552)
    at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:142)
    at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:775)
    at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:397)
    at org.springframework.boot.SpringApplication.run(SpringApplication.java:316)
    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1260)
    at org.springframework.boot.SpringApplication.run(SpringApplication.java:1248)
    at com.cifnews.seller.main.MainApplication.main(MainApplication.java:36)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:498)
    at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
    at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
    at org.springframework.boot.loader.Launcher.launch(Launcher.java:50)
    at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51)

在阿里云rocketmq控制台上还是无法查看消息轨迹

HallenW commented 4 years ago

我的也不行 请问如何解决 springboot版本:2.1.4.RELEASE springcloud-alibaba版本:2.1.2.RELEASE. 配置如下:

spring.cloud.stream.bindings.subscribe.destination=MQ_INST_xxx_BbsuaiRE%test
spring.cloud.stream.bindings.subscribe.group=MQ_INST_xxx_BbsuaiRE%GID-app
spring.cloud.stream.bindings.sender.destination=MQ_INST_xxx_BbsuaiRE%test
spring.cloud.stream.rocketmq.binder.customizedTraceTopic=rmq_sys_TRACE_DATA_cn-hangzhou

接收/发送器

public interface MySource {
    @Output("sender")
    MessageChannel sender();
    @Input("subscribe")
    SubscribableChannel subscribe();
}

rocketmq_client.log日志(截取trace相关和部分异常信息)

2020-07-28 17:05:01,001 INFO RocketmqClient - receive broker's notification[100.100.45.12:8080], the consumer group: MQ_INST_xxx_BbsuaiRE%GID-app changed, rebalance immediately
2020-07-28 17:05:02,002 INFO RocketmqClient - the topic[rmq_sys_TRACE_DATA_cn-hangzhou] route info changed, old[null] ,new[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=mqtrace4hz-29, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-26, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-04, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-27, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-24, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-03, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-25, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-22, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-23, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-20, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-21, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-09, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-08, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-07, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-01, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-02, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-17, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-18, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-15, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-16, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-11, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-12, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-16, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-15, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-17, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-11, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-14, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-19, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-13, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=mqtrace4hz-29, brokerAddrs={0=100.100.19.30:8080}], BrokerData [brokerName=mqtrace4hz-26, brokerAddrs={0=100.100.110.34:8080}], BrokerData [brokerName=mqtrace4hz-04, brokerAddrs={0=100.100.17.27:8080}], BrokerData [brokerName=mqtrace4hz-27, brokerAddrs={0=100.100.17.26:8080}], BrokerData [brokerName=mqtrace4hz-24, brokerAddrs={0=100.100.110.29:8080}], BrokerData [brokerName=mqtrace4hz-03, brokerAddrs={0=100.100.17.29:8080}], BrokerData [brokerName=mqtrace4hz-25, brokerAddrs={0=100.100.110.31:8080}], BrokerData [brokerName=mqtrace4hz-22, brokerAddrs={0=100.100.110.32:8080}], BrokerData [brokerName=mqtrace4hz-23, brokerAddrs={0=100.100.110.30:8080}], BrokerData [brokerName=mqtrace4hz-20, brokerAddrs={0=100.100.45.83:8080}], BrokerData [brokerName=mqtrace4hz-21, brokerAddrs={0=100.100.110.33:8080}], BrokerData [brokerName=hzshare-09, brokerAddrs={0=100.100.17.22:8080, 1=100.100.45.105:8080}], BrokerData [brokerName=hzshare-08, brokerAddrs={0=100.100.19.26:8080, 1=100.100.110.10:8080}], BrokerData [brokerName=hzshare-07, brokerAddrs={0=100.100.19.25:8080, 1=100.100.32.30:8080}], BrokerData [brokerName=hzshare-01, brokerAddrs={0=100.100.17.24:8080}], BrokerData [brokerName=hzshare-02, brokerAddrs={0=100.100.17.17:8080}], BrokerData [brokerName=mqtrace4hz-17, brokerAddrs={0=100.100.45.92:8080}], BrokerData [brokerName=mqtrace4hz-18, brokerAddrs={0=100.100.45.79:8080}], BrokerData [brokerName=mqtrace4hz-15, brokerAddrs={0=100.100.45.60:8080}], BrokerData [brokerName=mqtrace4hz-16, brokerAddrs={0=100.100.45.65:8080}], BrokerData [brokerName=mqtrace4hz-11, brokerAddrs={0=100.100.45.64:8080}], BrokerData [brokerName=mqtrace4hz-12, brokerAddrs={0=100.100.45.62:8080}], BrokerData [brokerName=hzshare-16, brokerAddrs={0=100.100.32.104:8080, 1=100.100.32.108:8080}], BrokerData [brokerName=hzshare-15, brokerAddrs={0=100.100.32.88:8080, 1=100.100.32.97:8080}], BrokerData [brokerName=hzshare-17, brokerAddrs={0=100.100.32.117:8080, 1=100.100.32.109:8080}], BrokerData [brokerName=hzshare-11, brokerAddrs={0=100.100.19.45:8080, 1=100.100.45.108:8080}], BrokerData [brokerName=hzshare-14, brokerAddrs={0=100.100.17.37:8080, 1=100.100.45.103:8080}], BrokerData [brokerName=mqtrace4hz-19, brokerAddrs={0=100.100.45.93:8080}], BrokerData [brokerName=hzshare-13, brokerAddrs={0=100.100.17.38:8080, 1=100.100.45.104:8080}]], filterServerTable={}]]
2020-07-28 17:05:02,002 INFO RocketmqClient - updateTopicPublishInfo prev is not null, TopicPublishInfo [orderTopic=false, messageQueueList=[], sendWhichQueue=ThreadLocalIndex{threadLocalIndex=null}, haveTopicRouterInfo=false]
2020-07-28 17:05:02,002 INFO RocketmqClient - topicRouteTable.put. Topic = rmq_sys_TRACE_DATA_cn-hangzhou, TopicRouteData[TopicRouteData [orderTopicConf=null, queueDatas=[QueueData [brokerName=mqtrace4hz-29, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-26, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-04, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-27, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-24, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-03, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-25, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-22, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-23, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-20, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-21, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-09, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-08, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-07, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-01, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-02, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-17, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-18, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-15, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-16, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-11, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-12, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-16, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-15, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-17, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-11, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=hzshare-14, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0], QueueData [brokerName=mqtrace4hz-19, readQueueNums=8, writeQueueNums=8, perm=6, topicSynFlag=0], QueueData [brokerName=hzshare-13, readQueueNums=8, writeQueueNums=8, perm=4, topicSynFlag=0]], brokerDatas=[BrokerData [brokerName=mqtrace4hz-29, brokerAddrs={0=100.100.19.30:8080}], BrokerData [brokerName=mqtrace4hz-26, brokerAddrs={0=100.100.110.34:8080}], BrokerData [brokerName=mqtrace4hz-04, brokerAddrs={0=100.100.17.27:8080}], BrokerData [brokerName=mqtrace4hz-27, brokerAddrs={0=100.100.17.26:8080}], BrokerData [brokerName=mqtrace4hz-24, brokerAddrs={0=100.100.110.29:8080}], BrokerData [brokerName=mqtrace4hz-03, brokerAddrs={0=100.100.17.29:8080}], BrokerData [brokerName=mqtrace4hz-25, brokerAddrs={0=100.100.110.31:8080}], BrokerData [brokerName=mqtrace4hz-22, brokerAddrs={0=100.100.110.32:8080}], BrokerData [brokerName=mqtrace4hz-23, brokerAddrs={0=100.100.110.30:8080}], BrokerData [brokerName=mqtrace4hz-20, brokerAddrs={0=100.100.45.83:8080}], BrokerData [brokerName=mqtrace4hz-21, brokerAddrs={0=100.100.110.33:8080}], BrokerData [brokerName=hzshare-09, brokerAddrs={0=100.100.17.22:8080, 1=100.100.45.105:8080}], BrokerData [brokerName=hzshare-08, brokerAddrs={0=100.100.19.26:8080, 1=100.100.110.10:8080}], BrokerData [brokerName=hzshare-07, brokerAddrs={0=100.100.19.25:8080, 1=100.100.32.30:8080}], BrokerData [brokerName=hzshare-01, brokerAddrs={0=100.100.17.24:8080}], BrokerData [brokerName=hzshare-02, brokerAddrs={0=100.100.17.17:8080}], BrokerData [brokerName=mqtrace4hz-17, brokerAddrs={0=100.100.45.92:8080}], BrokerData [brokerName=mqtrace4hz-18, brokerAddrs={0=100.100.45.79:8080}], BrokerData [brokerName=mqtrace4hz-15, brokerAddrs={0=100.100.45.60:8080}], BrokerData [brokerName=mqtrace4hz-16, brokerAddrs={0=100.100.45.65:8080}], BrokerData [brokerName=mqtrace4hz-11, brokerAddrs={0=100.100.45.64:8080}], BrokerData [brokerName=mqtrace4hz-12, brokerAddrs={0=100.100.45.62:8080}], BrokerData [brokerName=hzshare-16, brokerAddrs={0=100.100.32.104:8080, 1=100.100.32.108:8080}], BrokerData [brokerName=hzshare-15, brokerAddrs={0=100.100.32.88:8080, 1=100.100.32.97:8080}], BrokerData [brokerName=hzshare-17, brokerAddrs={0=100.100.32.117:8080, 1=100.100.32.109:8080}], BrokerData [brokerName=hzshare-11, brokerAddrs={0=100.100.19.45:8080, 1=100.100.45.108:8080}], BrokerData [brokerName=hzshare-14, brokerAddrs={0=100.100.17.37:8080, 1=100.100.45.103:8080}], BrokerData [brokerName=mqtrace4hz-19, brokerAddrs={0=100.100.45.93:8080}], BrokerData [brokerName=hzshare-13, brokerAddrs={0=100.100.17.38:8080, 1=100.100.45.104:8080}]], filterServerTable={}]]
2020-07-28 17:05:02,002 INFO RocketmqRemoting - createChannel: begin to connect remote host[100.100.17.27:8080] asynchronously
2020-07-28 17:05:02,002 INFO RocketmqRemoting - NETTY CLIENT PIPELINE: CONNECT  UNKNOWN => 100.100.17.27:8080
2020-07-28 17:05:02,002 INFO RocketmqRemoting - createChannel: connect remote host[100.100.17.27:8080] success, AbstractBootstrap$PendingRegistrationPromise@5ef381a9(success)
2020-07-28 17:04:40,040 WARN RocketmqClient - the producer group[_INNER_TRACE_PRODUCER] exist already.
2020-07-28 17:04:40,040 WARN RocketmqClient - trace dispatcher start failed 
org.apache.rocketmq.client.exception.MQClientException: The producer group[_INNER_TRACE_PRODUCER] has been created before, specify another name please.
See http://rocketmq.apache.org/docs/faq/ for further details.
  at org.apache.rocketmq.client.impl.producer.DefaultMQProducerImpl.start(DefaultMQProducerImpl.java:188)
  at org.apache.rocketmq.client.impl.producer.DefaultMQProducerImpl.start(DefaultMQProducerImpl.java:168)
  at org.apache.rocketmq.client.producer.DefaultMQProducer.start(DefaultMQProducer.java:231)
  at org.apache.rocketmq.client.trace.AsyncTraceDispatcher.start(AsyncTraceDispatcher.java:132)
  at org.apache.rocketmq.client.consumer.DefaultMQPushConsumer.start(DefaultMQPushConsumer.java:584)
  at com.alibaba.cloud.stream.binder.rocketmq.consuming.RocketMQListenerBindingContainer.start(RocketMQListenerBindingContainer.java:179)
  at com.alibaba.cloud.stream.binder.rocketmq.integration.RocketMQInboundChannelAdapter.doStart(RocketMQInboundChannelAdapter.java:109)
  at org.springframework.integration.endpoint.AbstractEndpoint.start(AbstractEndpoint.java:156)
  at org.springframework.cloud.stream.binder.AbstractMessageChannelBinder.doBindConsumer(AbstractMessageChannelBinder.java:361)
  at org.springframework.cloud.stream.binder.AbstractMessageChannelBinder.doBindConsumer(AbstractMessageChannelBinder.java:93)
  at org.springframework.cloud.stream.binder.AbstractBinder.bindConsumer(AbstractBinder.java:132)
  at org.springframework.cloud.stream.binding.BindingService.doBindConsumer(BindingService.java:140)
  at org.springframework.cloud.stream.binding.BindingService.bindConsumer(BindingService.java:121)
  at org.springframework.cloud.stream.binding.BindableProxyFactory.createAndBindInputs(BindableProxyFactory.java:234)
  at org.springframework.cloud.stream.binding.InputBindingLifecycle.doStartWithBindable(InputBindingLifecycle.java:54)
  at java.util.LinkedHashMap$LinkedValues.forEach(LinkedHashMap.java:608)
  at org.springframework.cloud.stream.binding.AbstractBindingLifecycle.start(AbstractBindingLifecycle.java:47)
  at org.springframework.cloud.stream.binding.InputBindingLifecycle.start(InputBindingLifecycle.java:33)
  at org.springframework.context.support.DefaultLifecycleProcessor.doStart(DefaultLifecycleProcessor.java:182)
  at org.springframework.context.support.DefaultLifecycleProcessor.access$200(DefaultLifecycleProcessor.java:53)
  at org.springframework.context.support.DefaultLifecycleProcessor$LifecycleGroup.start(DefaultLifecycleProcessor.java:360)
  at org.springframework.context.support.DefaultLifecycleProcessor.startBeans(DefaultLifecycleProcessor.java:158)
  at org.springframework.context.support.DefaultLifecycleProcessor.onRefresh(DefaultLifecycleProcessor.java:122)
  at org.springframework.context.support.AbstractApplicationContext.finishRefresh(AbstractApplicationContext.java:893)
  at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.finishRefresh(ServletWebServerApplicationContext.java:163)
  at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:552)
  at org.springframework.boot.web.servlet.context.ServletWebServerApplicationContext.refresh(ServletWebServerApplicationContext.java:142)
  at org.springframework.boot.SpringApplication.refresh(SpringApplication.java:775)
  at org.springframework.boot.SpringApplication.refreshContext(SpringApplication.java:397)
  at org.springframework.boot.SpringApplication.run(SpringApplication.java:316)
  at org.springframework.boot.SpringApplication.run(SpringApplication.java:1260)
  at org.springframework.boot.SpringApplication.run(SpringApplication.java:1248)
  at com.cifnews.seller.main.MainApplication.main(MainApplication.java:36)
  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
  at java.lang.reflect.Method.invoke(Method.java:498)
  at org.springframework.boot.loader.MainMethodRunner.run(MainMethodRunner.java:48)
  at org.springframework.boot.loader.Launcher.launch(Launcher.java:87)
  at org.springframework.boot.loader.Launcher.launch(Launcher.java:50)
  at org.springframework.boot.loader.JarLauncher.main(JarLauncher.java:51)

在阿里云rocketmq控制台上还是无法查看消息轨迹

后续我用的是原生的RocketMQAPI,就没用继续SpringCloud封装的。不过后面我猜测可能是订阅关系不一致的问题。看看开发环境和自己的本地环境在同一个group下订阅的topic数量是否不一样?可以看看这个https://help.aliyun.com/document_detail/43523.html?spm=a2c4g.11186623.6.738.4ef77e80nUyptX

zkzlx commented 3 years ago

please try the beta version #2029 to see if it solves your problem, or provide us more information to help find the latent bug.

zhangle910522 commented 1 year ago

啥情况了 有临时解决方案不