Open ISheepp opened 3 years ago
缺陷
[^1]: My reference.
[^1]: 报错信息:Unsubscribed all topics or patterns and assigned partitions, 消费者组重平衡....
[^2]:data-process.schema-ignore:false 配置导致sink的topic没有schema和payload
[^1]: 使用IOUtils.copy()
方法way 问题:java.io.IOException: Broken pipe
kafka connect两个问题
[2021-11-29 10:15:43,864] ERROR [source:拥堵态势测试|task-0|offsets] WorkerSourceTask{id=source:拥堵态势测试-0} Failed to flush, timed out while waiting for producer to flush outstanding 1 messages (org.apache.kafka.connect.runtime.WorkerSourceTask:500)
[2021-11-29 10:15:43,864] ERROR [source:拥堵态势测试|task-0|offsets] WorkerSourceTask{id=source:拥堵态势测试-0} Failed to commit offsets (org.apache.kafka.connect.runtime.SourceTaskOffsetCommitter:116)
sink task
Commit of offsets threw an unexpected exception for sequence number
org.apache.kafka.clients.consumer.CommitFailedException: Offset commit cannot be completed since the consumer is not part of an active group for auto partition assignment; it is likely that the consumer was kicked out of the group.
添加了两个参数,在source任务中添加flush.timeout.ms=30000(默认是10000ms)
,在sink任务中添加batch.size=500
这周老实呆家里
BeanUtils.copyProperties()
2. @Transactional
失败的2021终于要过去了 迎接失败的2022
此issue记录自己的每日TODO-list,做好自己