DTStack / chunjun

A data integration framework
https://dtstack.github.io/chunjun/
Apache License 2.0
4.01k stars 1.69k forks source link

[Bug] [chunjun-connector-binlog] Skipping unrecognized binlog event Unknown type:41 from: mysql-bin.xxx #1895

Open Icarus-Alpha opened 7 months ago

Icarus-Alpha commented 7 months ago

Search before asking

What happened

mysql版本:8.0.31 当我使用local-test模式,运行example中binlog的同步任务时,无法正常解析binlog日志。

WARN com.taobao.tddl.dbsync.binlog.LogDecoder - Skipping unrecognized binlog event Unknown type:41 from: mysql-bin.000002:1963402 WARN com.taobao.tddl.dbsync.binlog.LogDecoder - Skipping unrecognized binlog event Unknown type:41 from: mysql-bin.000002:1963402 image

经排查为chunjun的binlog connector使用的是canal1.1.6,对 mysql 8.0 版本的binlog部分格式无法识别,在canal1.1.7修复了这个问题。 canal1.1.7

What you expected to happen

正常打印数据变更记录。 image

How to reproduce

使用mysql版本8.0.31,运行binlog_stream.json

Anything else

No response

Version

master

Are you willing to submit PR?

Code of Conduct

maikouliujian commented 3 months ago

我也遇到了这个warn: Skipping unrecognized binlog event Unknown type:41 from: mysql-bin.000002:1963402,而且任务正常运行,但是binlog不采集了,canal版本是1.1.6,请问1.1.7能解决么?