alibaba / otter

阿里巴巴分布式数据库同步系统(解决中美异地机房)
Apache License 2.0
8.06k stars 2.49k forks source link

canal 报错 Read Q_FLAGS2_CODE error: limit excceed: 63 #355

Open yangshike opened 7 years ago

yangshike commented 7 years ago

大数据量的批量插入 类似select into 的sql (10w条记录),canal 报错: pid:1 nid:2 exception:canal:canal_master:java.io.IOException: Read Q_FLAGS2_CODE error: limit excceed: 63 at com.taobao.tddl.dbsync.binlog.event.QueryLogEvent.unpackVariables(QueryLogEvent.java:650) at com.taobao.tddl.dbsync.binlog.event.QueryLogEvent.(QueryLogEvent.java:477) at com.taobao.tddl.dbsync.binlog.LogDecoder.decode(LogDecoder.java:154) at com.taobao.tddl.dbsync.binlog.LogDecoder.decode(LogDecoder.java:106) at com.alibaba.otter.canal.parse.inbound.mysql.MysqlConnection.dump(MysqlConnection.java:123) at com.alibaba.otter.canal.parse.inbound.AbstractEventParser$3.run(AbstractEventParser.java:209) at java.lang.Thread.run(Thread.java:745) Caused by: java.lang.IllegalArgumentException: limit excceed: 63 at com.taobao.tddl.dbsync.binlog.LogBuffer.getUint32(LogBuffer.java:561) at com.taobao.tddl.dbsync.binlog.event.QueryLogEvent.unpackVariables(QueryLogEvent.java:563) ... 6 more

liyongcun commented 7 years ago

修改启动脚本的参数-Xmx5120m

agapple commented 6 years ago

用的什么版本,otter、canal、mysql