datavane / tis

Support agile DataOps Based on Flink, DataX and Flink-CDC, Chunjun with Web-UI
https://tis.pub
Apache License 2.0
989 stars 217 forks source link

增量同步mysql到doris null值被转换成了\N #328

Closed 18701606481 closed 3 months ago

18701606481 commented 3 months ago

mysqlddl:

CREATE TABLE `wl_test` (
  `ws_id` int NOT NULL AUTO_INCREMENT COMMENT '主键 ID',
  `ws_aaa` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_0900_ai_ci NOT NULL,
  `ws_bbb` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_0900_ai_ci DEFAULT NULL,
  `ws_ccc` varchar(50) CHARACTER SET utf8mb4 COLLATE utf8mb4_0900_ai_ci DEFAULT NULL,
  `ws_create_time` datetime DEFAULT CURRENT_TIMESTAMP,
  `ws_update_time` datetime DEFAULT CURRENT_TIMESTAMP,
  PRIMARY KEY (`ws_id`) USING BTREE,
  UNIQUE KEY `idx_ws_aaa` (`ws_aaa`) USING BTREE,
  UNIQUE KEY `idx_ws_bbb` (`ws_bbb`) USING BTREE
) ENGINE=InnoDB AUTO_INCREMENT=7210 DEFAULT CHARSET=utf8mb4 COLLATE=utf8mb4_0900_ai_ci;

doris_ddl:

CREATE TABLE `wl_test`
(
    `ws_id`           INT NOT NULL,
    `ws_aaa`          VARCHAR(150),
    `ws_bbb`          VARCHAR(150),
    `ws_ccc`          VARCHAR(150),
    `ws_create_time`  DATETIMEV2,
    `ws_update_time`  DATETIMEV2
)
 ENGINE=olap
UNIQUE KEY(`ws_id`)
DISTRIBUTED BY HASH(`ws_id`)
BUCKETS 10
PROPERTIES("replication_num" = "1"  )

开启增量同步后

INSERT INTO `group_shopmall`.`wl_test` ( `ws_aaa`) VALUES ('111');
INSERT INTO `group_shopmall`.`wl_test` ( `ws_aaa`) VALUES ('222');

在进行增量同步的时候 mysql里面的null值会变成\N 请问这个如何解决