search

StarRocks / starrocks-connector-for-kafka

Apache License 2.0
4 stars 8 forks source link

MySQL datetime type data is not being synchronized in StarRocks. #12

Open chzzk-cheese opened 6 months ago

chzzk-cheese commented 6 months ago

Issue : There's an issue where MySQL datetime type data is being synchronized as null in StarRocks.

There is create_ymdt and update_ymdt data in topic.


    "create_ymdt": 1702407600000,
        "update_ymdt": 1702407600000,

But those data is being synchronized as null in StarRocks.

zaorangyang commented 6 months ago

@chzzk-cheese The MySQL datetime field obtained by the Kafka connector is a timestamp in milliseconds. You cannot directly write a millisecond timestamp into the Starrocks datetime column. You need to use the from_unixtime function to perform a conversion.

chzzk-cheese commented 6 months ago

@zaorangyang Can you update debezium version from 1.8.1 to 2.4.1 Final to allow me use TimezoneConverter ? https://debezium.io/documentation/reference/nightly/transformations/timezone-converter.html