search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.22k stars 4.14k forks source link

[source-mysql] Possible wrong type conversion #41282

Closed theyueli closed 3 months ago

theyueli commented 4 months ago

@michel-tricot observed an issue reported on reddit:

https://www.reddit.com/r/dataengineering/comments/1dz1onq/weird_mysql_cdc_binlog_behavior/

rodireich commented 4 months ago

Enum types are converted to a String by debezium. It's worth checking perhaps if the initial sync matches in terms of mapped value.

rodireich commented 4 months ago

It does, it appears

case CHAR, VARCHAR, TINYTEXT, TEXT, MEDIUMTEXT, LONGTEXT, ENUM, SET -> setString(preparedStatement, parameterIndex, value);
rodireich commented 4 months ago

https://issues.redhat.com/browse/DBZ-7792 This is the bug in debezium I think - fixed in 2.7.?

evantahler commented 3 months ago

Closing issue as we will upgrade mysql dbz in Q3A