search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.13k stars 842 forks source link

[cdc] Handle case-insensitive in separate operator instead of record parsers #3551

Closed yuzelin closed 2 weeks ago

yuzelin commented 2 weeks ago

Purpose

Currently, all record parsers have to handle case-insensitive. This PR want to move it to a separate operator.

Note that #2485 has already considered handle case-insensitive with computed columns, so this PR won't cause problems to computed columns.

Tests

  1. there are already some test cases for table sync with case-insensitive.
  2. add MySqlSyncDatabaseActionITCase#testIgnoreCaseCombined
  3. enhance KafkaCanalSyncDatabaseActionITCase#testCaseInsensitive

API and Format

Documentation