apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.43k stars 956 forks source link

[Bug] Exception thrown when processing the DELETE cdc record in canal-json with the paimon-action-jar #4453

Open JackeyLee007 opened 2 weeks ago

JackeyLee007 commented 2 weeks ago

Search before asking

Paimon version

0.9 +

Compute Engine

flink

Minimal reproduce step

  1. Flink CDC collect mysql data to kafka, including delete record.
  2. Use paimon-flink-action to kafka_sync_database

What doesn't meet your expectations?

Exception thrown as ”Expected node 'data' to be of type ArrayNode but was NullNode.“

Anything else?

No response

Are you willing to submit a PR?

JingsongLi commented 2 weeks ago

Can you use kafka_sync_table ? There is no database and table in kafka messages if you use "Flink CDC collect mysql data to kafka".