search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.43k stars 955 forks source link

[Core]commit failed, add table name to the log #4478

Closed melin closed 1 week ago

melin commented 2 weeks ago

Purpose

flink cdc pipeline writes multiple table. If write failed, only file name information, no table name. It is difficult to find which table failed to write

wwj6591812 commented 2 weeks ago

You means FlinkCdcMultiTableSink? @melin

melin commented 2 weeks ago

You means FlinkCdcMultiTableSink? @melin

flink cdc pipeline paimon https://github.com/apache/flink-cdc/tree/master/flink-cdc-connect/flink-cdc-pipeline-connectors/flink-cdc-pipeline-connector-paimon

JingsongLi commented 1 week ago

I remember I have merged this PR?....

melin commented 1 week ago

I remember I have merged this PR?....

You added, I close this pr