[Bug][cdc] performance issue in CdcActionCommonUtils

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

https://paimon.apache.org/

Apache License 2.0

2.13k stars 842 forks source link

[Bug][cdc] performance issue in CdcActionCommonUtils #3549

Closed MOBIN-F closed 2 weeks ago

MOBIN-F commented 2 weeks ago

Search before asking

[X] I searched in the issues and found nothing similar.

Paimon version

0.8

Compute Engine

Flink

Minimal reproduce step

none

What doesn't meet your expectations?

When checking for duplicate fields, unnecessary errMsg string concatenation is performed each time, which may cause performance problems when the data volume is large and there are many fields.

Anything else?

No response

Are you willing to submit a PR?

[X] I'm willing to submit a PR!