[Feature] Add the flink jobid field to the files metadata table

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

https://paimon.apache.org/

Apache License 2.0

2.43k stars 955 forks source link

Open melin opened 1 week ago

melin commented 1 week ago

When a similar error occurs, use jobid to determine whether multiple tasks are writing to the same table at the same time. Easy to find problems.

Trying to delete file data-b2fb3e14-65f8-4058-8d64-5e6a6834eb5d-0.avro which is not previously added

No response

No response