[core] Update possible reasons for commit conflicts

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

https://paimon.apache.org/

Apache License 2.0

2.35k stars 928 forks source link

[core] Update possible reasons for commit conflicts #3518

Closed tsreaper closed 1 month ago

tsreaper commented 3 months ago

Purpose

We recently found that, if data is written into expired partitions, commit conflicts may occur.

It is not easy to completely work around this scenario, so currently we prefer users to filter out expired data by themselves. This PR updates possible reasons for commit conflicts to remind the users.

Tests

No tests.

API and Format

No API changes.

Documentation

No new features.

tsreaper commented 2 months ago

Also related to #3340.

JingsongLi commented 1 month ago

Fixed in https://github.com/apache/paimon/pull/3945