[core] Adjust default value of 'snapshot.expire.limit'

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.

https://paimon.apache.org/

Apache License 2.0

2.43k stars 955 forks source link

[core] Adjust default value of 'snapshot.expire.limit' #4508

Closed askwang closed 1 week ago

askwang commented 1 week ago

Purpose

When we use flink write data and spark compact, we find expiring only 10 snapshots each time in compact, and the snapshot backlog is quite serious. Increase the default value to 50 to avoid this situation.

Tests

API and Format

Documentation

JingsongLi commented 1 week ago