Closed LinMingQiang closed 2 months ago
Some discussion: If the partition conversion time fails, I feel like we can throw an exception and remind user to configure the formatter or use update-time mode.
Changing the expiration strategy for a table with data is risky, may be we could provide a procedure to expire the specified wrong partition.
…e time.
Purpose
Add an expiration strategy that comparing with partition update time.
Using
partition.expiration-strategy
option to specifies the expiration strategy for partition expiration.Possible values:
VALUES-TIME (default): A partition expiration policy that compares the time extracted from the partition value with the current time.
UPDATE-TIME : A partition expiration policy that compares the last update time of the partition with the current time.
What is the value of this feature :
If your partition value is not date formatted, you can use
UPDATE-TIME
as your partition expiration policy.If you only want to keep data that has been updated in the last n days/months/years, you can use
UPDATE-TIME
as your partition expiration policy.Linked issue: close #xxx
Tests
API and Format
Documentation