apache / amoro

Apache Amoro (incubating) is a Lakehouse management system built on open data lake formats.
https://amoro.apache.org/
Apache License 2.0
874 stars 290 forks source link

[Improvement]: When the data-expire feature is used with the expiration field as the partition field and the expiration level as partition, it expires the datafile using the partition information of the datafile. #3272

Open lintingbin opened 1 month ago

lintingbin commented 1 month ago

Search before asking

What would you like to be improved?

The current data-expire feature cannot function properly when the iceberg table does not have metrics enabled or when the metrics are ineffective (i.e., the datafile does not record the upper_bound of the expiration field). Hoping to implement the data-expire feature in cases where metrics information is missing.

How should we improve?

When the data-expire feature is used with the expiration field as the partition field and the expiration level as partition, it expires the datafile using the partition information of the datafile.

Are you willing to submit PR?

Subtasks

No response

Code of Conduct