apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.44k stars 959 forks source link

[hive]add retention seconds in hive catalog. #4367

Closed YanZhangN closed 3 weeks ago

YanZhangN commented 1 month ago

Purpose

Add retention properties for hive metastore according to 'partition.expiration-time'.

Linked issue: close #xxx

Tests

API and Format

Documentation

JingsongLi commented 4 weeks ago

Can you provide the specific application of this attribute? For example, Hive first introduced it with JIRA, etc.

JingsongLi commented 3 weeks ago

I am not sure this field is for partition retention.

Maybe we can use properties to store this option.

JingsongLi commented 3 weeks ago

Close this first, feel free to re-open this.