search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.39k stars 942 forks source link

[Feature] Support T$partitions system table which store partition related information #1633

Closed ChenShuai1981 closed 1 year ago

ChenShuai1981 commented 1 year ago

Search before asking

Motivation

Currently, there is no system table in paimon which store partition related information. Especially in partition expiration scenario, those expired partitions are logically deleted without delete partition folder physically. User does NOT know which partitions are retained and can be queried. By supporting T$partitions system table, user can fire the following sql to query them out: select * from T$partitions

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

JingsongLi commented 1 year ago

https://iceberg.apache.org/docs/latest/spark-queries/#partitions

john8628 commented 1 year ago

could you assign it to me , i will try this ;