search

apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.41k stars 946 forks source link

[Feature] Support Global System Table which record metadata of all paimon tables #1612

Closed ChenShuai1981 closed 1 year ago

ChenShuai1981 commented 1 year ago

Search before asking

Motivation

There are so many paimon tables, and I want to find which paimon tables has 'write-only' = 'true' option. Currently there is NO system tables provided by paimon, but only T$options system table companion with paimon table. It is hard for me to get all those write-only paimon tables because I have to iterate all paimon table names, and query its companion T$options system table, then check those options one by one. If paimon support Global system table just like information_schema.tables in mysql, I can query them quickly by fire the following sql:

select table_name from paimon_catalog.information_schema.tables where option_key = 'write-only' and option_value = 'true'

Solution

No response

Anything else?

No response

Are you willing to submit a PR?

zhuangchong commented 1 year ago

the related pr: #1647

The related PR has been merged, you are welcome to try this feature, I will close this issue.