apache / paimon

Apache Paimon is a lake format that enables building a Realtime Lakehouse Architecture with Flink and Spark for both streaming and batch operations.
https://paimon.apache.org/
Apache License 2.0
2.25k stars 897 forks source link

[Feature] Introduce Encryption Capability for Paimon #2113

Open zhangjun0x01 opened 10 months ago

zhangjun0x01 commented 10 months ago

Search before asking

Motivation

With the development of enterprises, data security has become increasingly important, and there are some industries that have mandatory legal requirements for it, such as bank, transportation, etc. As a data lake framework, it is very important for paimon in supporting data encryption to meet enterprise security standards. We should extend the current paimon architecture to provide users with out-of-the-box encryption capabilities.

Solution

See more info in PIP-11:Introduce Encryption Capability for Paimon

Anything else?

No response

Are you willing to submit a PR?

huyuanfeng2018 commented 5 months ago

hi @zhangjun0x01 , have you started the development work on this part? I seem to be able to get involved in some work