apache / gravitino

World's most powerful open data catalog for building a high-performance, geo-distributed and federated metadata lake.
https://gravitino.apache.org
Apache License 2.0
696 stars 216 forks source link

[FEATURE] Supports unified auditing of Fileset metadata and data operations #4021

Open xloya opened 1 week ago

xloya commented 1 week ago

Describe the feature

Currently, only metadata operations of Fileset can be audited in Gravitino Server using Event Bus, but data operations of Fileset cannot be audited. This issue mainly discusses and implements a solution to audit both metadata operations and data operations of Fileset in Gravitino Server.

Motivation

No response

Describe the solution

No response

Additional context

No response

xloya commented 6 days ago

A doc for possible solutions: https://docs.google.com/document/d/1_2U_k33memegm-jEjtgDULUUdkaSoe3UpJBW1oiAJgE.