projectnessie / nessie

Nessie: Transactional Catalog for Data Lakes with Git-like semantics
https://projectnessie.org
Apache License 2.0
988 stars 128 forks source link

[Feature]: Store audit logs #9312

Open nqvuong1998 opened 1 month ago

nqvuong1998 commented 1 month ago

Description

The Nessie catalog should persist all activity logs (username, query, DML, DDL,...), which can be stored in a backend database, ElasticSearch, or a file system.

Expected Use Cases

Admins can use activity logs for auditing.

Requested Changes in public API

No response

nqvuong1998 commented 1 month ago

cc @snazy @ajantha-bhat

dimas-b commented 1 month ago

Nessie provides events for the operations under its control.

One can build a custom Server and redirect those events, for example, to Kafka for further processing.