search

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.5k stars 1.68k forks source link

Logging in DeltaLake #603

Open himanshujindal opened 3 years ago

himanshujindal commented 3 years ago

I am running Delta Lake in standalone mode and want to enable DeltaLogging - (https://github.com/delta-io/delta/blob/master/src/main/scala/org/apache/spark/sql/delta/metering/DeltaLogging.scala) but I am having trouble enabling this. It might be that this Databricks logging which is a premium feature and cannot be accessed in the open source feature. ( https://docs.databricks.com/administration-guide/account-settings/audit-logs.html ) I was unable to find documentation to confirm this though. Is my assumption that deltalogging can accessed only through premium feature correct?

AFFogarty commented 3 years ago

I opened this PR which would allow you to enable a custom logger: https://github.com/delta-io/delta/pull/679