databricks / iceberg-kafka-connect

Apache License 2.0
220 stars 49 forks source link

move-noisy-debug-logs-to-debug #242

Closed tabmatfournier closed 7 months ago

tabmatfournier commented 7 months ago

These logs are the equivalent of "HERE" and account for ~75% of the logs but are generally not useful and drive up logging costs for anyone using this in production. Moved them to debug level if someone needs to debug something going on in an error scenario, but generally these logs have no context and are not useful.

Unfortunately, users can't blacklist worker/channel/coordinator in their log platform of choice as there are useful log messages around table commits succeeding. No metrics are available yet that can replace successful commits.

Moved them to debug level in the off chance someone is using them. Could be convinced to delete them entirely.