Allow enabling `franz-go` logging from `kafka` package

elastic / apm-queue

Abstraction layer over Kafka / GCP PubSub Lite to produce and consume records

Apache License 2.0

6 stars 15 forks source link

Allow enabling `franz-go` logging from `kafka` package #540

Open endorama opened 2 months ago

endorama commented 2 months ago

The kafka package does not initialize franz-go logging nor exposes a way to do this. This means there is no way for callers to enable franz-go logging.

Goal

Allow enabling franz-go logging from kafka package callers.

inge4pres commented 2 months ago

Clarification: when we decide to pursue logging the entirety of messages from franz-go, we can remove what's been added in #541. If we want to make both approach co-exists, it would be sensible to somehow configure franz-go logging, meaning:

log level
filters to include/exclude entries at ingestion time

The previous note is assuming that we want to reduce the amount of data stored in our logging infrastructure, or at least limit to what's actually useful.