kedacore / keda-olm-operator

Operator for deploying KEDA Controller on OperatorHub.io/OLM
Apache License 2.0
31 stars 23 forks source link

Fluentd config for processing keda logs #84

Closed leonids2005 closed 3 years ago

leonids2005 commented 3 years ago

A clear and concise description of what you want to happen.

I am using Fluentd to send logs to ELK and multiline KEDA logs are not handled properly.

Use-Case

Obviously, it is possible to create a regex definition to handle multiline logs but the ideal option will be if KEDA logs will be in Json format to make it easier to work with.

Specification

To be more specific - here is the example - by default call stack details are processed as single-line log entries

2021-03-27T11:24:07.220Z ERROR controller Reconciler error {"reconcilerGroup": "keda.sh", "reconcilerKind": "ScaledObject", "controller": "scaledobject", "name": "function-eventhub-processing", "namespace": "default", "error": "Operation cannot be fulfilled on scaledobjects.keda.sh \"function-eventhub-processing\": StorageError: invalid object, Code: 4, Key: /registry/keda.sh/scaledobjects/default/function-eventhub-processing, ResourceVersion: 0, AdditionalErrorMsg: Precondition failed: UID in precondition: fb1508ea-aa4d-4cfb-90c5-5acf5b383beb, UID in object meta: "}

github.com/go-logr/zapr.(zapLogger).Error /go/pkg/mod/github.com/go-logr/zapr@v0.1.1/zapr.go:128 sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).reconcileHandler /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.2/pkg/internal/controller/controller.go:237 sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).processNextWorkItem /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.2/pkg/internal/controller/controller.go:209 sigs.k8s.io/controller-runtime/pkg/internal/controller.(Controller).worker /go/pkg/mod/sigs.k8s.io/controller-runtime@v0.6.2/pkg/internal/controller/controller.go:188 k8s.io/apimachinery/pkg/util/wait.BackoffUntil.func1 /go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:155 k8s.io/apimachinery/pkg/util/wait.BackoffUntil /go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:156 k8s.io/apimachinery/pkg/util/wait.JitterUntil /go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:133 k8s.io/apimachinery/pkg/util/wait.Until /go/pkg/mod/k8s.io/apimachinery@v0.18.8/pkg/util/wait/wait.go:90

leonids2005 commented 3 years ago

sorry added to wrong repo