aws-samples / amazon-cloudwatch-container-insights

CloudWatch Agent Dockerfile and K8s YAML templates for CloudWatch Container Insights.
MIT No Attribution
162 stars 106 forks source link

Cannot seem to add a custom parser to the parsers conf of fluentd #141

Open punkle opened 1 year ago

punkle commented 1 year ago

The following error appears when starting fluentd. It continues to start up fine however it does not seem to continue to configure any custom parsers that come after it.

[2023/06/21 15:18:14] [error] [parser:container_firstline] Invalid regex pattern (?<log>(?<="log":")\S(?!\.).*?)(?<!\)".*(?<stream>(?<="stream":").*?)".*(?<time>\d{4}-\d{1,2}-\d{1,2}T\d{2}:\d{2}:\d{2}\.\w*).*(?=})

It seems to be configured here https://github.com/aws-samples/amazon-cloudwatch-container-insights/blob/main/k8s-deployment-manifest-templates/deployment-mode/daemonset/container-insights-monitoring/fluent-bit/fluent-bit.yaml#L229

omidraha commented 1 year ago

Same issue, I used fluent-bit.yaml mentioned here.

Info:

kubectl logs fluent-bit-4bqlk  -n amazon-cloudwatch -f
Fluent Bit v1.9.10
* Copyright (C) 2015-2022 The Fluent Bit Authors
* Fluent Bit is a CNCF sub-project under the umbrella of Fluentd
* https://fluentbit.io

[2023/08/31 19:43:28] [error] [parser:container_firstline] Invalid regex pattern (?<log>(?<="log":")\S(?!\.).*?)(?<!\)".*(?<stream>(?<="stream":").*?)".*(?<time>\d{4}-\d{1,2}-\d{1,2}T\d{2}:\d{2}:\d{2}\.\w*).*(?=})
[2023/08/31 19:43:28] [ info] [fluent bit] version=1.9.10, commit=1f4d09e087, pid=1
[2023/08/31 19:43:28] [ info] [storage] created root path /var/fluent-bit/state/flb-storage/
[2023/08/31 19:43:28] [ info] [storage] version=1.3.0, type=memory+filesystem, sync=normal, checksum=disabled, max_chunks_up=128
[2023/08/31 19:43:28] [ info] [storage] backlog input plugin: storage_backlog.0
[2023/08/31 19:43:28] [ info] [cmetrics] version=0.3.7
[2023/08/31 19:43:28] [ info] [input:storage_backlog:storage_backlog.0] queue memory limit: 4.8M
[2023/08/31 19:43:28] [ info] [sp] stream processor started