search

marcel-dempers / docker-development-youtube-series

5.24k stars 4.04k forks source link

FluentD over EKS #185

Closed crerem closed 11 months ago

crerem commented 1 year ago

Hi, I'm following your tutorial with FLuend on Kubernetes (eks).

I'm using the same config map and daemon image as in https://github.com/marcel-dempers/docker-development-youtube-series/tree/master/monitoring/logging/fluentd/kubernetes

Also, I'm using the @include pods-fluent.conf for the configMap since my cluster is an EKS one.

However, when I do the kubectl log on the pod, I get

2023-02-14 13:10:38 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:38.416347699Z stdout F 1684: Tue Feb 14 13:10:38 UTC 2023" 2023-02-14 13:10:39 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:39.417520592Z stdout F 1685: Tue Feb 14 13:10:39 UTC 2023" 2023-02-14 13:10:40 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:40.418799201Z stdout F 1686: Tue Feb 14 13:10:40 UTC 2023" 2023-02-14 13:10:41 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:41.419890815Z stdout F 1687: Tue Feb 14 13:10:41 UTC 2023" 2023-02-14 13:10:42 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:42.422986699Z stdout F 1688: Tue Feb 14 13:10:42 UTC 2023" 2023-02-14 13:10:43 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:43.424152882Z stdout F 1689: Tue Feb 14 13:10:43 UTC 2023" 2023-02-14 13:10:44 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:44.42524009Z stdout F 1690: Tue Feb 14 13:10:44 UTC 2023" 2023-02-14 13:10:45 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:45.426754838Z stdout F 1691: Tue Feb 14 13:10:45 UTC 2023" 2023-02-14 13:10:46 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:46.428101947Z stdout F 1692: Tue Feb 14 13:10:46 UTC 2023" 2023-02-14 13:10:47 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:47.429272745Z stdout F 1693: Tue Feb 14 13:10:47 UTC 2023" 2023-02-14 13:10:48 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:48.430449462Z stdout F 1694: Tue Feb 14 13:10:48 UTC 2023" 2023-02-14 13:10:49 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:49.431608198Z stdout F 1695: Tue Feb 14 13:10:49 UTC 2023" 2023-02-14 13:10:50 +0000 [warn]: #0 pattern not matched: "2023-02-14T13:10:50.432914447Z stdout F 1696: Tue Feb 14 13:10:50 UTC 2023"

I found the same kind of error on the files we set here <match **> @type file path /tmp/file-test.log

I try to change the time_format into time_format %a %b %d %H:%M:%S %Z %Y but the same problem occurs

Can you provide some assistance? Thank you

marceldempers commented 11 months ago

Not sure sure if this guide will work on recent kubernetes versions as the guide was done for 1.19. You may need to reference the public helm chart for fluentd to get a more up to date manifest. Also, most providers now use containerd and this guide was specific to docker runtime unfortunately.

There may be an updated guide in the future