[fluentd-elasticsearch] Exclude specific pods from log collection

kiwigrid / helm-charts

Helm charts for Kubernetes curated by Kiwigrid

https://kiwigrid.github.io

MIT License

186 stars 209 forks source link

[fluentd-elasticsearch] Exclude specific pods from log collection #341

Closed rgarcia89 closed 4 years ago

rgarcia89 commented 4 years ago

FEATURE REQUEST:

Is it somehow possible to exclude specific pods from log collection? I am especially thinking about the fluentd pods. They are producing tons of logs. Or only collect the stderr logs.

Which chart in which version: fluentd-elasticsearch-8.0.1

ChrisCooney commented 4 years ago

👍 Would love to see this!

monotek commented 4 years ago

What about: https://docs.fluentd.org/filter/record_transformer#remove_keys

rgarcia89 commented 4 years ago

This looks to me more like to filter out a key. However, what about filtering out for example all pods that have a label set logging=false. I have found the following fragment that excludes an entire namespace, which is also nice to save. But not what I was looking for

<match kubernetes.var.log.containers.**_kube-system_**>
  @type null
</match>

stale[bot] commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.