search

fluent / fluentd-kubernetes-daemonset

Fluentd daemonset for Kubernetes and it Docker image
Apache License 2.0
1.26k stars 978 forks source link

Using fluentd (Azure Blob) with auto-scaled pods (HPA) #1381

Closed karthik25 closed 1 year ago

karthik25 commented 2 years ago

Hello,

This is more of a question than an issue. I have tried googling an answer for this to no avail. I was able to add fluentd logging to Azure Blobs to my cluster. So far so good. The issue I currently face is that the logs for the pods created by the horizontal pod auto-scaler (using KEDA) don't seem to get pushed to the blob account. It does make sense why. The pod gets provisioned and terminated before the logs can be pushed. What I am trying to find is if there is a way to deal with this. I tried setting a terminationGracePeriodSeconds value of 30 seconds, but that does not seem to be enough. Is there a certain value I should set for this property to keep the pod long enough for the logs to be pushed?

I also have log analytics based logging, so this is not necessarily a big issue. But wanted to know if there is a way nevertheless.

Thank you!

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has been open 90 days with no activity. Remove stale label or comment or this issue will be closed in 30 days

github-actions[bot] commented 1 year ago

This issue was automatically closed because of stale in 30 days