fluent / fluentd

Fluentd: Unified Logging Layer (project under CNCF)
https://www.fluentd.org
Apache License 2.0
12.84k stars 1.34k forks source link

disable fluentd time related file-splitting functionality #3318

Open lixiaochun opened 3 years ago

lixiaochun commented 3 years ago

Check CONTRIBUTING guideline first and here is the list to help us investigate the problem.

Is your feature request related to a problem? Please describe.

I use out file plugin in my case, the out file is splited daily by default. but I would like to disable fluentd time related file-splitting functionality so that I can use logrotate to fully split file based on time and size.

I don't know how to disable fluentd time related file-splitting functionality.

hope it can be supported.

I'm looking forward to your feedback:)

lixiaochun commented 3 years ago

I got some point from here, but still have no idea about how to disable time slicing for out file plugin. I really need your help:) https://serverfault.com/questions/620770/configuring-logrotate-for-fluentd-files-necessary

kenhys commented 3 years ago

It seems that no way to disable slicing at the moment. but how about specifying longer-term in timekey in <buffer> section? (it may be a dirty workaround)

BTW, why do you want to disable? What is missing feature for fluentd?

lixiaochun commented 3 years ago

It seems that no way to disable slicing at the moment. but how about specifying longer-term in timekey in <buffer> section? (it may be a dirty workaround)

BTW, why do you want to disable? What is missing feature for fluentd?

@ hi kenhys, I would like to slice output file based on size and time. ​ because in my case the the output file generated by file plugin is still too big even specifying daily longer-term in timekey as I know, only time slicing is supported by fluentd file plugin, size slicing is not supported this is why I want to disable time slicing for fluentd file plugin, and the output file is fully sliced using logrotate instead of fluentd file plugin to implement size and time based slicing...

lixiaochun commented 3 years ago

is there alternative way to solve it?