[Buffer] Potential improvement

[ecristea]

Fluentd v0.14.7 added a new feature Data compression support in buffers and forward plugin, and the release notes contain following information:

Fluentd compresses events before writing these into buffer chunk, and extract these data before passing these to output plugins

Reference

If this is still valid IMHO will be worth to add this sentence for the compress buffering parameter

[fujimotos]

If this is still valid IMHO will be worth to add this sentence for the compress buffering parameter

@ecristea My understanding is that compressed chunks are decompressed if the output plugin does not support compressed data transfer.

For example, if you use out_forward with compress: gzip, these gzip-compressed chunks are actually send to the corresponding in_forward instance as is. So no wasteful round-trip will happen (like: gzip -> text -> gzip).

Is this behaviour what you are referencing? If so, I will add a small note to the section which explains the behaviour.

[ecristea]

@fujimotos Yes, I do believe such a note will help.

[fujimotos]

I have appended the information to the document in the patch #527.

If you feel anything missing, please feel free to reopen this issue.