Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
If you are interested in working on this issue or have submitted a pull request, please leave a comment
Problem
We use the vector configuration attached below
According to the vector documentation :
Partial message merging
By default, Vector merges partial messages that are split due to the Docker size limit. For everything else, we recommend that you use the reduce\transform, which enables you to handle custom merging of things like stacktraces.
Our applications in k8s can have logs larger than 1MB. They are split by container runtime(docker) into partial. In kafka we already see a split message.
We also tried to use a configuration without transformations
A note for the community
Problem
We use the vector configuration attached below
According to the vector documentation :
Partial message merging By default, Vector merges partial messages that are split due to the Docker size limit. For everything else, we recommend that you use the reduce\transform, which enables you to handle custom merging of things like stacktraces.
Our applications in k8s can have logs larger than 1MB. They are split by container runtime(docker) into partial. In kafka we already see a split message.
We also tried to use a configuration without transformations
Configuration
Version
0.34.2-alpine
Debug Output
No response
Example Data
No response
Additional Context
No response
References
No response