search

emsearcy / fluent-plugin-gelf

Buffered fluentd output plugin to GELF (Graylog2)
Apache License 2.0
33 stars 57 forks source link

MaxBytesLengthExceededException #26

Open poom opened 7 years ago

poom commented 7 years ago

IllegalArgumentException[Document contains at least one immense term in field="response" (whose UTF8 encoding is longer than the max length 32766), all of which were skipped. Please correct the analyzer to not produce such terms. The prefix of the first immense term is: '[123, 34, 115, 116, 97, 116, 117, 115, 34, 58, 50, 48, 48, 44, 34, 100, 97, 116, 97, 34, 58, 91, 123, 34, 105, 100, 34, 58, 49, 48]...', original message: bytes can be at most 32766 in length; got 465638]; nested: MaxBytesLengthExceededException[bytes can be at most 32766 in length; got 465638];

Can you have optional for truncate message or put original data to non-indexed field and truncate the message in indexed field?

emsearcy commented 7 years ago

Upstream issue Graylog2/graylog2-server#873

emsearcy commented 7 years ago

If you have a chance to to review my truncate-strings branch, that would be great. I haven't tested it yet, but as soon as I have a chance to, I plan to merge it into master.

emsearcy commented 7 years ago

truncate-strings wasn't supposed to be merged; I've reverted it to un-break the master branch.