Graylog2 / graylog2-server

Free and open log management
https://www.graylog.org
Other
7.38k stars 1.06k forks source link

Pineline key value parser does not support Chinese keys #12629

Open 775838893 opened 2 years ago

775838893 commented 2 years ago

Expected Behavior

supports chinese key in pineline

Current Behavior

missing key of chinese when parse in pineline

Steps to Reproduce (for bugs)

my pinelines rules as follows:

rule "key value parser demo"
when
contains(to_string($message.message), "日志类型")
then
set_fields(
    fields:
        key_value(
            value: to_string($message.message),
            delimiters:"  ",
            trim_value_chars: "",
            trim_key_chars:"",
            kv_delimiters:"="
        )
    );
end

result:

image

Environment

denity commented 2 years ago

Also, in Graylog 4.3.4+aae97b4, json extractor and key=value converter don't regonize chinese keys. They will ignore all the chinese keys and theirs values.