mozilla-services / heka

DEPRECATED: Data collection and processing made easy.
http://hekad.readthedocs.org/
Other
3.39k stars 531 forks source link

Add a remap_original_input_fields configuration option for JSON decoder. #1867

Closed mattmoyer closed 7 years ago

mattmoyer commented 8 years ago

This allows fields from the original message to be renamed and attached to the decoded messages. This is useful to capture fields set in input plugin pack decorators, e.g, capturing RemoteAddr from the HttpListenInput or capturing Offset from the KafkaInput.

The syntax is a little funky (space-delimited list of newField=newField). I didn't see an easy way to pass a map/table configuration value from the configuration .toml down into a SandboxPlugin. Is this a reasonable way to do this?

fire commented 8 years ago

As someone who's not on the development team but would like to try this, can you update this to master?