Further tests have show that the source is not the output. I'll close this
Describe the bug
The output creates an event nested field, containing an "original" field with the json payload parsed by logstash in there. It is problematic when using a strict mapping on the ES index as ES will reject the document insertion as this field is not on the mapping.
To Reproduce
Steps to reproduce the behavior:
Create an index with a strict mapping with no "event" field
use logstash to do something and output to the index
Expected behavior
This field could be interresting but i don't understand why it's default. Anyways, we should be able to disable it
Plugins
input rabbitmq
output opensearch
Host/Environment (please complete the following information):
OS: ubuntu 22.04
Logstash Version : container : opensearchproject/logstash-oss-with-opensearch-output-plugin:8.6.1
Additional context
There are some solutions to remove the field with filters but none work in this situation. The only thing we managed to do is to remove the "original" field, but no way to remove the "event" nested field
The conf :
EDIT
Further tests have show that the source is not the output. I'll close this
Describe the bug The output creates an event nested field, containing an "original" field with the json payload parsed by logstash in there. It is problematic when using a strict mapping on the ES index as ES will reject the document insertion as this field is not on the mapping.
To Reproduce Steps to reproduce the behavior:
Expected behavior This field could be interresting but i don't understand why it's default. Anyways, we should be able to disable it
Plugins input rabbitmq output opensearch
Host/Environment (please complete the following information):
Additional context There are some solutions to remove the field with filters but none work in this situation. The only thing we managed to do is to remove the "original" field, but no way to remove the "event" nested field The conf :
document example when NOT using a strict mapping :