The ignore_malformed property can be set at the index level and at the individual field level. I believe the field-level setting should override the index-level setting if both are present, but that is not the observed behavior for OpenSearch 2.4 and later.
Describe the bug
The
ignore_malformed
property can be set at the index level and at the individual field level. I believe the field-level setting should override the index-level setting if both are present, but that is not the observed behavior for OpenSearch 2.4 and later.Related component
Indexing
To Reproduce
Create an index like the following:
Index a document with a malformed value for the
number_two
field:This succeeds, but it should fail because the
ignore_malformed
value has been set to false for that field.Expected behavior
Field-level setting should override index-level setting.
Additional Details
This behaved as expected for versions of OpenSearch prior to 2.4.
Slack thread where originally reported: https://opensearch.slack.com/archives/C0539F41Z5X/p1730959987164549