110214 handles synthetic source for flattened fields when ignore_above is used (child fields ignored due to ignore_above are now present in synthetic source). In that PR if there is any ignored child fields encountered during parsing it stores the entire object in _ignored_source field. This can be optimized by storing only ignored child fields in dedicated stored fields and then merging such values with valid child fields read from doc values. This is similar to how ignore_malformed works with synthetic source for other field types. This optimization will reduce storage space needed to handle this case.
Description
110214 handles synthetic source for
flattened
fields whenignore_above
is used (child fields ignored due toignore_above
are now present in synthetic source). In that PR if there is any ignored child fields encountered during parsing it stores the entire object in_ignored_source
field. This can be optimized by storing only ignored child fields in dedicated stored fields and then merging such values with valid child fields read from doc values. This is similar to howignore_malformed
works with synthetic source for other field types. This optimization will reduce storage space needed to handle this case.