Open ehsankf opened 1 month ago
To disable metadata usage in OpensearchVectorStore
for MetadataMode.LLM
and MetadataMode.EMBED
, you can modify the index_results
method in the OpensearchVectorClient
class. It uses MetadataMode.NONE
to exclude metadata from the content being indexed:
texts.append(node.get_content(metadata_mode=MetadataMode.NONE))
Regarding excluding embedding from metadata in the OpenSearch pipeline, embeddings are stored separately in the vector_field
, so they are not included in the metadata by default. The current implementation already excludes embeddings from metadata [1].
To continue talking to Dosu, mention @dosu.
Question Validation
Question
OpensearchVectorStore
retrieves the embedding along with text as a meta data from the index. How to disable using meta data in the following modes:As a followup question, can we set to exclude embedding from metadata from the opensearch pipeline.
Thanks.