opensearch-project / documentation-website

The documentation for OpenSearch, OpenSearch Dashboards, and their associated plugins.
https://opensearch.org/docs
Apache License 2.0
65 stars 442 forks source link

[DOC] Faiss Byte Vector #7661

Open naveentatikonda opened 2 weeks ago

naveentatikonda commented 2 weeks ago

What do you want to do?

Tell us about your request. Provide a summary of the request. For lucene engine we have Lucene byte vector feature, which accepts byte vectors in the range [-128 to 127] providing memory savings upto 75% when compared with fp32 vectors. But, for large scale workloads we usually prefer to use faiss engine and as of today Faiss only supports fp32 and fp16 vectors(using SQfp16). So, adding byte vector support to faiss engine helps to reduce memory requirements especially for those users who are using LLM like Cohere Embed that generates signed int8 embeddings ranging from [-128 to 127].

*Version: List the OpenSearch version to which this issue applies, e.g. 2.14, 2.12--2.14, or all. 2.16

What other resources are available? Provide links to related issues, POCs, steps for testing, etc. https://github.com/opensearch-project/k-NN/issues/1659

naveentatikonda commented 2 weeks ago

Please add 2.16 label. Thanks!

naveentatikonda commented 1 week ago

Please change the label to 2.17. Thanks!

hdhalter commented 1 week ago

Please change the label to 2.17. Thanks!

Done. Thanks!