FlagOpen / FlagEmbedding

Retrieval and Retrieval-augmented LLMs
MIT License
7.1k stars 519 forks source link

feature request: Matryoshka embedding #438

Open VoVAllen opened 8 months ago

VoVAllen commented 8 months ago

Is there any plan to support Matryoshka embedding like OpenAI text-embedding-3?

Ref: https://arxiv.org/abs/2205.13147

staoxiao commented 8 months ago

Thanks for your suggestion! We will consider this in the next version.

VoVAllen commented 8 months ago

Looking forward to it! It's super useful in the vector database, so that user can use a subvector to build the index, with much less resources needed but got similar results.

supercoderhawk commented 6 months ago

Any Update ? This feature is very important for us.