Facilitating usage as a vector codec

facebookresearch / faiss

A library for efficient similarity search and clustering of dense vectors.

https://faiss.ai

MIT License

31.57k stars 3.65k forks source link

Facilitating usage as a vector codec #3976

Open mdouze opened 1 month ago

mdouze commented 1 month ago

For some use cases, Faiss serves only as a storage engine for flat arrays of compressed vectors. Maybe it would be useful to make a wrapper that makes this easier to use (especially to make compression transparent). More details in this doc (visible internally in Meta):

https://docs.google.com/document/d/1v1KkD4KqrgHyjqgfykRQss37LdozZhqPMTYbymJlvDw/edit?usp=sharing

alexanderguzhva commented 1 month ago

@mdouze would it be possible to see this document? Thanks