search

deepfates / memery

Search over large image datasets with natural language and computer vision!
https://deepfates.com/memery
MIT License
525 stars 27 forks source link

Switch similarity search to different library #30

Open deepfates opened 2 years ago

deepfates commented 2 years ago

Annoy takes a long time to build, maybe there's something else out there that doesn't

igorbrigadir commented 2 years ago

Curious to see what you end up with here. I had some good benchmarks from https://github.com/nmslib/hnswlib

deepfates commented 2 years ago

This looks quite useful, thank you! It can do CRUD ops on individual elements in the index which is desirable.

It does look like it needs to know the maximum possible number of elements before creating the index, but maybe we can work within that constraint..

On Mon, Mar 21, 2022, 12:52 PM Igor Brigadir @.***> wrote:

Curious to see what you end up with here. I had some good benchmarks from https://github.com/nmslib/hnswlib

— Reply to this email directly, view it on GitHub https://github.com/deepfates/memery/issues/30#issuecomment-1074287339, or unsubscribe https://github.com/notifications/unsubscribe-auth/AN7DJVCVTQH5XKWWNSYIGQ3VBDANFANCNFSM5RFYAOCA . You are receiving this because you authored the thread.Message ID: @.***>

igorbrigadir commented 2 years ago

Yeah the way I used it last time was just setting an order of magnitude of expected entries, and if you fill up, you can always reindex (which isn't as bad as it sounds, usually)