search

jina-ai / annlite

⚡ A fast embedded library for approximate nearest neighbor search
Apache License 2.0
216 stars 22 forks source link

Can annlite be accelerated? #194

Open geekchen007 opened 2 years ago

geekchen007 commented 2 years ago

Can annlite be accelerated? I currently build a database on 170w databases with 512 embedded length. Each reload takes about 2 minutes, which is too slow

jemmyshin commented 2 years ago

what is the version of annlite you use now?

geekchen007 commented 2 years ago

annlite=0.3.13

numb3r3 commented 2 years ago

Each reload takes about 2 minutes, which is too slow

We are working on refactoring reload function to allow restoring index from local backup. please track the PR https://github.com/jina-ai/annlite/pull/177

numb3r3 commented 1 year ago

@geekchen007 FYI, in the latest annlite, the dump and load functions are supported. Please simply read the README https://github.com/jina-ai/annlite#dump-and-load