openfoodfacts / robotoff-ann

GNU Affero General Public License v3.0
0 stars 0 forks source link

Change ANN library for a better one #146

Open alexgarel opened 2 years ago

alexgarel commented 2 years ago

The approximate nearest neighbour world is innovating a lot those years.

Annoy is far from being the best. See https://github.com/erikbern/ann-benchmarks

Change the ANN library for one of this.

Perf that interest us are on large dataset (we have more than 10M images) in cosine distance.

raphael0202 commented 2 years ago

And with a high embedding dimension (~800 for CLIP models).