lmcinnes / pynndescent

A Python nearest neighbor descent for approximate nearest neighbors
BSD 2-Clause "Simplified" License
899 stars 105 forks source link

Distributed PyNNDescent #191

Open gorlando04 opened 2 years ago

gorlando04 commented 2 years ago

I'm doing a research about distributed ways do build the kNNG, and i am especifically studying NNDescent. When i tested the distributed-pynndescent, that is in the fork, i couldn't perform it. Is this algorithm ready or it is on development?

lmcinnes commented 2 years ago

It is certainly in the category of "in development" rather than ready for mainstream use. It does also require dask, and ideally dask.distributed, including setting up a dask cluster with workers before running, which may be part of the issue.