Investigate whether it's possible to make some of the knn indices picklable

scikit-learn-contrib / sklearn-ann

Integration with (approximate) nearest neighbors libraries for scikit-learn + clustering based on with kNN-graphs.

https://sklearn-ann.readthedocs.io/en/latest/

BSD 3-Clause "New" or "Revised" License

15 stars 6 forks source link

Investigate whether it's possible to make some of the knn indices picklable #6

Open frankier opened 3 years ago

frankier commented 3 years ago

It is possible to mmap within a pickle: https://github.com/UniNE-CHYN/mmappickle so there might be hope

frankier commented 3 years ago

Neuraxle has support for custom saving e.g. https://github.com/Neuraxio/Neuraxle-TensorFlow . Unfortunately it reinvents quite a lot of sklearn stuff. Not sure if it's possible to support this as an optional extra while staying mainly on sklearn.