Adding the ability to read from .npy file

intel / ScalableVectorSearch

https://intel.github.io/ScalableVectorSearch/

GNU Affero General Public License v3.0

125 stars 18 forks source link

Adding the ability to read from .npy file #14

Closed slice4e closed 11 months ago

slice4e commented 11 months ago

Some datasets are availble in .npy format (e.g. https://laion.ai/blog/laion-400-open-dataset/ ) This facilitates loading those datasets directly without having to first transform them into another format.

hildebrandmw commented 11 months ago

Thanks for the contribution! Looks okay to me. Don't mind the CI failures, they are unrelated. Give me a bit of time to fix CI then I'm happy to merge.