Adding the ability to read from .npy file

intel / ScalableVectorSearch

https://intel.github.io/ScalableVectorSearch/

GNU Affero General Public License v3.0

115 stars 17 forks source link

Adding the ability to read from .npy file #14

Closed slice4e closed 9 months ago

slice4e commented 9 months ago

Some datasets are availble in .npy format (e.g. https://laion.ai/blog/laion-400-open-dataset/ ) This facilitates loading those datasets directly without having to first transform them into another format.

hildebrandmw commented 9 months ago

Thanks for the contribution! Looks okay to me. Don't mind the CI failures, they are unrelated. Give me a bit of time to fix CI then I'm happy to merge.