search

rom1504 / embedding-reader

Efficiently read embedding in streaming from any filesystem
MIT License
94 stars 19 forks source link

add numpy + parquet reader #15

Closed rom1504 closed 2 years ago

rom1504 commented 2 years ago

https://github.com/rom1504/clip-retrieval produce aligned parquet/npy files for some use cases it's convenient to have both read at the same time

it could be convenient to have a reader providing both at once here

rom1504 commented 2 years ago

done