search

rom1504 / embedding-reader

Efficiently read embedding in streaming from any filesystem
MIT License
92 stars 19 forks source link

try out new fsspec feature to speed up parquet read #33

Open rom1504 opened 1 year ago

rom1504 commented 1 year ago

https://developer.nvidia.com/blog/optimizing-access-to-parquet-data-with-fsspec/