Flagro / VecMetaQ

Server over Python Faiss serverless implementation to match interfaces used in langchain
https://flagrotown.com
MIT License
2 stars 0 forks source link

Important: lighten up the docker image #11

Open Flagro opened 8 months ago

Flagro commented 8 months ago

Currently the image weights over 3 GB because of all the CUDA drivers for FAISS in multiarchitechtural build, this needs to be fixed

Flagro commented 7 months ago

Possible solution: https://stackoverflow.com/questions/77205123/how-do-i-slim-down-sberts-sentencer-transformer-library