Implemented a "lite" docker image to reduce the overall storage footprint of the application, which will be used as the default for LibreChat.
This change aims to improve performance and reduce resource consumption, particularly for users with limited bandwidth or device capabilities.
The lite image omits the sentence_transformers package as by itself is 5 GB, and is necessary for local embeddings through the standalone HuggingFace provider.
Summary
Implemented a "lite" docker image to reduce the overall storage footprint of the application, which will be used as the default for LibreChat.
This change aims to improve performance and reduce resource consumption, particularly for users with limited bandwidth or device capabilities.
The lite image omits the sentence_transformers package as by itself is 5 GB, and is necessary for local embeddings through the standalone HuggingFace provider.