search

nautical-io / nautical

Open Source Model Serving Framework
2 stars 0 forks source link

Figure out how to reduce the size of images #4

Open annanay25 opened 1 year ago

annanay25 commented 1 year ago

Current docker image size is ~5.5GB. Need to figure out a way to reduce this.

Also need to figure out how to install only specific python packages for specific models. For instance, if the user is interested in running the OpenAI whisper model (https://github.com/openai/whisper), install the ffmpeg package. But don't mandate it for the base image.

sauravpanda commented 1 year ago

One idea, why don't we download the model when someone starts the run? It can be part of the setup process.