nautical-io / nautical

Open Source Model Serving Framework
2 stars 0 forks source link

Figure out how to build docker image with model weights #9

Open annanay25 opened 1 year ago

annanay25 commented 1 year ago

Currently, there is a hack in place to force the model to download weights upon startup - this involves running the model on a dummy input. Need to figure out if theres a way we can cache those weights and bake it into the image so we don't have to install it every time on the first run.