preload_model set in config.properties does not work for load model request

awslabs / multi-model-server

Multi Model Server is a tool for serving neural net models for inference

Apache License 2.0

998 stars 230 forks source link

preload_model set in config.properties does not work for load model request #977

Open lxning opened 2 years ago

lxning commented 2 years ago

preload_model=true set in config.properties. send request: POST /models start mms, the following log shows that preload_model is still false when mms sends cmd to backend server.